How I AIHow a visually impaired engineer builds personal software with Claude Code + Wispr Flow
CHAPTERS
Losing central vision—and how AI changed what’s possible
Joe McCormick shares how he lost most of his central vision to Leber’s hereditary optic neuropathy right before college, and how today’s AI tools dramatically reduce the friction of daily life and work. He frames AI as a gap-closer between sighted and visually impaired software engineers and as a major accelerant for accessibility.
Why micro “personal software” matters for accessibility
Claire and Joe discuss the underappreciated benefit of AI: enabling people to build highly customized tools for themselves when the market wouldn’t fund niche accessibility products. Joe positions micro-apps as fast-to-build, high-ROI solutions that match an individual’s specific workflow.
Chrome extensions vs AI-native browsers: the “drill” vs “Swiss Army knife”
Joe explains why he prefers targeted Chrome extensions over all-in-one AI browsers for certain tasks. Purpose-built extensions can be faster and more reliable for specific workflows, especially when triggered by quick keyboard shortcuts.
Demo: Slack image-description shortcut with follow-up Q&A
Joe demonstrates a Slack-focused tool that describes images on demand, avoiding tedious zooming and manual parsing. The extension not only generates an image description but also supports conversational follow-ups for deeper context.
Extending the idea to Figma: interpreting UI designs faster
Joe previews a similar concept for Figma: describing selected nodes with prompts tailored to engineering needs. The goal is to reduce the click-heavy process of extracting design details and make design reviews more efficient and accessible.
Demo: universal spell-check shortcut optimized for screen readers
Joe shows an extension that spell-checks text in any web input field using a single shortcut. Unlike many tools (e.g., Grammarly), it’s designed to be screen-reader accessible and to preserve the writer’s wording while fixing only typos.
From manual workflows to automation: collapsing the “payback period”
Joe and Claire unpack why these micro-tools are worth building now: they save minutes daily and take minutes to create. Joe describes iterating from clunky workflows (copying into ChatGPT) to embedded, one-keystroke actions that keep him in flow.
Building a Slack link summarizer: defining the problem and desired UX
Joe proposes a new extension: summarize external links posted in Slack so he can decide quickly whether to read or ignore. The design goal is a sub-10-second workflow that replaces “save for later” accumulation with immediate triage.
Drafting the PRD by voice in VS Code (and why it works)
Joe dictates a lightweight PRD using VS Code’s Copilot audio, then reviews and refines it. The PRD emphasizes privacy, speed, and accessibility, illustrating how AI helps engineers produce solid product documentation quickly.
Scaffolding with Claude Code + a Chrome-extension “Skill”
Joe uses Claude Code in planning mode and invokes a custom Claude Skill derived from prior extensions to standardize patterns. He also explains accessibility-oriented workflow tweaks, like editing prompts in an editor and using audible cues for required input.
Loading the extension in Chrome Developer Mode and first test run
Joe loads the unpacked extension locally via Chrome Developer Mode and refreshes Slack to activate it. The first attempt works functionally but renders the output as raw JSON, prompting a quick iteration cycle.
Debugging fast: screenshot-to-Claude, response formatting fix, successful demo
Joe captures a screenshot of the broken UI and sends it back to Claude Code using a custom slash command (bridging Windows clipboard to WSL). He adjusts the OpenAI response handling to return structured JSON correctly and re-tests successfully, producing clean takeaways in an accessible modal.
Lightning round: MCPs, accessibility, and the promise of multimodal AI
Joe shares how MCPs can reduce tool-switching and improve accessibility by pulling content into simpler formats like markdown. He also highlights a deeply personal multimodal win: using Gemini’s live features to “read” kids’ books page-by-page, transforming a painful limitation into a shared family experience.
Prompting and iteration philosophy + where to find Joe
Joe explains his pragmatic strategy when AI gets stuck: reset context and restart with distilled learnings rather than endlessly “massaging” a broken thread. The episode closes with Joe sharing how to connect with him and noting Babylist hiring for AI-forward engineering roles.
Get more out of YouTube videos.
High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.
Add to Chrome