Skip to content
How I AIHow I AI

How the engineer behind Claude Cowork actually uses Claude | Felix Rieseberg (Anthropic)

Felix Rieseberg is the engineering lead for Claude Cowork and Claude Code Desktop at Anthropic. He previously spent five years at Slack building developer tools. In this episode, Felix demonstrates how he uses Claude to solve real-life problems: analyzing floor plans to build interactive 3D house walkthroughs, automatically tracking promises he makes on Twitter, and building a $20 hardware device that physically approves Claude actions with a button press. *What you’ll learn:* 1. How to use Claude Cowork to turn a 2D floor plan into an interactive 3D walkthrough where you can move furniture around 2. The “go one abstraction layer up” philosophy: why you should never manually enter data Claude can find itself 3. How to use your email as an inventory database for furniture, clothing, and personal purchases 4. When to use Opus vs. Sonnet 4.6 (hint: it’s about how well you can scope the problem, not technical complexity) 5. How live artifacts work and why they’re powerful for dashboards that refresh with real-time data from your connectors 6. The product philosophy behind making latency delightful 7. How to build your own $20 hardware device using Claude Code (no hardware experience required) 8. Why Felix never reads the code Claude writes and judges it purely on output *Brought to you by:* Magic Patterns—Prototypes that look like your product: https://magicpatterns.com/howiai Guru—The AI layer of truth: http://getguru.com/ *In this episode, we cover:* (00:00) Introduction to Felix Rieseberg (02:40) Felix’s role at Anthropic (03:25) The multiple tabs in Claude and why they exist (05:55) Using Claude Cowork to design a new house using floor plans (09:52) When to use Opus versus Sonnet 4.6 (12:37) Building an interactive 3D furniture planner (14:30) Using your email as a source of truth for personal inventory (15:58) The anti-to-do list: going one abstraction layer up (23:14) Introduction to live artifacts (26:02) Building a personal dashboard with live data (28:37) Being polite to Claude (and why it matters for your humanity) (30:28) Claude interaction tips (32:33) Looking at the daily dashboard (33:55) How live artifacts work with connectors (35:02) Redesigning the dashboard (37:55) The biggest gap: people don’t know what problems AI can solve (41:52) The reverse interview (42:30) Making latency delightful through asynchronous design (44:05) The redesigned dashboard (45:28) AI should free up your creative energy (46:44) Building a $20 hardware Claude buddy (52:33) Why kids are magical AI users (54:30) Recap and final thoughts *Blog & detailed workflow walkthroughs from this episode:* How I AI: Felix Rieseberg’s Claude Workflows for 3D House Design and a $20 Hardware Buddy: https://www.chatprd.ai/how-i-ai/felix-rieseberg-claude-code-cowork-workflows-for-3d-house-design-and-hardware-buddy ↳ How to Build a $20 Physical AI ‘Buddy’ with Claude Code: https://www.chatprd.ai/how-i-ai/workflows/how-to-build-a-20-physical-ai-buddy-with-claude-code ↳ How to Create an Interactive 3D House Model from a Floor Plan Using AI: https://www.chatprd.ai/how-i-ai/workflows/how-to-create-an-interactive-3d-house-model-from-a-floor-plan-using-ai ↳ How to Build a Live, Auto-Updating Personal Dashboard with Claude: https://www.chatprd.ai/how-i-ai/workflows/how-to-build-a-live-auto-updating-personal-dashboard-with-claude *Tools referenced:* • Claude Cowork: https://www.anthropic.com/product/claude-cowork • Claude Code: https://claude.ai/code • Claude for Chrome: https://code.claude.com/docs/en/chrome • Claude Desktop: https://claude.ai/download • Live Artifacts: https://support.claude.com/en/articles/14729249-use-live-artifacts-in-claude-cowork • Connectors (Spotify, Gmail, Calendar, Notion): https://claude.ai/settings/connectors • Slack: https://slack.com/ *Where to find Felix Rieseberg:* Website: https://felixrieseberg.com/ LinkedIn: https://www.linkedin.com/in/felixrieseberg/ X: https://x.com/felixrieseberg GitHub: https://github.com/felixrieseberg *Where to find Claire Vo:* ChatPRD: https://www.chatprd.ai/ Website: https://clairevo.com/ LinkedIn: https://www.linkedin.com/in/clairevo/ X: https://x.com/clairevo _Production and marketing by https://penname.co/._ _For inquiries about sponsoring the podcast, email jordan@penname.co._

Felix RiesebergguestClaire Vohost
May 25, 202659mWatch on YouTube ↗

CHAPTERS

  1. 0:00 – 2:40

    Why AI should remove busywork (and free your creative energy)

    Felix and Claire open with a philosophy: AI is most valuable when it quietly handles annoying background tasks rather than “driving the mouse.” They preview the episode’s practical theme—finding everyday workflows where Claude meaningfully reduces cognitive load.

    • AI is “used poorly” when it only automates superficial interactions
    • Goal: offload tedious work to reclaim creative time
    • Preview of Claude workflows and a $20 hardware “Claude buddy”
    • Framing: the real gap is translating problems into AI workflows
  2. 2:40 – 7:15

    Felix’s role at Anthropic and why Claude has multiple “tabs”

    Felix explains his scope—Claude Cowork, Claude Code, Chrome, and desktop apps—and why the product offers multiple entry points. He compares today’s AI UX to the pre-smartphone era: experimentation across form factors before convergence.

    • Felix leads engineering for several Claude client products
    • Multiple tabs reflect different user intents (quick answers vs deep work vs engineering)
    • Current era = experimentation with UX “form factors”
    • Long-term vision: fewer choices, more unified experience
  3. 7:15 – 9:51

    A real Cowork workflow: turning a house folder into actionable plans

    Felix shares a moving-related workflow: he collects floor plans, disclosures, permits, and other docs into a folder and asks Cowork to infer missing details (like dimensions). Claude uses that context to generate more useful versions of documents and jump-start planning.

    • Organize a single folder as the project’s source of truth
    • Ask Claude to infer units/dimensions from related documents (e.g., permits)
    • Use Cowork’s ability to work across multiple files in context
    • Workflow mindset: start with a concrete problem and let Claude expand possibilities
  4. 9:51 – 12:32

    Opus vs Sonnet 4.6: choosing the model based on problem ambiguity

    Claire presses Felix on when to use Opus versus Sonnet. Felix’s heuristic is about how well-scoped the problem is: use Opus when you need help reframing the question itself, not just executing clearly-defined steps.

    • Sonnet 4.6 is sufficient for most everyday tasks
    • Opus is best when you don’t yet know what you’re really asking
    • Model choice depends on tolerance for misinterpretation/reframing
    • Analogy: experts (lawyers/doctors/creatives) reinterpret the real problem
  5. 12:32 – 14:34

    Claude generates an interactive 3D furniture planner (without being asked)

    Felix shows how Claude went beyond “place furniture on a floor plan” and produced an interactive planner, then even built a 3D walk-through model. He highlights Cowork’s core capability: Claude can use its own virtual machine to build whatever software it needs.

    • Artifact output can be a full interactive app, not just text
    • Cowork provides Claude a virtual computer/dev environment
    • Claude inferred a 3D approach from a 2D floor plan using image analysis
    • Value is emergent: Claude proposes solutions users didn’t think to request
  6. 14:34 – 15:45

    Email as a personal inventory database (furniture today, clothes tomorrow)

    They explore a powerful pattern: treat email receipts as a “source of truth” for what you own. Felix uses connected email to automatically extract furniture purchases and dimensions; Claire notes broader uses like moving inventories and wardrobe tracking.

    • Email receipts/confirmations can be mined for structured inventory
    • Claude can extract items, dimensions, vendors, and dates from purchase history
    • Reduces manual entry when planning moves or organizing possessions
    • Generalizable idea: build personal data systems from existing exhaust
  7. 15:45 – 18:07

    The “anti-to-do list”: keep climbing one abstraction level up

    Felix and Claire describe a habit shift: whenever you’re doing tedious manual work, step back and ask for the higher-level goal. The aim is not only delegating the task to Claude once, but designing a system so you never have to do it again.

    • Notice tedious work → ask “what’s the higher-level objective?”
    • Replace manual data entry with “Claude, you figure it out”
    • Next step: make it persistent so it stays solved long-term
    • Mindset: spend your time steering and deciding, not transcribing
  8. 18:07 – 23:14

    Promise tracking as an ongoing system (and letting go of perfectionism)

    Felix shares a personal automation: Claude reads his messages to track promises he made and reminds him when they’re due, using lightweight storage like SQLite/text files. They discuss a key unlock—judging by outcome, not whether Claude’s internals are “architecturally perfect.”

    • Claude can monitor messages to track commitments and deadlines
    • Automation can store state in simple local databases/files
    • Shift from code-reviewing everything to evaluating real-world impact
    • AI use expands into domains where you’re not the expert (e.g., medical info)
  9. 23:14 – 26:11

    From Artifacts to Live Artifacts: what they are and why they matter

    Felix defines artifacts as file-like outputs (pages, PDFs, apps), then introduces Live Artifacts: artifacts that can refresh with updated data. The key benefit is reducing repetitive “update work” (like pitch decks and dashboards) by keeping outputs connected to live sources.

    • Artifacts = durable outputs (documents, apps, spreadsheets, PDFs)
    • Live Artifacts add refreshable data so outputs stay current
    • Use case: founder pitch decks and recurring reports that need updates
    • Core idea: keep one template and continuously refresh the underlying facts
  10. 26:11 – 28:41

    Building a personal daily dashboard using connectors (OAuth, refresh, and remixing)

    They demo a daily dashboard Live Artifact pulling from connectors (Spotify, Gmail, Calendar, Notion, etc.) without managing API keys. Claire highlights the refresh button and OAuth reuse; Felix emphasizes going beyond calendar summaries to richer preparation via cross-referencing context.

    • Connectors bring external data into Claude via simple auth flows
    • Live Artifact refresh button reloads and recomputes the dashboard
    • Better dashboards prep you for meetings by summarizing context and relationships
    • Artifacts are “clay”: style and widgets can be iterated quickly
  11. 28:41 – 42:21

    Being polite to Claude—and a practical tip: assert what’s possible

    Claire asks about Felix’s consistently polite tone; both argue it’s about preserving your own humanity and communication habits. Felix adds a practical prompting tactic: if you know something is possible but hard, explicitly state that to boost follow-through and reduce unproductive pushback.

    • Politeness is for the human’s mindset, not the model’s feelings
    • “I believe in you / I know it’s possible” can reduce back-and-forth
    • Tip: preempt refusals by framing as exploratory/creative work
    • Trust-building helps users stop hovering and let work run asynchronously
  12. 42:21 – 46:42

    Designing around latency: make async work feel normal (and worth it)

    They discuss product design principles for AI’s inherent wait time: users will tolerate latency if the result quality is high and the system is reliably trying in the background. Felix argues the real goal is to stop making users watch AI work and instead let it operate asynchronously while humans do higher-value thinking.

    • Latency is acceptable when outcomes are high-quality
    • Asynchronous retries (Slack/iMessage analogy) reduce perceived failure
    • Don’t make users “watch” the model; build for background execution
    • Trust > patience: confidence in completion changes user behavior
  13. 46:42 – 59:25

    A $20 hardware Claude buddy: approvals, notifications, and kid-friendly interfaces

    Felix demonstrates a tiny Wi‑Fi/Bluetooth device that pairs with Claude to signal when approvals are needed and celebrate progress—built via Claude Code with minimal hardware expertise. They close by reflecting on kids as fearless AI users, and end with prompting/feedback tactics (debugging with Claude and using thumbs-down for product improvement).

    • Low-cost hardware + Claude Code enables custom physical companions
    • Device supports approval workflows with a big physical button
    • Kids are “magical” AI users because they haven’t learned learned helplessness
    • When Claude goes off-rails: debug expectations and improve harness/prompt
    • Use thumbs up/down feedback to help improve Claude products

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.