Skip to content
How I AIHow I AI

How I manage 15 AI agents 24/7 as a solo founder | Ryan Carson

Ryan Carson is a five-time founder and the current solo founder of Untangle, a B2B SaaS platform for family law firms. Before Untangle, he co-founded Treehouse, an online coding education platform, and has spent the better part of two decades building and leading tech companies. He’s active on X, where he shares his solo founder journey in real time, including what he actually spends on AI tools each month. *What you’ll learn:* 1. Why Ryan manages 15 concurrent Devin agents with a folder system and a piece of paper, not a dashboard 2. The Watchdog playbook: what he built to replace a customer success team across every law firm account 3. How his LAN PR skill closes the loop on 40 daily PRs without a QA team reviewing a single one 4. Why he moved off local agents almost entirely, and the one situation where he still reaches for Codex 5. The design workflow we’re both using: Claude Design into a Markdown spec, then Codex to build the real thing 6. What he found when he got away from his computer and met a real customer, and why it changed his entire product direction 7. How he’s hiring his first engineer without a single phone screen or interview 8. Why we both think more AI output is actually the wrong goal, and what to optimize for instead *Brought to you by:* WorkOS—Make your app enterprise-ready, with SSO, SCIM, RBAC, and more: https://workos.com?utm_source=lennys_howiai&utm_medium=podcast&utm_campaign=q22025 Jira AI SDLC—Get your tokens’ worth with Jira: https://jira.dev *Blog and detailed workflow walkthroughs from this episode:* How Ryan Carson Manages 40 PRs a Day with Devin and Codex: https://www.chatprd.ai/how-i-ai/how-ryan-carson-manages-40-prs-a-day-with-devin-and-codex ↳ Create a Production-Ready Design System Using Claude and Codex: https://www.chatprd.ai/how-i-ai/workflows/create-a-production-ready-design-system-using-claude-and-codex ↳ Scale Code Quality with an Automated Land PR AI Workflow: https://www.chatprd.ai/how-i-ai/workflows/scale-code-quality-with-an-automated-land-pr-ai-workflow ↳ Automate Business Health Checks with a Watchdog AI Agent Playbook: https://www.chatprd.ai/how-i-ai/workflows/automate-business-health-checks-with-a-watchdog-ai-agent-playbook *In this episode, we cover:* (00:00) Introduction to Ryan Carson (02:55) Ryan’s update: Untangle, the divorce PMF pivot, and B2B growth (07:35) Ryan’s current Devin stack: folders, P0 threads, and the paper list (16:29) Watchdog playbook: account monitoring across every firm (18:09) Managing agent decision fatigue: Ryan’s method vs. Claire’s (20:32) Producing more output does not make a better product (22:47) Using cloud agents for ops beyond just code (25:14) When to use Codex vs. Devin vs. Claude Code (27:15) Merge Mommy recap (28:15) LAN PR skill: review loops, video walkthrough, and auto-merge (30:20) Slack vs. Devin threads for async team communication (35:58) Claude Design plus Codex for building a technical design system (39:00) EA tools: Polly the OpenClaw vs. Claude Code on a Mac Mini (42:09) Quick recap and final thoughts *Tools referenced:* • Devin (Cognition): https://www.cognition.ai/ • Codex (OpenAI): https://openai.com/codex • Claude Code/Claude Design (Anthropic): https://www.anthropic.com/claude • OpenClaw (Claude-based desktop client): https://openclaw.ai • Cursor: https://www.cursor.com/ • BugBot (Devin’s built-in PR review): https://cursor.com/bugbot • Sentry (error monitoring referenced in Watchdog): https://sentry.io/ • Ugmonk (analog to-do system): https://ugmonk.com/ *Other references:* • Devin playbooks/skills documentation: https://docs.cognition.ai/ • Jack Dorsey/Buzz (async-first communication referenced): https://buzz.new/ • Merge Mommy (Claire’s Eve agent for PR risk scoring, deployed on Vercel): https://www.lennysnewsletter.com/p/build-an-ai-code-review-bot-in-30 *Where to find Ryan Carson:* X: https://x.com/ryancarson Untangle: https://untangle.us *Where to find Claire Vo:* ChatPRD: https://www.chatprd.ai/ Website: https://clairevo.com/ LinkedIn: https://www.linkedin.com/in/clairevo/ X: https://x.com/clairevo _Production and marketing by https://penname.co/._ _For inquiries about sponsoring the podcast, email jordan@penname.co._

Ryan CarsonguestClaire Vohost
Aug 24, 202644mWatch on YouTube ↗

At a glance

WHAT IT’S REALLY ABOUT

A solo founder’s system for managing 15 AI agents nonstop

  1. Ryan Carson explains how he runs 10–15 concurrent cloud-agent threads in Devin using folder-based priorities (Bugs, P0–P2) plus a weekly paper list to stay focused.
  2. He recounts Untangle’s pivot from consumer AI divorce help to B2B software for family law firms after direct customer conversations revealed lawyers would pay for discovery and paralegal-shortage relief.
  3. The episode argues that AI-driven output is not product strategy: founders must still talk to customers because frontier models can’t reliably decide what to ship.
  4. Carson shares operational playbooks like “Watchdog,” which audits every customer account, summarizes issues, and checks whether high-frequency PRs have already resolved them.
  5. Vo and Carson compare tool roles—Devin for background cloud execution and ops, Codex for low-latency pair programming and verification, and Claude Design for generating reusable design systems—plus PR automation patterns like Merge Mommy and LAN PR.

IDEAS WORTH REMEMBERING

5 ideas

Agent management is becoming the core job; organization beats raw prompting.

Carson argues the scarce skill is no longer writing code but directing, prioritizing, and verifying many parallel agent workstreams—similar to managing a large org without the pyramid. His solution is lightweight structure (priority folders + weekly paper priorities) so he can keep 10–15 active threads coherent.

Use a dual system: in-tool task triage plus an external focus anchor.

He organizes Devin work by folders (Bugs, P0, P1, P2, Investors) and keeps a separate weekly priority list on paper to prevent attention from being hijacked by endless agent outputs. The combined system creates an “anchor” so high-leverage work doesn’t get lost among fast-moving PRs and fixes.

Turn operational chaos into a repeatable monitoring playbook (e.g., Watchdog).

Watchdog is a repeated playbook that logs into each customer account, summarizes recent activity, surfaces errors (e.g., Sentry), and distills the “top three” problems—then checks whether they’re already fixed/in-progress given the high PR volume. This turns overwhelming operational visibility into a predictable, repeatable monitoring loop.

AI increases output, but customers—not models—determine what to build.

Both hosts stress that shipping more code does not automatically create a better product because models can’t reliably choose what the market wants. PMF came from outbound emails, calls, and on-site visits with law firms—not from autonomous “self-improvement” product loops.

Treat coding agents as business operators, not just programmers.

They describe using agents beyond software engineering: deal desk, customer triage, docs, and internal ops—especially valuable because the agent can both understand the codebase and execute changes. The implication is that “coding agents” are actually general business operators when given the right context and permissions.

WORDS WORTH SAVING

5 quotes

If you're out there listening and you are doing engineering, you're doing your work locally, you really need to open your eyes. Like, I, I think the future is pretty much 100%, you know, cloud agents.

Ryan Carson

I think one of my big messages for today is that all of us have to uplevel our ability to manage agents. Like, that is our job, right?

Ryan Carson

I really try to res- like, constrain my output capacity. Not on quality, not on bugs, but, like, because I don't- I don't think I get multiples of quality off of multiples of output.

Claire Vo

I think what, what, what is happening is people are not getting out of their chair enough and actually talking to real people.

Ryan Carson

I don't wanna talk to you. I don't wanna have a meeting with you. I don't wanna get to know if I like you. I just wanna see how good of an agent manager you are.

Ryan Carson

Cloud agents vs. local developmentDevin folder system (Bugs, P0–P2, Investors)Paper-based weekly priority anchoringWatchdog account monitoring playbookDecision fatigue and time/task bucketingPR review automation (LAN PR, Merge Mommy, BugBot)Tool selection: Devin vs. Codex vs. Claude/Claude Design

High quality AI-generated summary created from speaker-labeled transcript.

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.