Skip to content
How I AIHow I AI

How I run autonomous coding agents from my phone with OpenAI Symphony + Linear

Alessio Fanelli, founder of Kernel Labs and co-host of Latent Space podcast, walks us through two very different AI workflows: (1) a fully autonomous coding setup using OpenAI Symphony + Linear, where Linear acts as a state machine and Symphony manages agents through the whole dev lifecycle with zero babysitting; (2) Codex with browser access searching eBay for underpriced Pokémon cards—autonomously browsing, extracting PSA certificate numbers, and flagging deals on $10K–$20K cards for his San Carlos card shop, Merlin Games. *What you’ll learn:* 1. Why “agent manager” is a better mental model than “agent prompter” 2. Why local Mac Minis don’t scale, and what a cloud VPS unlocks 3. How to wire Symphony and Linear together as an agent state machine 4. How to track token costs per task (and what 221 million tokens buys you) 5. What Glimpse does, and why better agent senses extend autonomous runs 6. Why your CLAUDE.md probably needs a full purge, not more instructions 7. How Codex scouts underpriced $10K Pokémon cards on eBay at scale 8. The new category of small business that AI just made possible *Brought to you by:* Firecrawl—Power AI agents with clean web data: https://firecrawl.dev/?utm_source=newsletter&utm_medium=partner&utm_campaign=how_i_ai Jira Product Discovery—Prioritize with insights, build with confidence: https://atlassian.com/howiai *In this episode, we cover:* (00:00) Intro (02:24) Prompter vs. agent manager (04:31) Live demo: Symphony + Linear (09:31) Setting up Symphony (14:15) Purging your skills files (18:06) The benefits of this system (19:10) Demo: Using Codex to hunt for Pokémon cards (24:17) The benefit of AI for small businesses (28:23) Lightning round *Blog and detailed workflow walkthroughs from this episode:* How Alessio Fanelli uses Open AI Symphony for Autonomous Coding and Pokémon Card Trading Workflows: https://www.chatprd.ai/how-i-ai/alessio-fanelli-uses-open-ai-symphony-for-autonomous-coding-and-pokemon-card-trading ↳ Build an AI Agent to Find Underpriced Pokémon Cards for Arbitrage: https://www.chatprd.ai/how-i-ai/workflows/build-an-ai-agent-to-find-underpriced-pok-mon-cards-for-arbitrage ↳ Automate Software Development with an AI Agent Manager using OpenAI Symphony and Linear: https://www.chatprd.ai/how-i-ai/workflows/automate-software-development-with-an-ai-agent-manager-using-openai-symphony-and-linear *Tools referenced:* • OpenAI Codex: https://openai.com/codex • OpenAI Symphony (open-source framework): https://github.com/openai/symphony • Linear (project management/agent state machine): https://linear.app • PSA (Professional Sports Authenticator) grading: https://www.psacard.com • TCGplayer (card pricing): https://www.tcgplayer.com • eBay (used for card price scouting): https://www.ebay.com *Other references:* • Meta Ray-Ban glasses: https://www.ray-ban.com/usa/ray-ban-meta-smart-glasses • The Monk and the Riddle by Randy Komisar: https://www.amazon.com/Monk-Riddle-Creating-Making-Living/dp/1578516447/ref=sr_1_1 • The Divine Comedy by Dante Alighieri: https://www.amazon.com/dp/0451208633 • AS Roma (football club Alessio and Claire are both fans of): https://www.asroma.com/en *Where to find Alessio Fanelli:* X: https://x.com/FanaHOVA Latent Space podcast: https://www.latent.space/ *Where to find Claire Vo:* ChatPRD: https://www.chatprd.ai/ Website: https://clairevo.com/ LinkedIn: https://www.linkedin.com/in/clairevo/ X: https://x.com/clairevo _Production and marketing by https://penname.co/._ _For inquiries about sponsoring the podcast, email jordan@penname.co._

Claire VohostAlessio Fanelliguest
Jul 6, 202635mWatch on YouTube ↗

CHAPTERS

  1. 0:00 – 1:10

    Cold open: AI as leverage for small businesses (fish inventory + Pokémon cards)

    Claire and Alessio jump straight into the most tangible upside of AI: helping small businesses automate real-world, manual workflows. Alessio shares a concrete example from his family’s fish-delivery business, then tees up a fun, high-stakes Pokémon card use case.

    • AI enables small business creation and quality-of-life improvements
    • Manual inventory tracking (pen-and-paper in a freezer) is ripe for automation
    • Wearables/vision systems (e.g., smart glasses) can capture real-world inventory data
    • Pokémon cards become an example of AI-driven “goal shopping” and pricing automation
  2. 1:10 – 2:41

    Show framing + sponsor: why agent orchestration matters

    Claire introduces the episode’s goal: moving beyond one-off prompting to managing longer-running, autonomous agent work. A sponsor segment (Firecrawl) positions web data access as a common bottleneck for agents.

    • Episode focus: OpenAI Symphony + Linear for autonomous engineering workflows
    • Problem statement: most people still operate as “human-in-the-loop” prompters
    • Need for agent access to reliable web data at scale (search/scrape/structured output)
    • Firecrawl pitched as infrastructure for agent-ready web data
  3. 2:41 – 4:31

    From “agent prompter” to “agent manager”: cloud runtime and multi-channel control

    Alessio explains how improved models made longer-running tasks viable, changing his mindset from prompting to managing. He argues that local, Kanban-style workflows break down when you need multiple iterations and easy intervention—so he moved agents into the cloud and added flexible control channels.

    • Early autonomous coding was a demo; newer models made longer tasks practical
    • Shift in role: prompter → manager (directing systems, not typing every step)
    • Local Kanban boards are hard to iterate on and intervene within
    • Move orchestration to a cloud VPS so agents run continuously
    • Manage agents via multiple channels: phone/text, Linear, shell
  4. 4:31 – 7:01

    Live walkthrough: VPS + Symphony + Linear turning issues into PRs

    Alessio demos his setup: a hosted machine with agents preconfigured, running Symphony to monitor Linear as the source of truth. Tasks move through a state machine (To Do → In Progress → Human Review → Rework → Done) with Codex producing plans, acceptance criteria, and pull requests.

    • Using a VPS (“agent + server”) with pre-logged-in coding agents
    • Symphony concept: loop that converts Linear issues into coding runs
    • Linear as the state machine and system of record for work
    • Codex workpad includes plan, acceptance criteria, and validations
    • Human review happens in GitHub PR comments; rework loop is triggered from Linear
  5. 7:01 – 7:32

    Running tasks from your phone: quick triage, new issues, and progress dashboards

    Claire and Alessio clarify the workflow as a practical way to manage engineering work anywhere, especially from mobile. Alessio shows creating a Linear task on the fly, then monitoring runs via a Symphony dashboard—without reading every trace turn-by-turn.

    • Create tasks quickly (even mid-day) and move them to “To Do” to trigger agents
    • Phone-based management: adjust priorities and capture feedback anywhere
    • Dashboard view for concurrent runs across projects
    • Human review step relies on PR previews (e.g., Vercel) and comments
    • Goal: glanceable status rather than micromanaging agent traces
  6. 7:32 – 10:06

    Cost visibility: token ledgers, estimating effort, and pricing software work

    Alessio highlights a less-discussed challenge: understanding the cost of agent-written software. By tracking token usage per task, he can identify which work is unexpectedly expensive and improve specs, checks, and tooling to make future runs more efficient.

    • Token usage per task helps estimate build cost and ROI
    • Large variance in effort: small tasks vs. massive refactors/deploy fixes
    • Example of a high-token task tied to making an app deployable (storage/requests changes)
    • Ledger + history helps diagnose why tasks ballooned
    • Improving future efficiency via better descriptions, checks, and tools
  7. 10:06 – 13:16

    Setting up Symphony in practice: reference implementation + adding better tools

    Claire asks the practical setup question: what do you do with the open-source repo? Alessio explains he used the Elixir implementation and mainly customized workflow instructions and UI—then emphasizes that orchestration is only part of the battle; tools like visual testing help runs go longer without human intervention.

    • Used the Elixir Symphony reference implementation as the base
    • Key customization: workflow.md instructions and adding a UI layer
    • Default Symphony is a state monitor; token ledger/UI often need to be added
    • Kernel Labs work on tooling (e.g., Glimpse for screenshots, diffs, videos)
    • Core value shifts from orchestration to tool support for longer autonomous runs
  8. 13:16 – 18:04

    Purging skills/markdown files: why “magic MD” can quietly break your agents

    They discuss how small lines in skills/markdown files can strongly steer agent behavior—sometimes long after they stop being useful. Alessio advocates periodically pruning and diffing these files because models tend to add more rules rather than remove obsolete ones, creating confusion over time.

    • Over-reliance on a “magic skills file” is a common trap
    • Tiny instructions can permanently bias behavior (e.g., always using a worktree manager)
    • Models often add caveats instead of deleting old guidance, compounding complexity
    • Regularly review/diff/purge instruction files to keep behavior clean
    • Keep skills focused on constraints, commands, flags—not over-specifying decisions
  9. 18:04 – 19:10

    Why Symphony helps: task history and context shaping (not new capabilities)

    Claire asks if Symphony increases throughput or just feels nicer. Alessio argues the real win is having the complete history of a task—spec, plans, rework notes, and outcomes—in one searchable place, making it easier to shape context and improve future runs.

    • Primary benefit: full task history in one place (spec → workpads → rework)
    • Searchability and traceability beat scattered chat threads
    • Symphony doesn’t add new capabilities; it improves how you wield existing agents
    • Context shaping becomes the central skill for agent-driven development
    • Insights from failures inform workflow.md and future system prompts
  10. 19:10 – 24:16

    Demo: Codex “goal shopping” for expensive Pokémon cards (PSA certs + eBay hunting)

    Alessio demonstrates using Codex beyond coding: gathering PSA certificate numbers and scanning marketplaces to find underpriced high-value cards. He explains how skills encode batching and grading rules, and why automation matters most when real-time human pricing is the bottleneck.

    • Use case 1: collect PSA certificate numbers by browsing and extracting from images
    • Use case 2: hunt underpriced cards on eBay from a target list
    • Skills define batching limits to reduce detection/capture risk (e.g., 5 per batch)
    • Encode grading equivalencies (PSA vs BGS/CGC) to normalize comparisons
    • Operational payoff: reduce manual lookup time and improve trade-show pricing speed
  11. 24:16 – 28:22

    AI for the physical world: heterogeneous data, books cataloging, and fish freezer inventory

    They zoom out to the broader thesis: LLMs unlock automation in messy, heterogeneous, real-world environments where traditional software struggled. Claire shares a personal example of cataloging household books with vision AI, while Alessio returns to the fish-freezer inventory story and the leverage AI gives small operators.

    • LLMs handle heterogeneous, real-world data better than rigid classification pipelines
    • Claire’s example: photographing piles of books to catalog, categorize, locate, dedupe
    • AI enables “intersecting the human world” more efficiently than before
    • Small businesses can gain disproportionate leverage without massive economies of scale
    • Examples extend to other niches like vintage clothing and physical resale markets
  12. 28:22 – 35:54

    Lightning round: AI for personal finance, book recommendations, and debugging prompts

    In rapid-fire Q&A, Alessio describes using AI as a “safety net” for finances and inbox triage to reduce stress. He recommends books (The Monk and the Riddle; Dante’s Divine Comedy), shares an AS Roma aside, and offers tactics for when models go off the rails—switch providers, restart, decompose tasks, and speak longer prompts.

    • Personal finance as context offloading (connectors + planning after selling a house)
    • Inbox monitoring with AI to reduce anxiety about missing important messages
    • Book recs: The Monk and the Riddle; The Divine Comedy as a reminder of human capability
    • Prompt recovery tactics: try another model, restart conversation, break into smaller pieces
    • Use speech-to-text (“yappers API”) to add missing context when stuck

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.