Skip to content
How I AIHow I AI

Never write an update again: Notion's AI-powered engineering meetings | Ryan Nystrom

Ryan Nystrom is a software engineer at Notion. He joined in December 2024 after Notion acquired Campsite, the team communication platform he co-founded with Brian Lovin. At Notion, he’s been a core builder of Notion AI and the Custom Agents feature launched in February 2026. He manages a team of six to seven engineers while still writing code himself, currently running Project Afterburner, a push to cut Notion’s CI time to a quarter of its current duration. *What you’ll learn:* 1. How to build a Notion AI custom agent that auto-generates your daily standup pre-read by pulling from Slack, GitHub, Honeycomb metrics, and yesterday’s meeting transcript 2. How to configure subagents and MCP integrations within Notion AI 3. How Notion’s internal “Boxy” system lets engineers @mention Codex from within Notion comments and get a full pull request with screenshots in 20 minutes 4. The spec-first development workflow: dictate an idea into Whisper, have Codex format it as a proper spec, commit it to the repo, and let the agent implement and verify it autonomously 5. Why fast CI is absolutely critical in the age of AI coding agents 6. How to prompt AI coding agents to defend their reasoning under pushback 7. Why engineering managers and even senior executives should keep writing code *Brought to you by:* WorkOS—Make your app enterprise-ready today: https://workos.com?utm_source=lennys_howiai&utm_medium=podcast&utm_campaign=q22025 Orkes—The enterprise platform for reliable applications and agentic workflows: https://www.orkes.io/ *In this episode, we cover:* (00:00) Introduction to Ryan Nystrom (02:48) How AI has upended 12+ years of the same working routine (04:30) Project Afterburner: Notion’s push to cut CI time to a quarter (09:00) Why high-frequency, high-quality meetings beat lower-frequency standups (11:10) How automated context surfaces every engineer’s work equally (12:15) Why cutting meeting prep is a burnout protection mechanism (14:26) The case for engineering managers writing code (16:13) Inside “Boxy”: Notion’s internal VM-based background agent system (20:30) Old World vs. New World code review (24:51) Prompting Codex from Notion comments (29:20) The emotions around code review (31:01) Quick recap (32:00) Spec-first development: writing and checking agent specs into the repo (35:10) The spec as changelog: version control for how a feature actually works (37:53) How engineers’ roles are evolving (39:00) Lightning round (45:21) Where to find Ryan *Blog & detailed workflow walkthroughs from this episode:* How I AI: Ryan Nystrom’s 3 Notion Workflows for Engineering Velocity: https://www.chatprd.ai/how-i-ai/ryan-nystrom-notion-workflows-for-engineering-velocity ↳ Implement Features Using Spec-First Development and an AI Coding Agent: https://www.chatprd.ai/how-i-ai/workflows/implement-features-using-spec-first-development-and-an-ai-coding-agent ↳ From Notion Task to GitHub Pull Request in 20 Minutes with a Coding Agent: https://www.chatprd.ai/how-i-ai/workflows/from-notion-task-to-github-pull-request-in-20-minutes-with-a-coding-agent ↳ Automate Daily Standup Preparation with a Custom Notion AI Agent: https://www.chatprd.ai/how-i-ai/workflows/automate-daily-standup-preparation-with-a-custom-notion-ai-agent *Tools referenced:* • Notion AI: https://www.notion.com/product/ai • Notion Custom Agents: https://www.notion.com/blog/introducing-custom-agents • Codex (OpenAI): https://openai.com/codex • Claude Code (Anthropic): https://claude.ai/code • Honeycomb (observability + MCP): https://www.honeycomb.io • Whisper (OpenAI voice transcription): https://openai.com/research/whisper • Slack: https://slack.com • GitHub: https://github.com *Other references:* • How Stripe built “minions”—AI coding agents that ship 1,300 PRs weekly from Slack reactions | Steve Kaliski (Stripe): https://www.chatprd.ai/how-i-ai/stripes-ai-minions-ship-1300-prs-weekly-from-a-slack-emoji • Notion 3.3 Custom Agents launch (February 24, 2026): https://www.notion.com/releases/2026-02-24 *Where to find Ryan Nystrom:* X: https://x.com/ryannystrom LinkedIn: https://www.linkedin.com/in/ryannystrom/ GitHub: https://github.com/rnystrom *Where to find Claire Vo:* ChatPRD: https://www.chatprd.ai/ Website: https://clairevo.com/ LinkedIn: https://www.linkedin.com/in/clairevo/ X: https://x.com/clairevo _Production and marketing by https://penname.co/._ _For inquiries about sponsoring the podcast, email jordan@penname.co._

Ryan NystromguestClaire Vohost
May 11, 202647mWatch on YouTube ↗

CHAPTERS

  1. Ryan Nystrom’s AI working style reset: constant tool changes, more joy, more output

    Ryan describes how AI disrupted a decade-plus of stable habits, pushing him to switch IDEs, terminals, and workflows repeatedly. Despite the pace, he finds the change energizing and credits AI with making work both faster and more enjoyable.

  2. Project Afterburner: the mission to cut Notion’s CI time by 75%

    Ryan introduces Afterburner, a DevX initiative aimed at aggressively reducing CI times to a quarter of current duration. He frames it as an engineering-leverage project: faster feedback loops improve both quality and shipping velocity—especially in an agent-driven world.

  3. Engineering meetings reimagined: daily standups without the dead-eyed status round-robin

    Ryan explains why traditional standups often fail: they devolve into rote updates with low engagement. His team keeps meetings high-frequency but makes them high-quality by focusing on decisions, problems, and learning rather than individual reporting.

  4. The automated pre-read: surfacing Slack, PRs, tasks, and yesterday’s transcript into one agenda

    A Notion AI custom agent compiles a meeting pre-read by scanning the last 24 hours across Slack, merged PRs, closed tasks, and prior meeting notes. This creates a shared, detailed agenda so the team can start immediately with what matters.

  5. “Equal visibility” for every engineer: democratizing updates and catching missed wins

    Ryan and Claire discuss how automation creates a level playing field: quieter engineers’ work is captured as reliably as more vocal teammates’. The artifact also helps the team notice improvements (like CI/test speedups) that might otherwise slip by.

  6. Burnout protection via just-in-time prep: reclaiming manager and maker time

    Reducing meeting-prep overhead removes daily context switching and the “paperwork” burden that drains leaders. Ryan argues this is a concrete burnout prevention mechanism—freeing managers to stay hands-on, creative, and close to the work.

  7. How the Notion custom agent is built: triggers, instructions, subagents, permissions, and MCP metrics

    Ryan walks through the “Hot Potato” custom agent configuration: scheduled triggers, a detailed instruction page, and a structured output template. He also explains careful permissioning (read-only for most data, edit only for meeting notes) and using MCP to pull telemetry (Honeycomb).

  8. From prompts in terminals to prompts in Notion: the workflow that leads to “Boxy”

    Ryan describes the friction of writing prompts in CLIs and copy/pasting between tools. Notion becomes the place to draft structured prompts and tasks, leading to an internal system that can invoke coding agents directly from Notion work items.

  9. Inside Boxy: @mention Codex to spin up VMs, implement UI changes, and open PRs

    A simple feature request from a friend becomes a live demo: Ryan writes a short task with a screenshot and edge cases, then @mentions Codex in a Notion comment. Boxy runs the work on background VMs, returns a PR and preview URL, and even attaches UI verification screenshots.

  10. Old-world vs new-world code review: asking “I don’t get it” without social cost

    Ryan and Claire highlight how AI changes the emotional dynamic of code review. Ryan can candidly say “I don’t understand this—explain like I’m five,” pushing for clarity and correctness without interpersonal friction.

  11. Spec-first development in practice: speaking a spec, checking it into the repo, then ‘Build it’

    Ryan explains Notion’s agent harness rewrite and the shift to starting with specs instead of code. He uses Whisper to “yap” requirements, has Codex convert it into a structured markdown spec, then points Codex at the spec to implement the feature nearly end-to-end.

  12. The spec as changelog: version control for how the system actually works

    Treating the spec as the source of truth enables clearer evolution than code diffs alone. Updating behavior becomes “update the spec, then regenerate/adjust the implementation,” making intent legible to humans and machines across time.

  13. Engineers as architects and verification designers: roles evolving around evaluation loops

    Ryan argues engineers’ value shifts toward systems thinking and creating strong verification loops that agents can execute. The key bottleneck becomes correctness and evaluation—not hand-wiring every integration detail.

  14. Lightning round: why Codex, why CI speed matters more with agents, and prompting when things go wrong

    Ryan and Claire compare Codex to other agents, emphasizing long-running task stability and one-shot workflows. They tie CI speed directly to the throughput of both humans and agent swarms, then share prompting strategies: challenge sycophancy and demand evidence-based defenses.

  15. Where to find Ryan and closing notes

    Ryan shares where he’s most reachable and offers to help troubleshoot Notion issues. The episode wraps with standard podcast closing and calls to engage.

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.

Add to Chrome