Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

Latent SpaceLatent Space

Robots That Predict the Future: Dyna-2 & Physical AI — Jason Ma, Dyna Robotics

From training a world-action model on over one million hours of human video to deploying robots that fold thousands of napkins daily at Din Tai Fung, Dyna Robotics is pushing physical AI beyond impressive demos and into real-world production. In this episode, Dyna Robotics co-founder and Chief Scientist Jason Ma joins swyx on-site to unpack how robots can learn new tasks from as little as 45 minutes of demonstrations, why predicting the future of the physical world may be the key to general-purpose robotics, and what it actually takes to build robots that work reliably for real customers. We go deep on Dyna-2, Dyna's million-hour world-action model that combines future video prediction with robot actions, the scaling laws behind human-to-robot transfer, diffusion transformers and flow matching, and why synthetic environments and self-generated training data could unlock the next wave of robotics progress. Jason also explains why Dyna builds its own hardware instead of relying on off-the-shelf humanoids, how agentic harnesses enable robots to execute hour-long workflows, why dexterous hands and missing sensory data remain major bottlenecks, and what separates real commercial deployments from the graveyard of robotics startups. We also cover world-action models versus vision-language-action models, GPT-6 and coding agents in robotics, and Jason's journey from AlphaGo and Penn to NVIDIA, Google DeepMind, and founding Dyna. We discuss: - Why Dyna-2 was trained on over one million hours of human video - World-action models: predicting future video to guide physical robot actions - Diffusion transformers, flow matching, and real-time robotic control - How robots learn new tasks with as little as 45 minutes of demonstrations - Why robotics has no equivalent of the internet and data remains its biggest scaling challenge - Human egocentric video, robot demonstrations, and cross-embodiment transfer - Synthetic environments, simulation, and models that generate their own training data - Why robots need on-device inference, model distillation, and custom hardware - Why Dyna chose wheeled semi-humanoids instead of traditional bipedal robots - The hardware bottleneck: why dexterous robot hands still overheat - Best Western, Din Tai Fung, and the difference between robotics pilots and scaled deployments - The Bitter Lesson of Robotics: scaling data instead of engineering specialized solutions - Agentic harnesses and robots executing multi-step, hour-long physical workflows - GPT-6, coding agents, and AI-generated simulation environments for robotics research - World-action models versus VLAs, and why vision alone may not be enough - Jason's journey through AlphaGo, Penn, NVIDIA, Google DeepMind, and the Eureka project - Dyna's research culture, deployment-first philosophy, and vision for millions of robots --- Sponsorship and business inquiries: business@latent.space --- Jason Ma - LinkedIn: https://www.linkedin.com/in/jason-ma-742224a2/ - X: https://x.com/JasonMa2020 Dyna Robotics - Website: https://www.dyna.co/ - X: https://x.com/DynaRobotics Timestamps 00:00:00 Hook 00:01:56 Introduction and Dyna-2's World-Action Model 00:05:04 Diffusion Transformers, Flow Matching, and Generalist Robots 00:10:15 The Robotics Data Bottleneck 00:15:46 Synthetic Data and Self-Improving World Models 00:18:47 Real-Time Inference and Model Distillation 00:21:41 Full-Stack Robotics: Hardware and Supply Chains 00:26:58 Why Dyna Built a Wheeled Semi-Humanoid 00:31:31 Teaching Robots New Tasks and Evaluating Performance 00:33:55 Autonomous Workflows and Hardware Limitations 00:38:02 Real-World Deployments at Best Western and Din Tai Fung 00:43:03 The Bitter Lesson of Robotics 00:48:09 Agentic Harnesses for Physical AI 00:51:03 GPT-6, Coding Agents, and AI-Native Robotics 00:53:58 World-Action Models vs. VLAs 01:01:13 From AlphaGo to Founding Dyna Robotics 01:06:16 Dyna's Research Culture and the Future of Robotics

Jason MaguestswyxhostAlessio Fanellihost
Oct 13, 20261h 21mWatch on YouTube ↗

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

Episode Details

EPISODE INFO

Released
October 13, 2026
Duration
1h 21m
Channel
Latent Space
Watch on YouTube
▶ Open ↗

EPISODE DESCRIPTION

From training a world-action model on over one million hours of human video to deploying robots that fold thousands of napkins daily at Din Tai Fung, Dyna Robotics is pushing physical AI beyond impressive demos and into real-world production. In this episode, Dyna Robotics co-founder and Chief Scientist Jason Ma joins swyx on-site to unpack how robots can learn new tasks from as little as 45 minutes of demonstrations, why predicting the future of the physical world may be the key to general-purpose robotics, and what it actually takes to build robots that work reliably for real customers. We go deep on Dyna-2, Dyna's million-hour world-action model that combines future video prediction with robot actions, the scaling laws behind human-to-robot transfer, diffusion transformers and flow matching, and why synthetic environments and self-generated training data could unlock the next wave of robotics progress. Jason also explains why Dyna builds its own hardware instead of relying on off-the-shelf humanoids, how agentic harnesses enable robots to execute hour-long workflows, why dexterous hands and missing sensory data remain major bottlenecks, and what separates real commercial deployments from the graveyard of robotics startups. We also cover world-action models versus vision-language-action models, GPT-6 and coding agents in robotics, and Jason's journey from AlphaGo and Penn to NVIDIA, Google DeepMind, and founding Dyna. We discuss:

  • Why Dyna-2 was trained on over one million hours of human video
  • World-action models: predicting future video to guide physical robot actions
  • Diffusion transformers, flow matching, and real-time robotic control
  • How robots learn new tasks with as little as 45 minutes of demonstrations
  • Why robotics has no equivalent of the internet and data remains its biggest scaling challenge
  • Human egocentric video, robot demonstrations, and cross-embodiment transfer
  • Synthetic environments, simulation, and models that generate their own training data
  • Why robots need on-device inference, model distillation, and custom hardware
  • Why Dyna chose wheeled semi-humanoids instead of traditional bipedal robots
  • The hardware bottleneck: why dexterous robot hands still overheat
  • Best Western, Din Tai Fung, and the difference between robotics pilots and scaled deployments
  • The Bitter Lesson of Robotics: scaling data instead of engineering specialized solutions
  • Agentic harnesses and robots executing multi-step, hour-long physical workflows
  • GPT-6, coding agents, and AI-generated simulation environments for robotics research
  • World-action models versus VLAs, and why vision alone may not be enough
  • Jason's journey through AlphaGo, Penn, NVIDIA, Google DeepMind, and the Eureka project
  • Dyna's research culture, deployment-first philosophy, and vision for millions of robots

--- Sponsorship and business inquiries: business@latent.space --- Jason Ma

Dyna Robotics

Timestamps 00:00:00 Hook 00:01:56 Introduction and Dyna-2's World-Action Model 00:05:04 Diffusion Transformers, Flow Matching, and Generalist Robots 00:10:15 The Robotics Data Bottleneck 00:15:46 Synthetic Data and Self-Improving World Models 00:18:47 Real-Time Inference and Model Distillation 00:21:41 Full-Stack Robotics: Hardware and Supply Chains 00:26:58 Why Dyna Built a Wheeled Semi-Humanoid 00:31:31 Teaching Robots New Tasks and Evaluating Performance 00:33:55 Autonomous Workflows and Hardware Limitations 00:38:02 Real-World Deployments at Best Western and Din Tai Fung 00:43:03 The Bitter Lesson of Robotics 00:48:09 Agentic Harnesses for Physical AI 00:51:03 GPT-6, Coding Agents, and AI-Native Robotics 00:53:58 World-Action Models vs. VLAs 01:01:13 From AlphaGo to Founding Dyna Robotics 01:06:16 Dyna's Research Culture and the Future of Robotics

SPEAKERS

  • Jason Ma

    guest

    Co-founder and chief scientist of Dyna Robotics, building world-action models (Dyna-2) for physical AI and robot control.

  • swyx

    host

    Co-host of the Latent Space podcast.

  • Alessio Fanelli

    host

    Co-host of the Latent Space podcast.

EPISODE SUMMARY

In this episode of Latent Space, featuring Jason Ma and swyx, Robots That Predict the Future: Dyna-2 & Physical AI — Jason Ma, Dyna Robotics explores dyna Robotics’ world-action model for fast, deployable generalist robots Jason Ma explains Dyna-2 as a world-action model that predicts future visual world states and outputs robot actions to improve robustness and generalization.

RELATED EPISODES

Supabase duplicate

Supabase duplicate

Why AI Compute Comes in Rectangles — Erik Bernhardsson, Modal

Why AI Compute Comes in Rectangles — Erik Bernhardsson, Modal

How Anthropic ships the #1 LLM in the World — with Katelyn Lesse and Angela Jiang

How Anthropic ships the #1 LLM in the World — with Katelyn Lesse and Angela Jiang

Why AI Labs With Unlimited GPUs Still Fail — Anjney Midha, AMP

Why AI Labs With Unlimited GPUs Still Fail — Anjney Midha, AMP

🔬 The Limits of AI in Science - Why We Need Self-Driving Labs — Joseph Krause, Radical AI

🔬 The Limits of AI in Science - Why We Need Self-Driving Labs — Joseph Krause, Radical AI

The Agent Cloud: Databricks’ Bet on the Future of AI — Matei Zaharia and Reynold Xin

The Agent Cloud: Databricks’ Bet on the Future of AI — Matei Zaharia and Reynold Xin

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.