No Priors Ep. 80 | With Andrej Karpathy from OpenAI and Tesla
Sarah Guo (host), Elad Gil (host), Andrej Karpathy (guest), Elad Gil (host)
In this episode of No Priors, featuring Sarah Guo and Elad Gil, No Priors Ep. 80 | With Andrej Karpathy from OpenAI and Tesla explores andrej Karpathy on self-driving, humanoid robots, transformers, and education’s future Andrej Karpathy discusses how self-driving cars preview the path from AI demos to real-world, globalized products, comparing Tesla’s software-centric approach with Waymo’s hardware-heavy strategy. He explains why transformers are a foundational breakthrough, why the bottlenecks now are data and loss functions, and why synthetic data—if kept diverse—is essential for continued progress. The conversation explores humanoid robotics, including Tesla’s Optimus, transfer from car autonomy to robots, and why humanoids and multi-agent “swarms” of models make sense. Karpathy closes by outlining his new education company Eureka, his vision of AI tutors as an exocortex that empowers “team human,” and why rigorous STEM foundations will matter in both pre- and post-AGI worlds.
Andrej Karpathy on self-driving, humanoid robots, transformers, and education’s future
Andrej Karpathy discusses how self-driving cars preview the path from AI demos to real-world, globalized products, comparing Tesla’s software-centric approach with Waymo’s hardware-heavy strategy. He explains why transformers are a foundational breakthrough, why the bottlenecks now are data and loss functions, and why synthetic data—if kept diverse—is essential for continued progress. The conversation explores humanoid robotics, including Tesla’s Optimus, transfer from car autonomy to robots, and why humanoids and multi-agent “swarms” of models make sense. Karpathy closes by outlining his new education company Eureka, his vision of AI tutors as an exocortex that empowers “team human,” and why rigorous STEM foundations will matter in both pre- and post-AGI worlds.
Key Takeaways
Demos and real products are separated by a long, messy operational gap.
Karpathy notes Waymo drove him flawlessly a decade ago, yet it took 10 years to become a commercial product—highlighting that moving from a polished demo to robust, global deployment demands years of engineering, edge-case handling, and regulatory work.
Get the full analysis with uListen AI
Tesla’s self-driving advantage is deployment scale and a software-first strategy.
He argues Tesla has a “software problem” (easier to fix) while Waymo has a “hardware problem” (scaling expensive sensor rigs), and that Tesla’s massive installed base plus vision-only deployment—augmented by rich sensors at training time—is a powerful arbitrage.
Get the full analysis with uListen AI
Transformers are a fundamental architectural unlock; data and loss are now the real bottlenecks.
Unlike earlier architectures, transformers scale cleanly and act like a general-purpose differentiable computer; most innovation now happens in dataset curation and objective design rather than in model architecture.
Get the full analysis with uListen AI
Synthetic data is essential but must preserve entropy to avoid silent collapse.
He warns that naive synthetic data pipelines produce narrow, repetitive distributions (e. ...
Get the full analysis with uListen AI
Humanoid robots benefit from massive transfer from autonomous driving and from a unified platform.
Tesla’s robot reused car hardware, software, and data infrastructure so seamlessly that early Optimus “thought it was a car”; Karpathy believes a single humanoid platform maximizes reuse, teleoperation ease, and cross-task transfer learning.
Get the full analysis with uListen AI
Future AI systems will feel like swarms or companies of specialized models, not a single monolith.
He expects small, distilled “cognitive core” models (possibly ≈1B parameters or less) orchestrating other specialized models—programmer, PM, domain experts—much like a firm with a brilliant CEO and cheaper workers.
Get the full analysis with uListen AI
AI tutors can both globalize education and push human performance far beyond today’s norms.
Through Eureka, Karpathy wants great human teachers designing curricula while AI handles the “front end” tutoring—multilingual support, interactivity, and eventual adaptivity—aiming to approximate or exceed the gains of one-on-one tutoring at global scale.
Get the full analysis with uListen AI
Notable Quotes
“I kind of feel like we’ve reached AGI a little bit in self-driving, because there are systems today that you can basically take around as a paying customer.”
— Andrej Karpathy
“I think Tesla has a software problem, and I think Waymo has a hardware problem, and I think software problems are much easier.”
— Andrej Karpathy
“The transformer is not just another neural net; it’s a general-purpose training computer.”
— Andrej Karpathy
“If it’s not your weights, it starts to feel like you’re renting your brain.”
— Andrej Karpathy
“I feel like I’m kind of, on a high level, team human, and I’m interested in things that AI can do to empower people.”
— Andrej Karpathy
Questions Answered in This Episode
If transformers are no longer the bottleneck, what new architectures or training paradigms—if any—might eventually replace them?
Andrej Karpathy discusses how self-driving cars preview the path from AI demos to real-world, globalized products, comparing Tesla’s software-centric approach with Waymo’s hardware-heavy strategy. ...
Get the full analysis with uListen AI
How can we systematically detect and prevent “silent collapse” when large portions of training data are synthetic?
Get the full analysis with uListen AI
What governance or technical mechanisms could ensure that an exocortex remains under the user’s control rather than the provider’s?
Get the full analysis with uListen AI
In a post-AGI world where education is less economically necessary, what incentives will realistically motivate people to undertake the “gym-like” effort of serious learning?
Get the full analysis with uListen AI
How should regulators and society balance the safety concerns of humanoid robots (e.g., “don’t crush grandma”) against the massive productivity gains they could bring in factories and warehouses?
Get the full analysis with uListen AI
Transcript Preview
Hi, listeners. Welcome back to No Priors. Today, we're hanging out with Andrej Karpathy who needs no introduction. Andrej is a renowned researcher, beloved AI educator and cuber, an early team member from OpenAI, the lead for Autopilot at Tesla, and now working on AI for education. We'll talk to him about the state of research, his new company, and what we can expect from AI.
Thanks a lot for joining us today.
Yep.
It's great to have you here.
Thank you. Happy to be here.
You led Autopilot at Tesla and now, like, we actually have fully self-driving cars, passenger vehicles on the road. How do you read that in terms of where we are in the capability set, how quickly we should see increased capability or pervasive passenger vehicles?
Uh, yes. I spent maybe five years on self-driving space. I think it's a fascinating space and, um, basically what's happening in the field right now is... Well, um, I do also think that I f- I draw a lot of, like, analogies, I would say, to AGI from self-driving, and maybe that's just because I'm familiar with it. But I kind of feel like we've reached AGI a little bit in self-driving-
Mm-hmm.
... uh, because there are systems today that you can basically take around, and as a paying customer can take around here. So, Waymo in San Francisco here is, of course, very common. Probably you've taken Waymo. I've taken it a bunch and it's amazing and it can drive you all over the place and you're paying for it as a product.
Mm-hmm.
What's interesting with Waymo is the first time I took Waymo was actually a decade ago almost exactly, 2014 or so, and it was a friend of mine who worked there and he gave me a demo. And it drove me around the block 10 years ago and it was basically a perfect drive 10 years ago.
Mm-hmm.
And it took 10 years to go from, like, a demo that I had to a product I can pay for that's in a city scale and it's expanding, et cetera.
How much of that do you think was regulatory versus technology? Like, when do you think the technology was ready? Is it at this end? It's-
I think it's technology. You're just not seeing it in a single demo drive of 30 minutes.
Yeah, yeah.
You're not running into all the stuff that they had to do with, deal with for-
Sure.
... a decade. And so demo and product, there's a massive gap there. And I think a lot of it also regulatory, et cetera. Uh, but I do think that we've sort of, like, achieved AGI in the self-driving space in, in that sense a little bit. And yet, I think there's... What's n- really fascinating about it is the globalization hasn't happened at all.
Install uListen to search the full transcript and get AI-powered insights
Get Full TranscriptGet more from every podcast
AI summaries, searchable transcripts, and fact-checking. Free forever.
Add to Chrome