Skip to content
Lex Fridman PodcastLex Fridman Podcast

George Hotz: Hacking the Simulation & Learning to Drive with Neural Nets | Lex Fridman Podcast #132

George Hotz (geohot) is a programmer, hacker, and the founder of Comma.ai. Please support this podcast by checking out our sponsors: - Four Sigmatic: https://foursigmatic.com/lex and use code LexPod to get up to 40% & free shipping - Decoding Digital: https://appdirect.com/decoding-digital - ExpressVPN: https://expressvpn.com/lexpod and use code LexPod to get 3 months free EPISODE LINKS: Comma.ai's Twitter: https://twitter.com/comma_ai Comma.ai's Website: https://comma.ai/ George's Instagram: https://www.instagram.com/georgehotz George's Twitch: https://www.twitch.tv/georgehotz George's Twitter: https://twitter.com/realgeorgehotz Comma.ai YouTube (unofficial): https://www.youtube.com/channel/UCwgKmJM4ZJQRJ-U5NjvR2dg PODCAST INFO: Podcast website: https://lexfridman.com/podcast Apple Podcasts: https://apple.co/2lwqZIr Spotify: https://spoti.fi/2nEwCF8 RSS: https://lexfridman.com/feed/podcast/ Full episodes playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4 Clips playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOeciFP3CBCIEElOJeitOr41 OUTLINE: 0:00 - Introduction 2:31 - Will human civilization destroy itself? 5:18 - Where are the aliens? 10:05 - Tic Tac UFO and Bob Lazar 12:33 - Conspiracy theories 14:36 - The programming language of life 18:57 - The games that humans play 27:27 - Memory leaks in the simulation 29:58 - Theories of everything 31:43 - Ethereum startup story 39:30 - Cryptocurrency 48:57 - Self-help advice 52:37 - Comma.ai 54:30 - Comma two 1:03:19 - Tesla vs Comma.ai 1:12:22 - Driver monitoring 1:26:03 - Communicating uncertainty 1:27:51 - Tesla Dojo 1:34:19 - Tesla Autopilot big rewrite 1:40:37 - How to install the Comma Two 1:45:13 - Openpilot is Android & Autopilot is iOS 1:54:28 - Waymo 2:05:41 - Autonomous driving and society 2:07:53 - Moving 2:10:58 - Advice to Startups 2:24:00 - Programming setup 2:27:01 - Ideas that changed my life 2:35:06 - GPT-3 2:38:26 - AGI 2:42:29 - Programming languages that everyone should learn 2:49:02 - How to learn anything 2:51:34 - Book recommendations 2:59:57 - Love 3:01:46 - Psychedelics 3:04:07 - Crazy CONNECT: - Subscribe to this YouTube channel - Twitter: https://twitter.com/lexfridman - LinkedIn: https://www.linkedin.com/in/lexfridman - Facebook: https://www.facebook.com/LexFridmanPage - Instagram: https://www.instagram.com/lexfridman - Medium: https://medium.com/@lexfridman - Support on Patreon: https://www.patreon.com/lexfridman

Lex FridmanhostGeorge Hotzguest
Oct 22, 20203h 8mWatch on YouTube ↗

CHAPTERS

  1. 0:00 – 2:31

    Comma.ai, Comma Two, and the driver-sensing philosophy

    Lex introduces George Hotz (geohot), Comma.ai’s mission, and the Comma Two device as an “Android for Autopilot.” He emphasizes the importance of driver monitoring and frames autonomy as both a technical and human-centered safety problem.

    • What Comma Two does (lane centering even without markings)
    • Driver sensing as a core safety feature
    • Android vs iOS analogy for OpenPilot vs Tesla Autopilot
    • Lex’s MIT perspective on the human side of autonomy
    • Setting the stage for a wide-ranging conversation
  2. 2:31 – 5:39

    Civilizations self-destructing, memes as weapons, and crypto as defense

    George argues intelligent civilizations likely existed but often don’t last long, tying existential risk to increasingly democratized destructive capability. He contrasts domains where defense can win (cryptography) versus where offense dominates (nuclear weapons), and riffing on memes as destabilizing forces.

    • Geohot’s answer to the Fermi paradox: civilizations end quickly
    • “IQ required to destroy the world falls by one point every year”
    • Offense vs defense: nukes vs cryptography
    • Memes as a societal destabilizer
    • A bleak-but-analytical view of technological progress
  3. 5:39 – 10:05

    Where are the aliens? Von Neumann probes, waste heat, and detectable footprints

    They explore why advanced civilizations aren’t obvious if expansion is feasible. George points to von Neumann probes and the inevitability of waste heat as a signature of large-scale energy use, arguing that “hidden” advanced civilizations still face physical constraints.

    • Prime directive vs observable evidence
    • Von Neumann probes as a galaxy-colonizing mechanism
    • Timescales (sub-light travel at ~0.1c) and expansion logic
    • Waste heat as a key observable for advanced tech
    • Thought experiment: would the past detect modern civilization?
  4. 10:05 – 12:33

    UFOs, Bob Lazar, and “all news is a PSYOP”

    Lex brings up the Tic Tac UFO sightings and the broader UFO ecosystem. George responds with deep skepticism, suggesting psyops and narrative manipulation as more plausible explanations than extraterrestrials, while acknowledging the stories can be compelling.

    • Tic Tac incident context and pilot credibility
    • Bob Lazar discussion and the pull of extraordinary claims
    • PSYOP framing: narratives as tools
    • Stimulating scientific curiosity via fabricated stories (hypothetical)
    • Skepticism toward media and official storytelling
  5. 12:33 – 14:36

    Conspiracy theories, fake news, and flooding the field with flags

    George argues that in an internet era where censorship is harder, information control can shift to dilution—overwhelming reality with noise. They discuss how conspiracies can be used to discredit truths, and the broader erosion of shared objectivity.

    • Conspiracies as a tool to discredit real events
    • The “flags everywhere” metaphor for information dilution
    • Deepfakes and steganography as privacy/deniability tools
    • Loss of shared truth and the danger of epistemic chaos
    • How online dynamics change governance and belief formation
  6. 14:36 – 18:55

    Is DNA a programming language? Nature as CAD, compute limits, and bad biotech tools

    They compare natural language, programming languages, and biology’s “language.” George calls DNA more like a CAD model than code with serial execution, arguing we mostly understand it but can’t simulate it at scale—plus today’s lab tooling is surprisingly crude.

    • Natural vs programming languages: similarities and translation
    • DNA as a ‘CAD model,’ not a typical program
    • Simulation difficulty: protein folding and molecular compute costs
    • Biology experimentation vs automation (microfluidics dream)
    • Theranos as an example of disappointing tool maturity
  7. 18:55 – 27:27

    Hacking the simulation: humility, ‘real games,’ and choosing immortality

    George reframes ‘hacking the simulation’ as a mindset: stop playing artificial status games and engage with nature’s real rules. The conversation pivots into immortality, self-modifying minds, and the tension between infinite life and meaning.

    • Simulation talk as a critique of human goal functions
    • ‘Stop playing fake human games’ vs nature’s open-world MMORPG
    • Immortality as an anti-nature objective—on your own terms
    • Self-deception/self-modification to preserve curiosity
    • Safety structures for self-modifying systems
  8. 27:27 – 31:37

    Memory leaks in the universe and ‘power over nature’ theories of everything

    Lex asks what evidence could suggest we’re in a simulation; George suggests ‘memory leak’ style anomalies—read vs write access to reality. He also critiques unfalsifiable physics theories, prioritizing models that enable testable predictions and technological power.

    • Detectable ‘simulation exploits’ as falsifiable evidence
    • Scrying/remote viewing reframed as ‘arbitrary memory read’
    • Read vs write exploits: ‘Heartbleed for the universe’
    • Skepticism toward purely aesthetic theories (string theory)
    • Desire for theories that yield engineering leverage
  9. 31:37 – 39:31

    Ethereum scaling legend: Optimism, L2, and rewriting the compiler instead of transpiling

    Lex recounts the story of George helping an Ethereum L2 company under deadline; George confirms and explains the technical core. The key insight: instead of maintaining a messy bytecode transpiler, modify the Solidity compiler directly with a small diff.

    • What L2 means and why Ethereum scaling is hard
    • Gas as resource pricing to prevent DDoS-style abuse
    • Sandboxing analogy: syscalls, hypervisors, and restricted operations
    • Transpiler mess vs ‘just change the compiler’ approach
    • A 300-line compiler diff replacing a 3000-line transpiler
  10. 39:31 – 48:49

    Why crypto matters: Nakamoto consensus, smart contracts, and forks as governance

    George outlines why he’s bullish on crypto long-term: decentralized consensus and programmable contracts. He argues lawyers are ‘overpaid interpreters’ compared to deterministic code, and praises forks as a way to “vote with liquidity.”

    • Nakamoto consensus as a major innovation
    • Smart contracts: ‘code is law’ and determinism vs legal ambiguity
    • Lawyers vs Python: cost, reliability, repeatability
    • Bitcoin skepticism and preference for better governance models
    • Forking as a powerful mechanism for institutional experimentation
  11. 48:49 – 54:30

    Learning, self-help skepticism, and the Comma.ai mission statement

    Lex presses on how George learns so broadly; George rejects generic self-help advice, favoring repetition and experience. They then pivot into Comma.ai’s mission: solve self-driving while shipping real intermediates to stay honest and grounded.

    • Anti-self-help stance: ‘Do it for 20 years’
    • Aversion to overly deliberate life optimization
    • Comma.ai mission: ‘Solve self-driving cars while delivering shippable intermediaries’
    • Revenue/product as anti-self-delusion in autonomy progress
    • Definition of “solving” self-driving: human replacement driver
  12. 54:30 – 59:33

    Comma Two vs OpenPilot: hardware as a phone, software as the autonomy stack

    They break down Comma Two’s components and how it interfaces with cars via CAN. George frames OpenPilot as the full software system around a neural model: calibration, sensor management, logging, thermal/disk/resource management, and execution.

    • Comma Two hardware: Snapdragon-based ‘phone plus’ device
    • CAN bus integration and harnesses across car models
    • OpenPilot as the orchestration layer around a model ‘blob of weights’
    • Sensor fusion, calibration, banked-road compensation
    • Data logging/upload as the learning flywheel
  13. 59:33 – 1:12:52

    End-to-end driving, RL on the world, and Tesla vs Comma philosophies

    George claims major progress: lane lines can be turned off and the system still drives, pushing toward end-to-end policies trained on user data. They debate Tesla’s multi-task ‘feature/task engineering’ approach versus end-to-end learning, with MuZero proposed as a blueprint for learned dynamics and planning.

    • Progress metric: disengagements improving (10 miles → ~100 miles)
    • End-to-end lateral today; longitudinal end-to-end as next goal
    • RL framing: data depends on weights; disengagements as training signal
    • Tesla’s segmented tasks as ‘feature engineering’ vs elegance of end-to-end
    • MuZero as a cornerstone idea for learned simulators and planning
  14. 1:12:52 – 1:27:51

    Driver monitoring at scale: scene-adaptive enforcement and communicating uncertainty

    They discuss how to keep Level 2 safe as systems improve and drivers get complacent. George describes scene-adaptive driver monitoring policies, user fatigue tradeoffs, and the need to communicate uncertainty—both in UI and through the ‘feel’ of control.

    • Scene-adaptive driver monitoring (stopped vs complex urban road)
    • Risk estimation shaping enforcement aggressiveness
    • Why over-alerting trains users to ignore or circumvent safety
    • Mode confusion concerns and clean engage/disengage semantics
    • UI as safety: showing lanes/path/uncertainty; hiring for UI work
  15. 1:27:51 – 1:54:28

    Training hardware wars: Tesla Dojo, Google TPU limits, and NVIDIA price gouging

    George critiques the current training compute landscape: effectively NVIDIA or Google, with Google’s TPU access and terms seen as hostile to competitors. He argues NVIDIA’s pricing strategy risks creating a backlash and motivates vertical integration efforts like Tesla’s Dojo.

    • Compute bottleneck: constrained vendor choices for training
    • TPU availability/terms concerns and platform risk
    • NVIDIA margins and A100 vs consumer GPU pricing comparisons
    • Why ‘sell chips’ beats over-productizing the ecosystem
    • Tesla’s potential advantage in opening accelerators to build tooling ecosystems
  16. 1:54:28 – 2:23:59

    Waymo skepticism, societal impact of autonomy, and honesty as a startup strategy

    Lex argues Waymo’s engineering is impressive in constrained geofenced domains; George says the larger robotaxi product doesn’t compete well with human ride-sharing on speed and user preferences. The discussion expands into what autonomy changes in society, why Comma stays focused, where to build companies, and why ‘technology wins’ if you don’t lie.

    • Waymo: impressive tech in Chandler, but product-market doubts at scale
    • Robotaxi economics and ‘race to the bottom’ market dynamics
    • Autonomy as an applied AI milestone more than a civilization-shifting novelty
    • Startup/location views: San Diego vs SF, Austin/Colorado considerations
    • Startup maxim: build real tech, avoid hype backed by lies; honest hype is fine if you deliver
  17. 2:23:59 – 2:42:26

    Programming mindset: minimal setup, PyTorch vs TensorFlow, and ideas that changed his life

    George downplays tooling fetishism—he’ll code on a MacBook Air with Vim—while noting modern tools can still improve. He names a few worldview-shaping intellectual ‘days’ (Yudkowsky, compression/AIXI/Hutter Prize, and Curtis Yarvin’s blog), then pivots into critiques of GPT-3 hype and what AGI might look like (collective intelligence more than a single hard takeoff).

    • Setup minimalism: Vim, portability, tools matter less than thinking
    • PyTorch superiority after switching from TensorFlow
    • Three transformative frameworks: exponential compute vs humans; intelligence as compression; political/ideological lenses
    • GPT-3: impressive but not a straight path to AGI; memory and objectives matter
    • AGI/singularity framing: bandwidth/network effects and collective intelligence
  18. 2:42:26 – 3:08:46

    What languages everyone should learn: assembly, C, and Python as a ladder of abstractions

    George recommends a foundational progression: learn assembly to understand what the machine actually does, learn C to appreciate system-level control, then learn Python to value high-level productivity. The focus is on internalizing layers of abstraction and how compilers and hardware constraints shape software.

    • Assembly as the ‘ground truth’ for understanding computation
    • C as the bridge between hardware realities and software structure
    • Python as leverage after learning lower-level constraints
    • Appreciating compilers, registers, and abstraction layers
    • Learning languages to understand tradeoffs, not just syntax

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.