Lex Fridman PodcastJuergen Schmidhuber: Godel Machines, Meta-Learning, and LSTMs | Lex Fridman Podcast #11
CHAPTERS
- 0:00 – 4:05
Teenage origins of recursive self-improvement: building a machine better than a physicist
Schmidhuber traces his core motivation back to his teenage years: understanding the universe by creating a machine that can outlearn and outthink him. The discussion frames AGI as a path to solving increasingly complex (and ultimately all solvable) problems through self-improving learning systems.
- 4:05 – 6:35
Meta-learning vs transfer learning: “learning to learn” by inspecting and rewriting the learner
They distinguish today’s common usage of “meta-learning” (often fast adaptation via transfer learning) from Schmidhuber’s stronger definition. True meta-learning requires the system to represent its own learning algorithm in a form it can analyze, modify, and iteratively improve.
- 6:35 – 9:08
Gödel machines and universal solvers: proof search, optimality, and the “constant overhead” problem
Schmidhuber explains Gödel machines and related universal problem solvers that use proof search to guarantee optimality. He emphasizes the practical limitation: additive constant overheads can dominate for the “small” real-world problems humans care about.
- 9:08 – 11:32
Hutter’s fastest method and the TSP example: asymptotic optimality in plain terms
Using the traveling salesman problem, Schmidhuber illustrates how a universal solver can match the best computable algorithm’s asymptotic runtime, plus a constant for proving the bound. This leads to the provocative claim that “almost all large problems” are, in a sense, already solved optimally—just not practically.
- 11:32 – 15:00
P vs NP and the role of theory: why today’s best AI works with little theoretical grounding
They discuss whether complexity theory meaningfully guides modern AI practice. Schmidhuber argues P vs NP is intellectually valuable and can inspire ideas, but current top-performing AI systems rely mostly on local search/gradient descent with limited theory behind their success.
- 15:00 – 17:29
Why AGI may be “a few lines of code”: simplicity, abstractions, and standing on giants’ shoulders
Schmidhuber defends the idea that the most powerful algorithms can be remarkably short in pseudocode. Lex challenges that this simplicity sits atop layers of human-made abstractions; Schmidhuber agrees, stressing civilization’s accumulated mathematical language enables concise core ideas.
- 17:29 – 25:38
Determinism, quantum randomness, and the beauty of compressible universes
The conversation pivots to whether quantum events are truly random or just appear random due to an unknown short generator. Schmidhuber argues there’s no conclusive evidence for fundamental randomness and that a deterministic, highly compressible universe would be more elegant.
- 25:38 – 29:36
Science as compression progress: Kepler → Newton → Einstein and predictive coding
Schmidhuber describes scientific discovery as successive improvements in compression: better theories predict more with fewer bits. He connects this to predictive coding, where what can be predicted need not be stored explicitly, making insight measurable as compression gain.
- 29:36 – 30:28
Intrinsic motivation and curiosity: rewarding agents for “depth of insight”
Building on compression-as-understanding, Schmidhuber outlines intrinsic reward mechanisms that encourage agents to seek learnable novelty. The agent is motivated to run experiments that produce data revealing new patterns, mirroring scientific exploration.
- 30:28 – 35:35
PowerPlay: systems that invent their own problems and expand capabilities without forgetting
Schmidhuber introduces PowerPlay as a framework where the system searches not only for solutions but also for new problems it can nearly solve—then modifies itself to solve them while retaining prior skills. This formalizes open-ended creativity as continually pushing the frontier of what the system can do.
- 35:35 – 37:58
Humans as curious agents: meaning, exploration trade-offs, and evolution’s built-in biases
Asked about the meaning of life, Schmidhuber frames humans (including babies) as curiosity-driven explorers. He highlights evolutionary trade-offs: too much exploration can be dangerous, so populations balance highly exploratory individuals with more conservative ones.
- 37:58 – 46:10
Creativity and consciousness as byproducts: self-models emerge from compression and planning
Schmidhuber argues neither creativity nor consciousness needs a dedicated “module”; both can emerge as side effects of general problem solving. He describes architectures with a controller and a predictive world-model, where compression naturally leads to internal self-models that resemble self-awareness.
- 46:10 – 50:57
LSTMs and the meaning of depth: long time lags, credit assignment, and practical limits
They turn to LSTMs, with Schmidhuber crediting key collaborators and explaining why temporal depth matters: important information may be far back in time. He notes LSTMs have demonstrated memory over millions of steps, but reinforcement learning adds the harder challenge of choosing among many possible futures.
- 50:57 – 1:06:32
Controller-Model (CM) systems, the next RL wave, and robots that learn like children
Schmidhuber describes modern controller-model systems where a controller learns when and how to exploit a learned world-model to reduce search and improve decision-making. He argues the next major AI wave will be action-driven (not passive prediction), enabled by RL, learned models, curiosity, and scalable imitation—transforming robotics and industry.
- 1:06:32 – 1:19:58
Jobs, existential risk, and cosmic expansion: AI ecologies, resources beyond Earth, and alien intelligence
The closing stretches from near-term labor disruption to long-term cosmic-scale intelligence. Schmidhuber is broadly optimistic: societies invent new jobs, and future superintelligences may quickly look beyond Earth for energy and materials, forming vast AI ecologies; he also reflects on whether we might be alone (locally) and why that responsibility matters.
