Juergen Schmidhuber: Godel Machines, Meta-Learning, and LSTMs | Lex Fridman Podcast #11

Unlike standard transfer learning, Schmidhuber’s notion of meta-learning opens the space of possible learning algorithms to the system itself, allowing recursive self-improvement where the AI learns not just tasks, but how to improve its own way of learning.

Methods like the Gödel machine and Marcus Hutter’s fastest problem solver are asymptotically optimal up to an additive constant, which becomes negligible for huge problems but is prohibitive for the smaller-scale problems humans typically care about, hence the dominance of heuristic methods like gradient descent.

From Kepler’s ellipses to Newton and Einstein, better theories compress more observational data into shorter descriptions; Schmidhuber formalizes this as “compression progress” and ties it directly to the experience of insight, beauty, and scientific fun.

In his “artificial curiosity” and “power play” frameworks, agents are rewarded for discoveries that reduce description length or for inventing and solving the simplest problems just beyond their current competence, mirroring how human scientists generate and tackle their own questions.

A recurrent network that learns to predict the world efficiently will also learn compact internal models of the agent itself (since the agent appears in all its data); when a controller uses this model to mentally simulate consequences of its own actions, the resulting self-referential processing closely resembles what we call consciousness.

Schmidhuber argues that the most powerful problem solvers and physical laws tend to have very short descriptions, suggesting that both AGI’s core code and even quantum phenomena might be generated by compact, deterministic programs rather than true randomness.

He foresees robots that learn like children—building their own world models from raw sensory data, using RL and intrinsic curiosity to explore, and learning skills (like assembly) from high-level human demonstration—transforming traditional industries and the nature of work.