Skip to content
Lex Fridman PodcastLex Fridman Podcast

Jeff Hawkins: Thousand Brains Theory of Intelligence | Lex Fridman Podcast #25

Jeff Hawkins is the founder of Redwood Center for Theoretical Neuroscience in 2002 and Numenta in 2005. In his 2004 book titled On Intelligence, and in his research before and after, he and his team have worked to reverse-engineer the neocortex and propose artificial intelligence architectures, approaches, and ideas that are inspired by the human brain. These ideas include Hierarchical Temporal Memory (HTM) from 2004 and The Thousand Brains Theory of Intelligence from 2017. Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep25-sb See below for timestamps, and to give feedback, submit questions, contact Lex, etc. *CONTACT LEX:* *Feedback* - give feedback to Lex: https://lexfridman.com/survey *AMA* - submit questions, videos or call-in: https://lexfridman.com/ama *Hiring* - join our team: https://lexfridman.com/hiring *Other* - other ways to get in touch: https://lexfridman.com/contact *OUTLINE:* 0:00 - Introduction 1:28 - Understanding how the human brain works 5:44 - Parts of the brain 11:05 - How much do we understand? 14:20 - Nature of time in the brain 20:22 - Building a theory of intelligence 34:29 - Thousand brains theory of intelligence 40:06 - Ensembles and sensor fusion 44:00 - Concepts and language 45:38 - Memory palace and method of loci 50:20 - Reference frames 57:33 - Open problems 59:00 - Context 1:01:50 - Introspective thinking about the brain 1:04:19 - Deep learning 1:23:09 - Benchmarks 1:27:07 - Brain learning process 1:34:33 - How far are we from solving intelligence 1:38:37 - Possibility of AI winter 1:39:58 - Consciousness and intelligence 1:49:16 - Mortality 1:53:49 - Will understanding intelligence make us happy? 1:55:19 - Existential threats of AI 2:01:45 - Super-human intelligence and our future *PODCAST LINKS:* - Podcast Website: https://lexfridman.com/podcast - Apple Podcasts: https://apple.co/2lwqZIr - Spotify: https://spoti.fi/2nEwCF8 - RSS: https://lexfridman.com/feed/podcast/ - Podcast Playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4 - Clips Channel: https://www.youtube.com/lexclips *SOCIAL LINKS:* - X: https://x.com/lexfridman - Instagram: https://instagram.com/lexfridman - TikTok: https://tiktok.com/@lexfridman - LinkedIn: https://linkedin.com/in/lexfridman - Facebook: https://facebook.com/lexfridman - Patreon: https://patreon.com/lexfridman - Telegram: https://t.me/lexfridman - Reddit: https://reddit.com/r/lexfridman

Lex FridmanhostJeff Hawkinsguest
Jun 30, 20192h 9mWatch on YouTube ↗

At a glance

WHAT IT’S REALLY ABOUT

Jeff Hawkins maps how brain’s thousand models could reinvent intelligence

  1. Jeff Hawkins argues that true artificial intelligence will only emerge from understanding the neocortex, the brain structure underlying human intelligence, rather than scaling current deep learning methods.
  2. He presents his Thousand Brains Theory, where thousands of cortical columns each learn full object models using spatial reference frames and vote together to infer what we perceive and think.
  3. Hawkins contrasts this brain-based view with today’s deep learning, highlighting biological mechanisms like sparse, predictive neurons and synaptogenesis that support rapid, continual, and robust learning.
  4. He believes we are past a key theoretical breakthrough in understanding the neocortex, and that brain-inspired approaches can both advance AI and preserve human knowledge far beyond our species.

IDEAS WORTH REMEMBERING

5 ideas

Understanding the neocortex is central to building true intelligence.

Hawkins insists that without a principled model of how the neocortex works, AI will remain narrow and brittle; brain-inspired architectures are, in his view, the fastest path to general intelligence.

The brain represents the world through thousands of spatial reference frames.

Each small cortical region (or "column") learns complete models of objects and concepts by encoding locations within object-centered reference frames and moving through them over time, then collectively voting to recognize what is sensed.

Time and movement are fundamental to perception and cognition.

Brains don’t classify static snapshots; they continually process changing inputs as we move eyes, hands, and attention, building models by linking sequences of sensations across time rather than via single images.

Abstract thought likely reuses the same spatial machinery as perception.

Evidence from memory palaces and fMRI suggests concepts like birds or mathematical ideas are organized as navigable “spaces” in the cortex, using grid-cell-like mechanisms originally evolved for physical navigation.

Biological neurons are predictive, sparse, and learn via new connections, not fine weight tweaks.

Real neurons use thousands of synapses, sparse population codes, dendritic prediction, and synaptogenesis (plus silent synapses) to support rapid, robust, and continual learning—properties largely absent from standard deep nets.

WORDS WORTH SAVING

5 quotes

We will not be able to create fully intelligent machines until we understand how the human brain works.

— Jeff Hawkins

The neocortex all works on the same principle… language, hearing, touch, vision, engineering are basically built in the same computational substrate.

— Jeff Hawkins

There isn’t one model of a cup. There are thousands of models of this cup.

— Jeff Hawkins

Real neurons in the brain are time-based prediction engines… there’s no concept of this at all in artificial point neurons.

— Jeff Hawkins

What is special about our species is not our genes. It’s our knowledge. That’s the rare thing we should preserve.

— Jeff Hawkins

Motivation: understanding the human brain as the path to machine intelligenceStructure and function of the neocortex versus older brain regionsHierarchical Temporal Memory (HTM) and the role of time and memory in intelligenceThousand Brains Theory: reference frames, cortical columns, and sensor fusion via votingFrom objects to abstract concepts: maps, mathematics, and language as spatial structuresBiological neurons vs. artificial neurons: prediction, sparsity, synaptogenesis, and continual learningImplications for AI progress, limitations of deep learning, and existential risk perspectives

High quality AI-generated summary created from speaker-labeled transcript.

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.