Skip to content
Matt Botvinick: Neuroscience, Psychology, and AI at DeepMind | Lex Fridman Podcast #106
This video isn’t embeddableWatch on YouTube →
Lex Fridman PodcastLex Fridman Podcast

Matt Botvinick: Neuroscience, Psychology, and AI at DeepMind | Lex Fridman Podcast #106

Matt Botvinick is the Director of Neuroscience Research at DeepMind. He is a brilliant cross-disciplinary mind navigating effortlessly between cognitive psychology, computational neuroscience, and artificial intelligence. Support this podcast by supporting our sponsors: - The Jordan Harbinger Show: https://www.jordanharbinger.com/lex - Magic Spoon: https://magicspoon.com/lex and use code LEX at checkout EPISODE LINKS: Matt's papers: https://scholar.google.com/citations?user=eM916YMAAAAJ PODCAST INFO: Podcast website: https://lexfridman.com/podcast Apple Podcasts: https://apple.co/2lwqZIr Spotify: https://spoti.fi/2nEwCF8 RSS: https://lexfridman.com/feed/podcast/ Full episodes playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4 Clips playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOeciFP3CBCIEElOJeitOr41 OUTLINE: 0:00 - Introduction 3:29 - How much of the brain do we understand? 14:26 - Psychology 22:53 - The paradox of the human brain 32:23 - Cognition is a function of the environment 39:34 - Prefrontal cortex 53:27 - Information processing in the brain 1:00:11 - Meta-reinforcement learning 1:15:18 - Dopamine 1:19:01 - Neuroscience and AI research 1:23:37 - Human side of AI 1:39:56 - Dopamine and reinforcement learning 1:53:07 - Can we create an AI that a human can love? CONNECT: - Subscribe to this YouTube channel - Twitter: https://twitter.com/lexfridman - LinkedIn: https://www.linkedin.com/in/lexfridman - Facebook: https://www.facebook.com/LexFridmanPage - Instagram: https://www.instagram.com/lexfridman - Medium: https://medium.com/@lexfridman - Support on Patreon: https://www.patreon.com/lexfridman

Lex FridmanhostMatt Botvinickguest
Jul 3, 20202h 0mWatch on YouTube ↗

CHAPTERS

  1. 0:00 – 3:04

    Sponsor messages and episode setup (Jordan Harbinger, Magic Spoon)

    Lex introduces Matt Botvinick and opens with sponsor messages before the conversation begins. He sets expectations about ad placement and how to support the podcast.

    • Who Matt Botvinick is and why he’s a compelling guest
    • Sponsor: The Jordan Harbinger Show
    • Sponsor: Magic Spoon cereal
    • Lex’s preferred podcast format: ads only at the beginning
    • Ways to support and follow the show
  2. 3:04 – 5:21

    How much of the brain we understand: the “foggy” high-level view vs mechanistic detail

    Botvinick describes neuroscience as having strong coarse, functional-level understanding and rapidly improving low-level measurement tools, but a major explanatory gap between them. Lex probes what “high level” means and why bridging levels matters.

    • Progress at a coarse functional/computational level of explanation
    • Rapid advances in measuring neurons (single-unit, dendrites)
    • A “yawning gap” between function-level theories and neural mechanisms
    • Why it’s hard to map cognition onto neural implementation
    • Framing the brain as a system turning perception into adaptive action
  3. 5:21 – 14:27

    Psychology and neuroscience as one enterprise: metaphors, reduction, and the gene analogy

    Botvinick argues that separating psychology from neuroscience is ultimately unhelpful: both aim to explain behavior and its mechanisms. He discusses the role of metaphorical constructs (attention, memory) and compares today’s cognitive theories to pre-DNA genetics.

    • Neuroscience as studying what the brain is for—behavior
    • Psychological constructs as useful “virtual mechanisms”
    • Why grounding in physical mechanisms still matters
    • Mendelian genes as a productive metaphor before molecular biology
    • Reduction without getting lost in infinite “turtles all the way down”
  4. 14:27 – 20:15

    What psychology gets right (and wrong): controlled experiments, neuropsychology, and real-world behavior

    Lex shares disappointment with small-N lab studies and lack of “in the wild” measurement; Botvinick defends psychology’s power while acknowledging limits. He highlights neuropsychology’s creativity in using lesions and deficits to reverse-engineer mental structure.

    • Why controlled experiments trade realism for interpretability
    • Neuropsychology as a major source of insight (lesion-deficit mapping)
    • Language models emerging from patient studies (production, comprehension, reading)
    • AI researchers rediscovering behavioral methods from cognitive psychology
    • The appeal of large-scale behavioral data (internet/social platforms)
  5. 20:15 – 22:55

    Botvinick’s path: medical school, art history, and discovering connectionism (PDP)

    Botvinick recounts an unusually cross-disciplinary trajectory—medicine and art history—before being pulled into cognitive modeling. A psychiatry rotation and the PDP books become the turning point that draws him into neural networks as a scientific framework.

    • Early interests: surgery and psychiatry as “beneath the surface” disciplines
    • A mentor introduces him to PDP (Parallel Distributed Processing)
    • Connectionism as early deep learning aimed at modeling cognition
    • Neural networks as the concrete entry point into science
    • How diverse backgrounds shape research taste and questions
  6. 22:55 – 28:10

    The paradox of the brain and the mystery of experience (consciousness, language, and “magic”)

    Botvinick articulates the “paradox” that the brain is both deeply mysterious and the source of everyday obviousness and familiarity. Lex connects this to consciousness and the loss of “magic” when cognition is forced into benchmarks and rigid scientific tasks.

    • The brain is always present yet hard to understand
    • Brains generating the full richness of human experience
    • AI discussions can feel too narrow (beyond just cognition + emotion)
    • Benchmarking language can strip away nuance (wit, music, spirit of the Turing test)
    • A commitment to explaining richness via computation—without settling for shallow tasks
  7. 28:10 – 30:33

    Deep learning in cognitive science: quasi-regularity and modeling the messiness of language

    They revisit classic cognitive debates (like English past tense) to show how connectionist models embraced real-world complexity rather than clean rule/exceptions stories. Botvinick argues deep learning can capture structured irregularity and representational richness.

    • Past tense debate: symbolic rules + exceptions vs connectionist learning
    • Real language data as “quasi-regular”: structure among exceptions
    • Why neural nets are suited to messy, graded structure
    • Training on corpora as a way to discover internal representations
    • Deep learning’s original cognitive-science spirit: model richness, not toy problems
  8. 30:33 – 37:50

    Human flexibility vs current AI: the “software-running” mind and Turing-machine analogy

    Lex asks what’s profoundly different between brains and modern AI; Botvinick focuses on flexibility and rapid contextual adaptation. He offers a Turing-machine-inspired view: humans aren’t universal computers, but they can ‘run’ novel behavioral programs within limits.

    • A key AI limitation: lack of human-like flexibility and rapid switching
    • Humans can generate behavior unlike anything done before
    • Brains as computational devices (with constraints)
    • The desire to explain the full spectrum—not just chess/arithmetic
    • Early framing of intelligence as implementing general-purpose behavioral ‘software’
  9. 37:50 – 40:06

    Cognition depends on the environment: task distributions, redundancy, and the role of other agents

    The discussion shifts to how intelligence is shaped by the structure of the world and social context. Botvinick emphasizes that cognition emerges from interaction with an environment rich in repeated structure—an idea that resonates with reinforcement learning and self-play.

    • Why focusing only on the agent is incomplete—environment structure matters
    • Human life as “endless variety with endless redundancy”
    • Communities and multi-agent settings as the context for human behavior
    • Debate: intelligence as individual vs community-level property
    • Self-play and other agents as part of the learning environment
  10. 40:06 – 49:41

    Prefrontal cortex: cognitive control, overriding habits, and cross-species questions

    Botvinick introduces prefrontal cortex anatomically and functionally, tracing early lesion insights and modern control-vs-habit frameworks. They explore whether animals (mice, flies) share comparable flexibility and how experimental design can hide or reveal intelligence.

    • Prefrontal cortex defined anatomically (in front of motor cortex)
    • History: wartime lesions and Luria’s observations of flexibility deficits
    • Controlled vs automatic behavior; goal-directed vs habitual control
    • Examples like handshakes vs elbow bumps as habit override
    • Model-organism debate: mice/flies intelligence vs task naturalism
  11. 49:41 – 53:26

    Is the brain modular or a “mush”? Graded specialization and surprising mixed signals

    Botvinick argues functional differentiation is real but often graded, with vague borders—especially in prefrontal regions. New measurement methods reveal unexpected information (like reward/task context) even in areas thought to be narrowly specialized, like primary visual cortex.

    • Strong evidence for specialization, but rarely clean modules
    • Differences across regions often graded rather than discrete
    • Prefrontal cortex has fuzzy subregion boundaries and mixed functions
    • Primary sensory cortex can encode task, behavior, and reward context
    • Neuroscience oscillation between modular and distributed views
  12. 53:26 – 1:00:11

    How the brain carries information: rate coding, spike timing, dendrites, and “are we totally wrong?”

    They examine neural communication and what’s abstracted away in artificial neural networks. Botvinick defends mainstream rate-coding as a useful approximation while acknowledging debates about precise timing, dendritic computation, and other subthreshold signals.

    • Mainstream view: spike rate as the key communicative variable
    • Alternative hypotheses: spike timing, dendritic computation, subthreshold signals
    • Neuroscience 101 pathway: neurotransmitters → voltage → spikes → axonal transmission
    • Why deep nets can still be reasonable models despite biological details
    • Deep-learning-to-brain correspondences as strong (but not definitive) evidence
  13. 1:00:11 – 1:15:10

    Prefrontal cortex as meta-reinforcement learning: how fast learning can emerge from slow learning

    Lex asks about Botvinick’s paper framing prefrontal cortex as a meta-RL system. Botvinick explains meta-learning (“learning to learn”) and shows how training recurrent networks across related tasks can produce emergent fast adaptation even when weights are frozen.

    • Meta-learning defined: a learning process that yields another learning algorithm
    • Learning-to-learn example: foreign languages get easier over time
    • Recurrent networks as working-memory systems with trainable dynamics
    • Slow RL weight updates shape dynamics that implement fast within-task learning
    • Neuroscience hypothesis: PFC may implement RL-like updates in activity patterns
  14. 1:15:10 – 1:18:58

    Dopamine meets distributional reinforcement learning: beyond single-number prediction errors

    Botvinick summarizes work connecting a new AI idea—distributional value learning—to dopamine signaling. Instead of encoding only scalar reward prediction errors, dopamine neurons may represent a distribution of possible outcomes, a hypothesis supported by experimental predictions.

    • Traditional link: dopamine as reward prediction error (TD learning)
    • Distributional RL: represent full outcome distributions, not just expected value
    • Why distributional methods can improve learning via richer representations
    • Collaboration with experimental neuroscience to generate and test predictions
    • Early evidence dopamine may encode “distributional surprise,” pending replication
  15. 1:18:58 – 1:23:37

    A virtuous circle between AI and neuroscience—and the difficulty of mastering both

    Botvinick describes AI and neuroscience as a mutually reinforcing loop, with AI currently generating many testable computational hypotheses for the brain. He also discusses the practical reality: deep expertise in both is rare, so progress often comes from diverse teams spanning the spectrum.

    • The “virtuous circle”: ideas flowing both directions between AI and neuroscience
    • AI currently “ahead” in generating algorithmic hypotheses to test in brains
    • Neuroscience methods exploding, but often lagging in behavioral richness
    • Why being world-class in both fields is hard (tooling/engineering complexity)
    • Best model: interdisciplinary communities with translators and specialists
  16. 1:23:37 – 1:47:59

    The human side of AI: human-agent interaction, preferences, autonomy, and social choice

    They pivot from mechanisms to meaning: if AI is to improve human life, it must understand and interact with humans rather than merely observe them. Botvinick argues the problem quickly expands from engineering into psychology, culture, economics, and politics—especially when humans disagree.

    • Human-agent interaction as essential, not optional, for beneficial AI
    • Safety is necessary but insufficient: define what “going right” looks like
    • Preference learning complications: people want help, but not total replacement
    • Cultural questions (e.g., would we want robot-performed Beethoven?)
    • Multi-human preference conflicts → economics, social choice theory, governance
  17. 1:47:59 – 1:53:05

    Where the fields are headed: richer behavior in neuroscience, flexibility and control in AI

    Botvinick forecasts a convergence: neuroscience regains focus on complex behavior thanks to new experimental paradigms, while AI turns toward human-like flexibility, abstraction, and cognitive control. These threads link back to prefrontal function and the challenge of rapid generalization.

    • Neuroscience trend: add meaningful behavior back into high-tech circuit studies
    • Technical constraints (e.g., head-fixed animals) driving creative VR/task design
    • AI trend: build systems that are multi-skilled and can switch quickly
    • Focus areas: abstraction, cognitive control, rapid transfer/generalization
    • PFC as a key biological reference point for flexibility mechanisms
  18. 1:53:05 – 2:00:32

    Can we build AI we can love? Warmth, trust, and the “ultimate Turing test”

    The conversation ends with an emotional and social challenge: beyond capability, humans evaluate others on warmth. Botvinick argues the deepest test of human-compatible AI is whether it can display genuine-seeming care without manipulation—and learn the social skills that convey it.

    • Social psychology frame: capability vs warmth (Susan Fiske’s model)
    • AI focuses on competence; warmth is the missing dimension
    • Warm behavior is partly learned skill, not just innate trait
    • The “ultimate Turing test”: are we comfortable calling the AI a ‘good guy’?
    • Open research problem: avoid deception while achieving authentic-feeling care

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.