Lex Fridman PodcastDileep George: Brain-Inspired AI | Lex Fridman Podcast #115
At a glance
WHAT IT’S REALLY ABOUT
Dileep George explains brain-inspired AI, inference, and human-like vision
- Lex Fridman and Dileep George explore how insights from neuroscience can guide the design of artificial intelligence, focusing especially on perception and vision. George critiques brute‑force brain simulations like Blue Brain and instead advocates for explicit computational theories that explain how neural microcircuits implement inference and world modeling. He describes his Recursive Cortical Network (RCN), a brain‑inspired vision system that uses feedback, lateral connections, and probabilistic inference to solve tasks like CAPTCHAs with very little training data. The conversation broadens to concept learning, grounded language understanding, memory, GPT‑style large language models, brain–computer interfaces, and what it really means to “understand” the brain if our goal is to build AGI.
IDEAS WORTH REMEMBERING
5 ideasYou can’t build a brain by simulating neurons without a theory of computation.
Projects like Blue Brain try to wire up detailed biophysical neuron models and hope intelligence emerges, but without a functional theory—what each structure computes and why—there’s no way to debug or guide the system when it fails.
Feedback and lateral connections are central to how the cortex performs inference.
Unlike purely feedforward deep nets, the visual cortex is densely interconnected with feedback and lateral pathways that let top–down expectations shape perception, explain illusions, and resolve ambiguity via iterative inference over competing hypotheses.
Brain-inspired graphical models can achieve strong data efficiency and robustness.
George’s Recursive Cortical Network uses probabilistic graphical models with feedback and lateral constraints to jointly perform recognition and segmentation, breaking many CAPTCHAs and achieving high MNIST accuracy from tens–hundreds of examples rather than tens of thousands.
Perception should be designed as part of a full cognition stack, not a standalone preprocessor.
George argues perception must be top‑down controllable and generative so higher-level cognition can “imagine,” manipulate internal models, and query perceptual knowledge—mirroring how humans visualize and mentally simulate scenarios from language or thought.
Grounded concepts and world models can’t be learned from text alone.
Text captures correlations in language, not the full causal, sensorimotor structure of the world; systems like GPT-3 can model text impressively but lack the ability to run physical simulations or access rich common-sense knowledge encoded in perception and action.
WORDS WORTH SAVING
5 quotesGetting a single neuron's model 99% right is like getting a transistor model right and then trying to build a microprocessor without understanding Boolean logic.
— Dileep George
What we are seeing is not just a feedforward thing. We are constantly projecting our expectations onto the world, and the final percept is a combination of that projection with the actual sensory input.
— Dileep George
To really solve CAPTCHA, you have to solve the whole problem of intelligence.
— Dileep George
Language is simulation-controlled. Your perceptual and motor systems are building a simulation of the world, and language is a way of querying and controlling that simulation.
— Dileep George
I don't treat brain-inspired as a marketing term. I'm looking into the details of biology and grappling with them.
— Dileep George
High quality AI-generated summary created from speaker-labeled transcript.
Get more out of YouTube videos.
High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.
Add to Chrome