Lex Fridman PodcastMark Zuckerberg: First Interview in the Metaverse | Lex Fridman Podcast #398
At a glance
WHAT IT’S REALLY ABOUT
Zuckerberg And Fridman Demo Photoreal Metaverse, Redefining Real Presence Online
- Lex Fridman interviews Mark Zuckerberg entirely inside Meta’s experimental photorealistic “Codec Avatar” system, demonstrating a sense of presence that feels nearly identical to in‑person interaction. Zuckerberg explains how high‑fidelity face and body scans are compressed into low‑bandwidth, real‑time avatars, and outlines the roadmap to making such avatars scannable via smartphones and usable across work, social, and mixed‑reality contexts. They explore how mixed reality in Quest 3 blends digital objects with physical space, and how Meta’s open‑source Llama 2 and new AI personas will power both assistants and character‑based AIs across Meta’s platforms. Throughout, they dive into philosophical and ethical questions about identity, grief, AI replicas, what counts as “real,” and how a blended physical–digital world could transform work, relationships, and civilization.
IDEAS WORTH REMEMBERING
5 ideasPhotorealistic avatars can cross the uncanny valley and enable true remote intimacy.
Fridman repeatedly forgets Zuckerberg is not physically present, suggesting Codec Avatars capture enough micro‑expressions—especially around the eyes—to recreate the psychological feeling of being in the same room, potentially overturning standard video‑call limitations.
Mass adoption depends on cheap, fast scanning—ideally via smartphones.
Today’s hour‑long, high‑end scans are a research process; Meta’s goal is a 2–3 minute phone scan that generates similar fidelity, which Zuckerberg frames as one of the last big technical hurdles before this becomes a consumer feature.
Mixed reality will make VR experiences safer, more comfortable, and more social.
Quest 3’s higher‑resolution passthrough, stronger chipset, and hand‑tracking let users see their real environment while interacting with digital objects, alleviating safety concerns and enabling scenarios like hiding behind your real couch from virtual enemies.
The ‘real world’ is shifting from purely physical to a physical‑digital blend.
Zuckerberg argues that the modern ‘real world’ will be the fusion of physical and holographic objects, where many current physical artifacts (screens, games, some art and media) are better as instantly instantiated digital holograms.
AI personas will be numerous, specialized, and embedded in social contexts.
Instead of one monolithic super‑assistant, Meta is building multiple AIs—from neutral Meta AI to business bots and entertaining characters like Snoop Dogg as a dungeon master—designed to live inside chats, games, and social apps.
WORDS WORTH SAVING
5 quotesIt feels like we're in the same room. It feels like the future.
— Lex Fridman
The real world is the combination of the physical world and the digital worlds coming together.
— Mark Zuckerberg
We’re basically shortcutting the laws of physics and delivering the social and psychological benefits of being able to be present with another person.
— Mark Zuckerberg
I'm already forgetting that you're not real… it feels like I'm seeing color for the first time.
— Lex Fridman
I don’t think we want one big superintelligence. We want to empower everyone with a variety of AIs.
— Mark Zuckerberg
High quality AI-generated summary created from speaker-labeled transcript.
Get more out of YouTube videos.
High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.
Add to Chrome