Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

Lex Fridman PodcastLex Fridman Podcast

Mark Zuckerberg: First Interview in the Metaverse | Lex Fridman Podcast #398

Mark Zuckerberg is CEO of Meta.

Lex FridmanhostMark Zuckerbergguest
Sep 27, 20231h 4mWatch on YouTube ↗

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

At a glance

WHAT IT’S REALLY ABOUT

Zuckerberg And Fridman Demo Photoreal Metaverse, Redefining Real Presence Online

  1. Lex Fridman interviews Mark Zuckerberg entirely inside Meta’s experimental photorealistic “Codec Avatar” system, demonstrating a sense of presence that feels nearly identical to in‑person interaction. Zuckerberg explains how high‑fidelity face and body scans are compressed into low‑bandwidth, real‑time avatars, and outlines the roadmap to making such avatars scannable via smartphones and usable across work, social, and mixed‑reality contexts. They explore how mixed reality in Quest 3 blends digital objects with physical space, and how Meta’s open‑source Llama 2 and new AI personas will power both assistants and character‑based AIs across Meta’s platforms. Throughout, they dive into philosophical and ethical questions about identity, grief, AI replicas, what counts as “real,” and how a blended physical–digital world could transform work, relationships, and civilization.

IDEAS WORTH REMEMBERING

5 ideas

Photorealistic avatars can cross the uncanny valley and enable true remote intimacy.

Fridman repeatedly forgets Zuckerberg is not physically present, suggesting Codec Avatars capture enough micro‑expressions—especially around the eyes—to recreate the psychological feeling of being in the same room, potentially overturning standard video‑call limitations.

Mass adoption depends on cheap, fast scanning—ideally via smartphones.

Today’s hour‑long, high‑end scans are a research process; Meta’s goal is a 2–3 minute phone scan that generates similar fidelity, which Zuckerberg frames as one of the last big technical hurdles before this becomes a consumer feature.

Mixed reality will make VR experiences safer, more comfortable, and more social.

Quest 3’s higher‑resolution passthrough, stronger chipset, and hand‑tracking let users see their real environment while interacting with digital objects, alleviating safety concerns and enabling scenarios like hiding behind your real couch from virtual enemies.

The ‘real world’ is shifting from purely physical to a physical‑digital blend.

Zuckerberg argues that the modern ‘real world’ will be the fusion of physical and holographic objects, where many current physical artifacts (screens, games, some art and media) are better as instantly instantiated digital holograms.

AI personas will be numerous, specialized, and embedded in social contexts.

Instead of one monolithic super‑assistant, Meta is building multiple AIs—from neutral Meta AI to business bots and entertaining characters like Snoop Dogg as a dungeon master—designed to live inside chats, games, and social apps.

WORDS WORTH SAVING

5 quotes

It feels like we're in the same room. It feels like the future.

— Lex Fridman

The real world is the combination of the physical world and the digital worlds coming together.

— Mark Zuckerberg

We’re basically shortcutting the laws of physics and delivering the social and psychological benefits of being able to be present with another person.

— Mark Zuckerberg

I'm already forgetting that you're not real… it feels like I'm seeing color for the first time.

— Lex Fridman

I don’t think we want one big superintelligence. We want to empower everyone with a variety of AIs.

— Mark Zuckerberg

Read the available transcript
Photorealistic Codec Avatars and the feeling of real presenceScanning, compression, and technical challenges of avatar creationMixed reality and Quest 3 as a mainstream MR platformBlending physical and digital worlds into a new conception of ‘real’AI personas, Meta AI, and creator/celebrity AI replicasEthics and norms: grief, identity, harm, and behavior in the metaverseOpen‑sourcing Llama 2 and Meta’s broader AI roadmap

High quality AI-generated summary created from speaker-labeled transcript.

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.