Mark Zuckerberg — Llama 3, $10B models, Caesar Augustus, & 1 GW datacenters

ℹ️ EPISODE INFO

Released

April 18, 2024

Duration

1h 18m

Channel

Dwarkesh Podcast

Watch on YouTube

▶ Open ↗

📝 EPISODE DESCRIPTION

Zuck on:

• Llama 3
• open sourcing towards AGI
• custom silicon, synthetic data, & energy constraints on scaling
• Caesar Augustus, intelligence explosion, bioweapons, $10b models, & much more

Enjoy! 𝐄𝐏𝐈𝐒𝐎𝐃𝐄 𝐋𝐈𝐍𝐊𝐒

• Transcript: https://www.dwarkeshpatel.com/p/mark-zuckerberg
• Apple Podcasts: https://podcasts.apple.com/us/podcast/mark-zuckerberg-llama-3-open-sourcing-%2410b-models-caeser/id1516093381?i=1000652877239
• Spotify: https://open.spotify.com/episode/6Lbsk4HtQZfkJ4dZjh7E7k?si=GOqj7hUdSaWSgi7ULWXjMA
• Me on Twitter: https://twitter.com/dwarkesh_sp

𝐒𝐏𝐎𝐍𝐒𝐎𝐑𝐒

• This episode is brought to you by Stripe, financial infrastructure for the internet. Millions of companies from Anthropic to Amazon use Stripe to accept payments, automate financial processes and grow their revenue. Learn more at https://stripe.com/

• V7 Go is a tool to automate multimodal tasks using GenAI, reliably and at scale. Use code DWARKESH20 for 20% off on the pro plan. Learn more at https://www.v7labs.com/go?utm_campaign=Dwarkesh%20Podcast%20Newsletter&utm_source=Dwarkesh-Podcast&utm_medium=Newsletter&utm_term=Paid-Email

• CommandBar is an AI user assistant that any software product can embed to non-annoyingly assist, support, and unleash their users. Used by forward-thinking CX, product, growth, and marketing teams. Learn more at https://www.commandbar.com/ If you’re interested in advertising on the podcast, fill out this form: https://airtable.com/appxGOvFLDLP5dlzv/pagFVrbHRohW6F2bZ/form 𝐓𝐈𝐌𝐄𝐒𝐓𝐀𝐌𝐏𝐒 00:00:00 - Llama 3 00:09:15 - Coding on path to AGI 00:26:07 - Energy bottlenecks 00:34:03 - Is AI the most important technology ever? 00:38:04 - Dangers of open source 00:54:40 - Caesar Augustus and metaverse 01:05:36 - Open sourcing the $10b model & custom silicon 01:16:02 - Zuck as CEO of Google+

🎤 SPEAKERS

• Mark Zuckerberg

  guest

• Dwarkesh Patel

  host

• Narrator

  other

🧾 EPISODE SUMMARY

In this episode of Dwarkesh Podcast, featuring Mark Zuckerberg and Dwarkesh Patel, Mark Zuckerberg — Llama 3, $10B models, Caesar Augustus, & 1 GW datacenters explores mark Zuckerberg bets on open-source AI, colossal compute, and metaverse Mark Zuckerberg discusses Meta’s launch of Llama 3, positioning Meta AI as the most capable freely available assistant and deeply integrating it into Meta’s apps with real‑time web search and powerful image generation.

🔗 RELATED EPISODES

David Reich – Bronze Age shock, the Neanderthal puzzle, & the sudden spread of farming

Jensen Huang – TPU competition, why we should sell chips to China, & Nvidia’s supply chain moat

Dario Amodei — “We are near the end of the exponential”

Andrej Karpathy — “We’re summoning ghosts, not building animals”

Why Leonardo was a saboteur, Gutenberg went broke, and Florence was weird – Ada Palmer

Richard Sutton – Father of RL thinks LLMs are a dead end