Skip to content
No PriorsNo Priors

No Priors Ep. 95 | Best of 2024

2024 has been a year of transformative technological progress, marked by conversations that have reshaped our understanding of AI's evolution and what lies ahead. Throughout the year, Sarah and Elad have had the privilege of speaking with some of the brightest minds in the field. As we look back on the past months, we’re excited to share highlights from some of our favorite No Priors podcast episodes. Featured guests include Jensen Huang (Nvidia), Andrej Karpathy (OpenAI, Tesla), Bret Taylor (Sierra), Aditya Ramesh, Tim Brooks, and Bill Peebles (OpenAI’s Sora Team), Dmitri Dolgov (Waymo), Dylan Field (Figma), and Alexandr Wang (Scale). Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil Show Notes: 0:00 Introduction 0:15 Jensen Huang on building at data-center scale 4:00 Andrej Karpathy on the AI exo-cortex, model control, and a shift to smaller models 7:14 Bret Taylor on the agentic future of business interactions 11:17 OpenAI’s Sora team on visual models and their role in AGI 15:53 Waymo’s Dmitri Dolgov on bridging the gap to full autonomy and the challenge of 100% accuracy 19:00 Figma’s Dylan Field on the future of interfaces and new modalities 23:29 Scale AI’s Alexandr Wang on the journey to AGI 26:29 Outro

Sarah GuohostJensen HuangguestAndrej KarpathyguestElad GilhostGuestguest
Dec 25, 202427mWatch on YouTube ↗

At a glance

WHAT IT’S REALLY ABOUT

AI’s 2024 Frontiers: Data Centers, Exocortex, Agents, World Models, AGI

  1. This “best of 2024” episode of No Priors curates highlights from conversations with leading AI and tech figures, focusing on how AI is reshaping infrastructure, products, and human-computer interaction.
  2. Jensen Huang explains NVIDIA’s evolution into a vertically integrated data center platform, while Andrej Karpathy explores AI as an exocortex and why small, distilled models may power personal cognition.
  3. Bret Taylor and Dylan Field discuss how AI agents and new UI paradigms will redefine digital business presence and interaction, from branded company agents to intelligent visual interfaces.
  4. The Sora team, Dmitri Dolgov, and Alexandre Wang debate world modeling, autonomy, and the road to AGI, contrasting views on generalization, scaling, and the many small problems still to solve.

IDEAS WORTH REMEMBERING

5 ideas

The new unit of computing is the data center, not the chip.

Jensen Huang argues that serious AI software requires designing and validating entire data centers, then disaggregating and selling components so NVIDIA’s stack can graft into all major cloud providers while keeping CUDA ubiquitous.

Owning your exocortex may become as important as owning your data.

Andrej Karpathy suggests that if AI becomes an extension of our cognition, people will care deeply about owning model weights or having open-source fallbacks rather than entirely ‘renting their brain’ from closed platforms.

Smaller, distilled models may provide a compact ‘cognitive core.’

Karpathy believes current LLMs waste capacity memorizing irrelevant details; with better data curation and distillation, performant models could shrink to around a billion parameters while using tools for external knowledge.

Branded AI agents will become the primary digital presence for companies.

Bret Taylor predicts that by around 2025, interacting with a business will mean talking to its AI agent that can handle everything from support to commerce, eventually encompassing the full scope of what the company does.

World-modeling from video may be a key ingredient in advanced intelligence.

The Sora team describes how training on video leads models to implicitly learn 3D structure, causality, and object interactions—potentially yielding better-than-human predictive capabilities as scale increases by simply ‘predicting data.’

WORDS WORTH SAVING

5 quotes

The new unit of computing is the data center.

— Jensen Huang

If it’s not your weights, is it not your brain?

— Andrej Karpathy

Existing digitally will probably mean having a branded AI agent that your customers can interact with to do everything that they can do on your website.

— Bret Taylor

Building Sora as a world model is very similar to a big part of the intelligence that humans have.

— Member of the OpenAI Sora team

The path to AGI is going to look a lot more like curing cancer than developing a vaccine.

— Alexandre Wang

NVIDIA’s shift from chip maker to full-stack data center ecosystemAI as an exocortex and debates over ownership, openness, and model sizeBranded company agents and the future of websites and customer experienceVideo-based world modeling with Sora and its role in AGI developmentThe difficulty of full self-driving versus driver assistance and the ‘last nines’ problemEvolving UI paradigms in an AI world, including chat, voice, and visual interfacesCompeting views on the path to AGI, generalization limits, and niche problem-solving

High quality AI-generated summary created from speaker-labeled transcript.

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.

Add to Chrome