No Priors Ep. 74 | With Google DeepMind VP of Research Oriol Vinyals

In this episode of No Priors, hosts Sarah and Elad are joined by Oriol Vinyals, VP of Research, Deep Learning Team Lead, at Google DeepMind and Technical Co-lead of the Gemini project. Oriol shares insights from his career in machine learning, including leading the AlphaStar team and building competitive StarCraft agents. We talk about Google DeepMind, forming the Gemini project, and integrating AI technology throughout Google products. Oriol also discusses the advancements and challenges in long context LLMs, reasoning capabilities of models, and the future direction of AI research and applications. The episode concludes with a reflection on AGI timelines, the importance of specialized research, and advice for future generations in navigating the evolving landscape of AI. Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @oriolvinyalsml Show Notes: 00:00 Introduction to Oriol Vinyals 00:55 The Gemini Project and Its Impact 02:04 AI in Google Search and Chat Models 08:29 Infinite Context Length and Its Applications 14:42 Scaling AI and Reward Functions 31:55 The Future of General Models and Specialization 38:14 Reflections on AGI and Personal Insights 43:09 Will the Next Generation Study Computer Science? 45:37 Closing thoughts

Sarah GuohostOriol VinyalsguestElad Gilhost

Aug 1, 202446mWatch on YouTube ↗

EPISODE INFO

Released: August 1, 2024
Duration: 46m
Channel: No Priors
Watch on YouTube: ▶ Open ↗

EPISODE DESCRIPTION

In this episode of No Priors, hosts Sarah and Elad are joined by Oriol Vinyals, VP of Research, Deep Learning Team Lead, at Google DeepMind and Technical Co-lead of the Gemini project. Oriol shares insights from his career in machine learning, including leading the AlphaStar team and building competitive StarCraft agents. We talk about Google DeepMind, forming the Gemini project, and integrating AI technology throughout Google products. Oriol also discusses the advancements and challenges in long context LLMs, reasoning capabilities of models, and the future direction of AI research and applications. The episode concludes with a reflection on AGI timelines, the importance of specialized research, and advice for future generations in navigating the evolving landscape of AI. Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @oriolvinyalsml Show Notes: 00:00 Introduction to Oriol Vinyals 00:55 The Gemini Project and Its Impact 02:04 AI in Google Search and Chat Models 08:29 Infinite Context Length and Its Applications 14:42 Scaling AI and Reward Functions 31:55 The Future of General Models and Specialization 38:14 Reflections on AGI and Personal Insights 43:09 Will the Next Generation Study Computer Science? 45:37 Closing thoughts

SPEAKERS

Sarah Guo
host
Oriol Vinyals
guest
Elad Gil
host
Narrator
other

EPISODE SUMMARY

In this episode of No Priors, featuring Sarah Guo and Oriol Vinyals, No Priors Ep. 74 | With Google DeepMind VP of Research Oriol Vinyals explores google DeepMind’s Oriol Vinyals on Gemini, AGI, and Infinite Context Oriol Vinyals, VP of Research at Google DeepMind and Gemini co-lead, explains how Google Brain and DeepMind were unified into Google DeepMind and how the Gemini project emerged as Google’s core, multimodal foundation model. He outlines how Gemini powers products from Search and Ads to Cloud, developer tooling, and the Gemini chatbot, and why Google remains agnostic between chat-first and search-first interfaces. Vinyals highlights long and “infinite” context windows, hybrid retrieval-plus-neural architectures, and improved reasoning/reward models as the next major frontiers for LLMs. He is optimistic about AGI arriving around the 2028–2030 timeframe but argues the focus should be on practical impact, scientific progress, and how humans adapt to and collaborate with these systems.

RELATED EPISODES