The 10 Trillion Parameter AI Model With 300 IQ

Earlier this month, OpenAI raised the largest venture round ever at $6.6 billion. The company’s CFO says AI is now at the point where orders of magnitude matter and the next generation of models will be capital intensive. In this episode of the Lightcone, the hosts consider what a world with ultra intelligent models would look like and what potential unlocks could be made possible. Apply to Y Combinator: https://ycombinator.com/apply Chapters (Powered by https://bit.ly/chapterme-yc) - 0:00 Coming Up 0:54 What models get unlocked with the biggest venture round ever? 5:35 Some discoveries take a long time to actually be felt by regular people 9:53 Distillation may be how most of us benefit 14:26 o1 making previously impossible things possible 21:17 The new Googles 23:47 o1 makes the GPU needs even bigger 25:44 Voice apps are fast growing 27:05 Incumbents aren’t taking these innovations seriously 31:52 Ten trillion parameters 33:15 Outro

Garry TanhostDiana HuhostHarj Taggarhost

Nov 1, 202433mWatch on YouTube ↗

EPISODE INFO

Released: November 1, 2024
Duration: 33m
Channel: Y Combinator
Watch on YouTube: ▶ Open ↗

EPISODE DESCRIPTION

Earlier this month, OpenAI raised the largest venture round ever at $6.6 billion. The company’s CFO says AI is now at the point where orders of magnitude matter and the next generation of models will be capital intensive. In this episode of the Lightcone, the hosts consider what a world with ultra intelligent models would look like and what potential unlocks could be made possible. Apply to Y Combinator: https://ycombinator.com/apply Chapters (Powered by https://bit.ly/chapterme-yc) - 0:00 Coming Up 0:54 What models get unlocked with the biggest venture round ever? 5:35 Some discoveries take a long time to actually be felt by regular people 9:53 Distillation may be how most of us benefit 14:26 o1 making previously impossible things possible 21:17 The new Googles 23:47 o1 makes the GPU needs even bigger 25:44 Voice apps are fast growing 27:05 Incumbents aren’t taking these innovations seriously 31:52 Ten trillion parameters 33:15 Outro

SPEAKERS

Garry Tan
host
Diana Hu
host
Harj Taggar
host

EPISODE SUMMARY

In this episode of Y Combinator, featuring Garry Tan and Garry Tan, The 10 Trillion Parameter AI Model With 300 IQ explores ten-Trillion-Parameter AI: From 300 IQ Models To Startup Goldrush The episode explores what ultra-large models (imagined at 10 trillion parameters and ~300 IQ) and OpenAI’s new o1 model mean for founders, enterprises, and the broader economy.

RELATED EPISODES