Why The Next AI Breakthroughs Will Be In Reasoning, Not Scaling

There's an ongoing debate about whether AI scaling laws will hold or hit a wall in the near future. However, what's clear now is today's models already have the power to increase productivity in ways that would have been unimaginable just a few years ago. In this episode of the Lightcone, we dig into the results of a recent o1 hackathon hosted by YC to find out what can be unlocked when founders leverage a SOTA reasoning model. Chapters (Powered by https://bit.ly/chapterme-yc) - 0:00 Intro 1:15 The intelligence age 4:18 YC o1 hackathon 12:09 4 orders of magnitude 14:42 The architecture of o1 21:52 Getting that final 10-15% of accuracy 32:06 The companies/ideas that should pivot because of o1 34:44 Outro

Harj TaggarhostGarry TanhostJared FriedmanhostDiana Huhost

Nov 14, 202435mWatch on YouTube ↗

EPISODE INFO

Released: November 14, 2024
Duration: 35m
Channel: Y Combinator
Watch on YouTube: ▶ Open ↗

EPISODE DESCRIPTION

There's an ongoing debate about whether AI scaling laws will hold or hit a wall in the near future. However, what's clear now is today's models already have the power to increase productivity in ways that would have been unimaginable just a few years ago. In this episode of the Lightcone, we dig into the results of a recent o1 hackathon hosted by YC to find out what can be unlocked when founders leverage a SOTA reasoning model. Chapters (Powered by https://bit.ly/chapterme-yc) - 0:00 Intro 1:15 The intelligence age 4:18 YC o1 hackathon 12:09 4 orders of magnitude 14:42 The architecture of o1 21:52 Getting that final 10-15% of accuracy 32:06 The companies/ideas that should pivot because of o1 34:44 Outro

SPEAKERS

Harj Taggar
host
Garry Tan
host
Jared Friedman
host
Diana Hu
host

EPISODE SUMMARY

In this episode of Y Combinator, featuring Harj Taggar and Garry Tan, Why The Next AI Breakthroughs Will Be In Reasoning, Not Scaling explores aI’s Next Leap: Reasoning Engines Transform Science, Chips, And Startups The hosts discuss Sam Altman’s recent AGI/ASI essay and argue that the next major AI breakthroughs will come from reasoning-focused models like OpenAI’s o1, not just larger model scaling. They highlight how o1’s chain-of-thought and reinforcement-learning-inspired architecture unlocks step-function improvements in hard domains such as chip design, CAD/airfoils, and complex customer support. Several YC-backed companies are showcased as concrete examples of o1 enabling system-level engineering, advanced physics simulations, and high-accuracy automation that older models like GPT-4o couldn’t reliably handle. The conversation closes with implications for startup moats, the centrality of evals and proprietary data, and how reasoning models may usher in a “Star Trek” style age of physical-world abundance if steered well.

RELATED EPISODES