The Twenty Minute VCJonathan Ross, Founder & CEO @ Groq: NVIDIA vs Groq - The Future of Training vs Inference | E1260
Episode Details
EPISODE INFO
- Released
- February 17, 2025
- Duration
- 1h 25m
- Channel
- The Twenty Minute VC
- Watch on YouTube
- ▶ Open ↗
EPISODE DESCRIPTION
Jonathan Ross is the Founder & CEO of Groq, the creator of the world’s first Language Processing Unit (LPUTM). Prior to Groq, Jonathan began what became Google’s Tensor Processing Unit (TPU) as a 20% project where he designed and implemented the core elements of the first-generation TPU chip. Jonathan next joined Google X’s Rapid Eval Team, the initial stage of the famed “Moonshots Factory”, where he devised and incubated new Bets (Units) for Google’s parent company, Alphabet. ---------------------------------------------- In Today’s Episode We Discuss: (00:00) Intro (01:29) Scaling Laws and AI Model Training (06:48) Synthetic Data and Model Efficiency (09:00) Inference vs. Training Costs: Why NVIDIA Loses Inference (15:12) The Future of AI Inference: Efficiency and Cost (16:35) Chip Supply and Scaling Concerns (19:40) Energy Efficiency in AI Computation (25:37) Why Most Dollars Into Datacenters Will Be Lost (31:41) Meta, Google, and Microsoft's Data Center Investments (43:24) Distribution of Value in the AI Economy (44:17) Stages of Startup Success (45:46) The AI Investment Bubble (47:45) The Keynesian Beauty Contest in VC (51:52) NVIDIA's Role in the AI Ecosystem (57:30) China's AI Strategy and Global Implications (01:02:25) Europe's Potential in the AI Revolution (01:17:13) Future Predictions and AI's Impact on Society ---------------------------------------------- Subscribe on Spotify: https://open.spotify.com/show/3j2KMcZTtgTNBKwtZBMHvl?si=85bc9196860e4466 Subscribe on Apple Podcasts: https://podcasts.apple.com/us/podcast/the-twenty-minute-vc-20vc-venture-capital-startup/id958230465 Follow Harry Stebbings on Twitter: https://twitter.com/HarryStebbings Follow Jonathan Ross on Twitter: https://twitter.com/JonathanRoss321 Follow 20VC on Instagram: https://www.instagram.com/20vchq Follow 20VC on TikTok: https://www.tiktok.com/@20vc_tok Visit our Website: https://www.20vc.com Subscribe to our Newsletter: https://www.thetwentyminutevc.com/contact ----------------------------------------------- #20vc #harrystebbings #jonathanross #groq #CEO #venturecapital #founder #ai #nvidia #modeltraining #inference
SPEAKERS
Jonathan Ross
guestHarry Stebbings
host
EPISODE SUMMARY
In this episode of The Twenty Minute VC, featuring Jonathan Ross and Harry Stebbings, Jonathan Ross, Founder & CEO @ Groq: NVIDIA vs Groq - The Future of Training vs Inference | E1260 explores groq’s Jonathan Ross Redefines AI Inference, Chips, and Global Power Dynamics Jonathan Ross, founder and CEO of Groq, explains why AI inference, not training, will be the dominant long‑term bottleneck and economic driver, and how Groq’s LPU architecture is built specifically to win that market. He argues that synthetic data, better algorithms, and massive compute will push scaling laws further than most people expect, while energy and power infrastructure become true hard constraints. Groq’s model avoids high‑margin GPU training, instead targeting low‑margin, ultra‑high‑volume inference with a capital‑light, revenue‑sharing deployment model, exemplified by its multibillion‑dollar Saudi deal. Ross also examines NVIDIA’s position, China’s AI trajectory, Europe’s strategic choices, and the societal risks of abundance and over‑delegation to AI, framing Groq’s mission as preserving human agency in the age of AI.
RELATED EPISODES
