Skip to content
The Twenty Minute VCThe Twenty Minute VC

Jonathan Ross, Founder & CEO @ Groq: NVIDIA vs Groq - The Future of Training vs Inference | E1260

Jonathan Ross is the Founder & CEO of Groq, the creator of the world’s first Language Processing Unit (LPUTM). Prior to Groq, Jonathan began what became Google’s Tensor Processing Unit (TPU) as a 20% project where he designed and implemented the core elements of the first-generation TPU chip. Jonathan next joined Google X’s Rapid Eval Team, the initial stage of the famed “Moonshots Factory”, where he devised and incubated new Bets (Units) for Google’s parent company, Alphabet. ---------------------------------------------- In Today’s Episode We Discuss: (00:00) Intro (01:29) Scaling Laws and AI Model Training (06:48) Synthetic Data and Model Efficiency (09:00) Inference vs. Training Costs: Why NVIDIA Loses Inference (15:12) The Future of AI Inference: Efficiency and Cost (16:35) Chip Supply and Scaling Concerns (19:40) Energy Efficiency in AI Computation (25:37) Why Most Dollars Into Datacenters Will Be Lost (31:41) Meta, Google, and Microsoft's Data Center Investments (43:24) Distribution of Value in the AI Economy (44:17) Stages of Startup Success (45:46) The AI Investment Bubble (47:45) The Keynesian Beauty Contest in VC (51:52) NVIDIA's Role in the AI Ecosystem (57:30) China's AI Strategy and Global Implications (01:02:25) Europe's Potential in the AI Revolution (01:17:13) Future Predictions and AI's Impact on Society ---------------------------------------------- Subscribe on Spotify: https://open.spotify.com/show/3j2KMcZTtgTNBKwtZBMHvl?si=85bc9196860e4466 Subscribe on Apple Podcasts: https://podcasts.apple.com/us/podcast/the-twenty-minute-vc-20vc-venture-capital-startup/id958230465 Follow Harry Stebbings on Twitter: https://twitter.com/HarryStebbings Follow Jonathan Ross on Twitter: https://twitter.com/JonathanRoss321 Follow 20VC on Instagram: https://www.instagram.com/20vchq Follow 20VC on TikTok: https://www.tiktok.com/@20vc_tok Visit our Website: https://www.20vc.com Subscribe to our Newsletter: https://www.thetwentyminutevc.com/contact ----------------------------------------------- #20vc #harrystebbings #jonathanross #groq #CEO #venturecapital #founder #ai #nvidia #modeltraining #inference

Jonathan RossguestHarry Stebbingshost
Feb 17, 20251h 25mWatch on YouTube ↗

CHAPTERS

  1. 0:00 – 1:29

    Intro

  2. 1:29 – 6:48

    Scaling Laws and AI Model Training

  3. 6:48 – 9:00

    Synthetic Data and Model Efficiency

  4. 9:00 – 15:12

    Inference vs. Training Costs: Why NVIDIA Loses Inference

  5. 15:12 – 16:35

    The Future of AI Inference: Efficiency and Cost

  6. 16:35 – 19:40

    Chip Supply and Scaling Concerns

  7. 19:40 – 25:37

    Energy Efficiency in AI Computation

  8. 25:37 – 31:41

    Why Most Dollars Into Datacenters Will Be Lost

  9. 31:41 – 43:24

    Meta, Google, and Microsoft's Data Center Investments

  10. 43:24 – 44:17

    Distribution of Value in the AI Economy

  11. 44:17 – 45:46

    Stages of Startup Success

  12. 45:46 – 47:45

    The AI Investment Bubble

  13. 47:45 – 51:52

    The Keynesian Beauty Contest in VC

  14. 51:52 – 57:30

    NVIDIA's Role in the AI Ecosystem

  15. 57:30 – 1:02:25

    China's AI Strategy and Global Implications

  16. 1:02:25 – 1:17:13

    Europe's Potential in the AI Revolution

  17. 1:17:13 – 1:25:52

    Future Predictions and AI's Impact on Society

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.

Add to Chrome