All-In PodcastJensen Huang: Why cheap chips still produce expensive tokens
Via Groq, Nvidia routes each inference step to the right chip. Vera Rubin targets agentic racks; Huang's key metric is token cost, not the datacenter price tag.
Episode Details
EPISODE INFO
- Released
- March 19, 2026
- Duration
- 1h 6m
- Channel
- All-In Podcast
- Watch on YouTube
- ▶ Open ↗
EPISODE DESCRIPTION
(0:00) Jensen Huang joins the show! (1:00) Acquiring Groq and the inference explosion (9:27) Decision making at the world's most valuable company (11:22) Physical AI's $50T market, OpenClaw's future, the new operating system for modern AI computing (17:12) AI's PR crisis, refuting doomer narratives, Anthropic's comms mistakes (21:22) Revenue capacity, token allocation for employees, Karpathy's autoresearch, agentic future (31:24) Open source, global diffusion, Iran/Taiwan supply chain impact (40:19) Self-driving platform, facing competition from active customers, responding to growth slowdown predictions (48:06) Datacenters in space, AI healthcare, Robotics (56:44) OpenAI/Anthropic revenue potential, how to build an AI moat (59:38) Advice to young people on excelling in the AI era Follow the besties: https://x.com/chamath https://x.com/Jason https://x.com/DavidSacks https://x.com/friedberg Follow on X: https://x.com/theallinpod Follow on Instagram: https://www.instagram.com/theallinpod Follow on TikTok: https://www.tiktok.com/@theallinpod Follow on LinkedIn: https://www.linkedin.com/company/allinpod Intro Music Credit: https://rb.gy/tppkzl https://x.com/yung_spielburg Intro Video Credit: https://x.com/TheZachEffect #allin #tech #news
SPEAKERS
Jason Calacanis
hostAngel investor and entrepreneur; founder of Launch and co-host of the All-In Podcast.
Jensen Huang
guestCo-founder and CEO of Nvidia, leading its GPU and AI computing platform strategy.
David Friedberg
hostEntrepreneur and investor; founder of The Production Board and co-host of the All-In Podcast.
Chamath Palihapitiya
hostVenture capitalist; founder of Social Capital and co-host of the All-In Podcast.
EPISODE SUMMARY
In this episode of All-In Podcast, featuring Jason Calacanis and Jason Calacanis, Jensen Huang: Why cheap chips still produce expensive tokens explores jensen Huang on agents, physical AI, and inference growth economics Nvidia frames its evolution from a GPU vendor to an “AI factory” company, emphasizing disaggregated inference and heterogeneous compute (GPUs, CPUs, networking, storage processors, and Groq LPUs) orchestrated by an “operating system” layer (Dynamo).
RELATED EPISODES
Get more out of YouTube videos.
High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.
Add to Chrome




