All-In PodcastJensen Huang: Why cheap chips still produce expensive tokens
Via Groq, Nvidia routes each inference step to the right chip. Vera Rubin targets agentic racks; Huang's key metric is token cost, not the datacenter price tag.
Episode Details
EPISODE INFO
- Released
- March 19, 2026
- Duration
- 1h 6m
- Channel
- All-In Podcast
- Watch on YouTube
- ▶ Open ↗
EPISODE DESCRIPTION
(0:00) Jensen Huang joins the show! (1:00) Acquiring Groq and the inference explosion (9:27) Decision making at the world's most valuable company (11:22) Physical AI's $50T market, OpenClaw's future, the new operating system for modern AI computing (17:12) AI's PR crisis, refuting doomer narratives, Anthropic's comms mistakes (21:22) Revenue capacity, token allocation for employees, Karpathy's autoresearch, agentic future (31:24) Open source, global diffusion, Iran/Taiwan supply chain impact (40:19) Self-driving platform, facing competition from active customers, responding to growth slowdown predictions (48:06) Datacenters in space, AI healthcare, Robotics (56:44) OpenAI/Anthropic revenue potential, how to build an AI moat (59:38) Advice to young people on excelling in the AI era Follow the besties: https://x.com/chamath https://x.com/Jason https://x.com/DavidSacks https://x.com/friedberg Follow on X: https://x.com/theallinpod Follow on Instagram: https://www.instagram.com/theallinpod Follow on TikTok: https://www.tiktok.com/@theallinpod Follow on LinkedIn: https://www.linkedin.com/company/allinpod Intro Music Credit: https://rb.gy/tppkzl https://x.com/yung_spielburg Intro Video Credit: https://x.com/TheZachEffect #allin #tech #news
SPEAKERS
Jason Calacanis
hostAngel investor and entrepreneur; founder of Launch and co-host of the All-In Podcast.
Jensen Huang
guestCo-founder and CEO of Nvidia, leading its GPU and AI computing platform strategy.
David Friedberg
hostEntrepreneur and investor; founder of The Production Board and co-host of the All-In Podcast.
Chamath Palihapitiya
hostVenture capitalist; founder of Social Capital and co-host of the All-In Podcast.
EPISODE SUMMARY
In this episode of All-In Podcast, featuring Jason Calacanis and Jason Calacanis, Jensen Huang: Why cheap chips still produce expensive tokens explores jensen Huang on agents, physical AI, and inference growth economics Nvidia frames its evolution from a GPU vendor to an “AI factory” company, emphasizing disaggregated inference and heterogeneous compute (GPUs, CPUs, networking, storage processors, and Groq LPUs) orchestrated by an “operating system” layer (Dynamo).
RELATED EPISODES
