Skip to content
All-In PodcastAll-In Podcast

Jensen Huang: Why cheap chips still produce expensive tokens

Via Groq, Nvidia routes each inference step to the right chip. Vera Rubin targets agentic racks; Huang's key metric is token cost, not the datacenter price tag.

Jason CalacanishostJensen HuangguestDavid FriedberghostChamath Palihapitiyahost
Mar 19, 20261h 6mWatch on YouTube ↗

Episode Details

EPISODE INFO

Released
March 19, 2026
Duration
1h 6m
Channel
All-In Podcast
Watch on YouTube
▶ Open ↗

EPISODE DESCRIPTION

(0:00) Jensen Huang joins the show! (1:00) Acquiring Groq and the inference explosion (9:27) Decision making at the world's most valuable company (11:22) Physical AI's $50T market, OpenClaw's future, the new operating system for modern AI computing (17:12) AI's PR crisis, refuting doomer narratives, Anthropic's comms mistakes (21:22) Revenue capacity, token allocation for employees, Karpathy's autoresearch, agentic future (31:24) Open source, global diffusion, Iran/Taiwan supply chain impact (40:19) Self-driving platform, facing competition from active customers, responding to growth slowdown predictions (48:06) Datacenters in space, AI healthcare, Robotics (56:44) OpenAI/Anthropic revenue potential, how to build an AI moat (59:38) Advice to young people on excelling in the AI era Follow the besties: https://x.com/chamath https://x.com/Jason https://x.com/DavidSacks https://x.com/friedberg Follow on X: https://x.com/theallinpod Follow on Instagram: https://www.instagram.com/theallinpod Follow on TikTok: https://www.tiktok.com/@theallinpod Follow on LinkedIn: https://www.linkedin.com/company/allinpod Intro Music Credit: https://rb.gy/tppkzl https://x.com/yung_spielburg Intro Video Credit: https://x.com/TheZachEffect #allin #tech #news

SPEAKERS

  • Jason Calacanis

    host

    Angel investor and entrepreneur; founder of Launch and co-host of the All-In Podcast.

  • Jensen Huang

    guest

    Co-founder and CEO of Nvidia, leading its GPU and AI computing platform strategy.

  • David Friedberg

    host

    Entrepreneur and investor; founder of The Production Board and co-host of the All-In Podcast.

  • Chamath Palihapitiya

    host

    Venture capitalist; founder of Social Capital and co-host of the All-In Podcast.

EPISODE SUMMARY

In this episode of All-In Podcast, featuring Jason Calacanis and Jason Calacanis, Jensen Huang: Why cheap chips still produce expensive tokens explores jensen Huang on agents, physical AI, and inference growth economics Nvidia frames its evolution from a GPU vendor to an “AI factory” company, emphasizing disaggregated inference and heterogeneous compute (GPUs, CPUs, networking, storage processors, and Groq LPUs) orchestrated by an “operating system” layer (Dynamo).

RELATED EPISODES

SpaceX-Cursor Deal, SaaS Debt Bomb, New Apple CEO, SPLC Indictment, Colon Cancer Spike

SpaceX-Cursor Deal, SaaS Debt Bomb, New Apple CEO, SPLC Indictment, Colon Cancer Spike

Anthropic’s $30B Ramp, Mythos Doomsday, OpenClaw Ankled, Iran War Ceasefire, Israel's Influence

Anthropic’s $30B Ramp, Mythos Doomsday, OpenClaw Ankled, Iran War Ceasefire, Israel's Influence

Elon’s Anthropic Deal, The Next AI Monopoly?, “FDA for AI” Panic, Trading the AI Boom

Elon’s Anthropic Deal, The Next AI Monopoly?, “FDA for AI” Panic, Trading the AI Boom

OpenAI's Identity Crisis, Datacenter Wars, Market Up on Iran News, Mamdani's First Tax, Swalwell Out

OpenAI's Identity Crisis, Datacenter Wars, Market Up on Iran News, Mamdani's First Tax, Swalwell Out

OpenAI Misses Targets, Codex vs Claude, Elon vs Sam Trial, Big Hyperscaler Beats, Peptide Craze

OpenAI Misses Targets, Codex vs Claude, Elon vs Sam Trial, Big Hyperscaler Beats, Peptide Craze

NBA Gambling Scandal, Billionaire Tax, Tesla's Future, Amazon Robots, AWS Outage, Dangerous AI Bias

NBA Gambling Scandal, Billionaire Tax, Tesla's Future, Amazon Robots, AWS Outage, Dangerous AI Bias

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.

Add to Chrome