Nvidia: The Machine Learning Company (2006-2022)

By 2012, NVIDIA was on a decade-long road to nowhere. Or so most rational observers of the company thought. CEO Jensen Huang was plowing all the cash from the company’s gaming business into building a highly speculative platform with few clear use cases and no obviously large market opportunity. And then... a miracle happened. A miracle that led not only to Nvidia becoming the 8th largest market cap company in the world, but also nearly every internet and technology innovation that’s happened in the decade since. Machines learned how to learn. And they learned it... on Nvidia. PSA: We’re doing an ARENA SHOW!! May 4th, 2022 in Seattle (Star Wars day). All proceeds go to charity. We’d love to see you there! https://events.pitchbook.com/acquired If you want more Acquired, you can follow our newly public LP Show feed here in the podcast player of your choice (including Spotify!): https://pod.link/acquiredlp Sponsors: Thank you to our presenting sponsor for all of Season 10, Vanta! Vanta is the leader in automated security compliance – making SOC 2, HIPAA, GDPR, and more a breeze for startups and organizations of all sizes. You might say they’re like the “AWS of security and compliance”. Everyone in the Acquired community can get 10% off using this link: https://bit.ly/acquiredvanta Thank you as well to Vouch and to SoftBank Latin America! https://bit.ly/acquired-vouch https://bit.ly/acquiredsoftbanklatam Links: Ben Thompson’s great Stratechery interview with Jensen: https://stratechery.com/2022/an-interview-with-nvidia-ceo-jensen-huang-about-manufacturing-intelligence/ Linus Tech Tips tests an Nvidia A100: https://www.youtube.com/watch?v=zBAxiQi2nPc Episode sources: https://docs.google.com/document/d/1BRPps0c_MoZq7TAKt7gpkHlAhQH0AMcT2MkpkemyP2k/edit Carve Outs: The Expanse short story collection, Memory's Legion: https://www.amazon.com/Memorys-Legion-Complete-Expanse-Collection-ebook/dp/B096RSDCVK Sony RX100 point-and-shoot camera: https://electronics.sony.com/imaging/compact-cameras/all-compact-cameras/p/dscrx100m7-b ‍Note: Acquired hosts and guests may hold assets discussed in this episode. This podcast is not investment advice, and is intended for informational and entertainment purposes only. You should do your own research and make your own independent decisions when considering any financial transactions.

Ben GilberthostDavid Rosenthalhost

Apr 19, 20222h 15mWatch on YouTube ↗

WHAT IT’S REALLY ABOUT

Nvidia’s CUDA bet transformed a gaming chipmaker into AI platform

The episode traces Nvidia’s post-2006 pivot from a dominant gaming GPU business to a broader mission: general-purpose computing on GPUs, enabled by the CUDA software platform.
That bet looked irrational for years—costly, early, and with an unclear market—leading to major stock drawdowns (2008, 2011) while Nvidia invested heavily in software, drivers, and developer tooling.
The “miracle” catalyst was deep learning’s breakthrough moment (ImageNet/AlexNet in 2012), which used CUDA on Nvidia GPUs and ignited massive enterprise/hyperscaler demand for GPU compute in data centers.
The hosts argue Nvidia’s moat now comes from full-stack integration (hardware + CUDA + libraries/SDKs + systems), enabling high margins and expanding ambitions into networking (Mellanox), CPUs (Grace), automotive, and Omniverse/digital twins.

IDEAS WORTH REMEMBERING

5 ideas

CUDA created lock-in by making Nvidia a platform, not a chip vendor.

Nvidia gave CUDA away for free, but kept it proprietary to Nvidia hardware—an Apple-like play that built switching costs for developers and enterprises that standardized on CUDA libraries and tooling.

Owning drivers and the developer relationship was a hidden early moat.

Unlike peers that outsourced drivers, Nvidia internalized them, building deep low-level software capability and tighter user experience control—foundational for later full-stack ambitions.

The CUDA investment was an iPhone-sized bet made while already successful.

Nvidia pursued general-purpose GPU computing despite unclear market size, high cost, and long time-to-utility—an unusually bold move for a multi-billion-dollar public company.

AlexNet (2012) was the demand shock that made CUDA inevitable.

Deep learning’s computational intensity mapped perfectly to GPU parallelism; AlexNet’s success on CUDA/Nvidia GPUs turned “maybe someday” into immediate, compounding enterprise and hyperscaler demand.

Data center economics changed Nvidia’s business quality dramatically.

Enterprise GPUs and systems sell at far higher price points than consumer cards (tens of thousands vs. thousands), supporting Apple-like gross margins and strong operating profitability.

WORDS WORTH SAVING

5 quotes

If you don't build it, they can't come.

— David Rosenthal (citing Jensen Huang’s framing)

CUDA… is entirely free… [but] closed source and proprietary exclusively to Nvidia's hardware.

— David Rosenthal

This was the Big Bang moment for artificial intelligence, and NVIDIA and CUDA were right there.

— David Rosenthal

Every single [deep learning startup] effectively comes in building on NVIDIA's platforms… We’d put in all of our money to NVIDIA.

— Ben Gilbert (quoting Marc Andreessen)

You say solutions, I hear gross margin.

— Ben Gilbert

CUDA as a full-stack platform betEarly competitive advantages: ship cadence, driver control, programmability2008–2011 stumbles: earnings whiffs, Tegra mobile detourImageNet/AlexNet and the deep learning inflectionData center monetization and margin expansionSegmentation tactics: enterprise GPUs, GeForce restrictions, crypto miningStrategic frontiers: Mellanox/DPUs, Arm attempt, Grace CPU, Omniverse, automotive

High quality AI-generated summary created from speaker-labeled transcript.

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.