Skip to content
AcquiredAcquired

Google: The AI Company. Google is amazingly well-positioned... will they win in AI? (audio)

Google faces the greatest innovator's dilemma in history. They invented the Transformer — the breakthrough technology powering every modern AI system from ChatGPT to Claude (and, of course, Gemini). They employed nearly all the top AI talent: Ilya Sutskever, Geoff Hinton, Demis Hassabis, Dario Amodei — more or less everyone who leads modern AI worked at Google circa 2014. They built the best dedicated AI infrastructure (TPUs!) and deployed AI at massive scale years before anyone else. And yet... the launch of ChatGPT in November 2022 caught them completely flat-footed. How on earth did the greatest business in history wind up playing catch-up to a nonprofit-turned-startup? Today we tell the complete story of Google's 20+ year AI journey: from their first tiny language model in 2001 through the creation Google Brain, the birth of the transformer, the talent exodus to OpenAI (sparked by Elon Musk's fury over Google’s DeepMind acquisition), and their current all-hands-on-deck response with Gemini. And oh yeah — a little business called Waymo that went from crazy moonshot idea to doing more rides than Lyft in San Francisco, potentially building another Google-sized business within Google. This is the story of how the world's greatest business faces its greatest test: can they disrupt themselves without losing their $140B annual profit-generating machine in Search? Sponsors: Many thanks to our fantastic Fall ‘25 Season partners: J.P. Morgan Payments https://bit.ly/acquiredJPMPgoogle3yt Sentry https://bit.ly/acquiredsentry WorkOS https://bit.ly/workos25 Shopify https://bit.ly/ShopifyACQ25 Acquired’s 10th Anniversary Celebration! - When: October 20th, 4:00 PM PT - Who: All of you! - Where: https://us02web.zoom.us/j/84061500817?pwd=opmlJrbtOAen4YOTGmPlNbrOMLI8oo.1 0:00 The Innovator's Dilemma: Google's AI Challenge 4:36 From PageRank to language models: Google's Early AI Foundations 17:21 Parallelizing Language: Jeff Dean's Google Translate Revolution 24:05 Sebastian Thrun and Geoff Hinton: Laying Google X Foundations 35:10 Unsupervised Learning: Google Brain's Cat Paper Breakthrough 47:05 From AlexNet to DeepMind: The GPU AI Revolution 1:00:02 The DeepMind Acquisition: AlphaGo and AI's New Frontier 1:40:22 Building TPUs: Google's Hardware Bet on AI 1:51:25 "Attention Is All You Need": The Transformer's Impact 2:04:01 Elon's Exit, Microsoft's Entry: OpenAI's New Path 2:15:43 The Chat GPT Shockwave: Google's Code Red Response 2:37:32 Unifying AI: Gemini and the Google DeepMind Merger 2:46:58 From DARPA Challenge to Robotaxis: Waymo's Long Road 3:03:44 Waymo's Billion-Dollar Potential and Google's Financial Power 3:20:26 Google Cloud's Strategic Role in the AI Ecosystem 3:32:31 Bull and Bear Cases on the Future of Google 3:53:10 Navigating the Innovator's Dilemma: Google's AI Strategy 3:54:34 NFL Summit Carveouts, and Outro Links: Sign up for email updates and vote on future episodes! https://www.acquired.fm/email Geoff Hinton’s 2007 Tech Talk at Google https://youtu.be/AyzOUbkUf3M?si=sLQJsEwq-JEOQmIN Our recent ACQ2 episode with Tobi Lutke https://www.acquired.fm/episodes/how-to-live-in-everyone-elses-future-with-shopify-ceo-tobi-lutke Worldly Partners’ Multi-Decade Alphabet Study https://worldlypartners.com/businesshistory In the Plex https://www.amazon.com/Plex-Google-Thinks-Works-Shapes/dp/1416596585 Supremecy https://www.amazon.com/Supremacy-ChatGPT-Race-Change-World/dp/1250337747 Genius Makers https://www.amazon.com/Genius-Makers-Mavericks-Brought-Facebook/dp/1524742678 All episode sources https://docs.google.com/document/d/1B7MSmQDqaTtcxWskoVwN0V5N292So_9lKiArzRUgTFU/edit?usp=sharing Carve Outs: We’re hosting the Super Bowl Innovation Summit! https://bit.ly/SBISFall25 F1: The Movie https://www.imdb.com/title/tt16311594/ Travelpro suitcases https://travelpro.com Glue Guys Podcast https://open.spotify.com/show/18n6FcVMR5J0hSeboeETPc?si=b876358f752a474d Sea of Stars https://seaofstarsgame.co Stepchange Podcast https://open.spotify.com/show/3RHJ129caYkxh2FliqtaBP?si=2bef3a854e084a39 More Acquired: Get email updates and vote on future episodes! https://www.acquired.fm/email Join the Slack http://acquired.fm/slack Subscribe to ACQ2 https://pod.link/acquiredlp Check out the latest swag in the ACQ Merch Store! https://www.acquired.fm/store Note: Acquired hosts and guests may hold assets discussed in this episode. This podcast is not investment advice, and is intended for informational and entertainment purposes only. You should do your own research and make your own independent decisions when considering any financial transactions.

Ben GilberthostDavid Rosenthalhost
Oct 6, 20254h 6mWatch on YouTube ↗

CHAPTERS

  1. Google’s Innovator’s Dilemma: AI Could Cannibalize Search

    The hosts frame Google’s AI situation as a classic innovator’s dilemma: the company invented key AI breakthroughs yet risks undermining its own extraordinarily profitable Search business by embracing AI-native products. They outline Google’s unique assets—models, chips, cloud, talent, and distribution—and pose the core strategic question: will Google protect Search or bet fully on AI?

  2. Early AI DNA at Google: PageRank, Data Compression, and PHIL

    The story rewinds to Google’s earliest years, when language modeling and machine learning were already embedded in the company’s culture. A lunch conversation about “compressing data equals understanding it” leads Noam Shazeer and Georges Harik to build early probabilistic language models that become foundational to core products.

  3. Google Translate’s Production Breakthrough: Jeff Dean Parallelizes Language

    Google Translate’s research-grade language models were powerful but unusably slow until Jeff Dean re-architected them for parallel processing. This chapter shows Google’s hallmark strength: turning frontier research into production systems at enormous scale.

  4. Sebastian Thrun, Geoff Hinton, and the Birth of Google X

    Sebastian Thrun joins Google and proves ambitious data-driven projects can reshape products, notably through Maps/Street View efforts. He also pulls in academic talent like Geoff Hinton, helping mainstream deep learning inside Google and paving the way for the moonshot factory, Google X.

  5. Google Brain and the “Cat Paper”: Proving Large-Scale Unsupervised Learning

    Google Brain launches under Andrew Ng, Jeff Dean, and Greg Corrado with the DistBelief infrastructure. Their “cat paper” demonstrates that large neural nets trained on unlabeled YouTube frames can learn meaningful concepts—unlocking a decade of recommendation-driven consumer internet products.

  6. AlexNet, GPUs, and the AI ‘Big Bang’—Plus a Wild Acquisition Auction

    AlexNet’s ImageNet win proves GPUs are the right hardware for deep learning and accelerates the entire field. Google acquires DNNResearch (Hinton/Krizhevsky/Sutskever) via an auction story that foreshadows today’s AI talent wars and the Google–DeepMind–OpenAI web of relationships.

  7. DeepMind’s Origin, Funding, and Google Acquisition

    DeepMind forms in London with an AGI mission (‘solve intelligence’), funded by contrarian backers like Peter Thiel and later Elon Musk. Zuckerberg’s interest triggers a competitive dynamic, and Google ultimately acquires DeepMind with unusual governance/ethics carveouts to preserve its research mission.

  8. DeepMind’s Early Wins: Data Center Cooling and AlphaGo’s Leap

    Post-acquisition, DeepMind quickly delivers tangible business value (data center cooling) while also achieving iconic research milestones (AlphaGo). AlphaGo’s creative play illustrates why deep reinforcement learning captured the world’s imagination and reshaped perceptions of AI capability.

  9. OpenAI’s Creation: Elon’s Reaction, Talent Exodus, and the Microsoft Pivot

    Elon’s anger over DeepMind’s sale to Google helps catalyze OpenAI’s founding as an ‘open’ nonprofit research lab to counter Google/Facebook’s AI dominance. Funding constraints and compute needs later force a structural pivot: a capped-profit entity and a landmark partnership with Microsoft Azure.

  10. Google’s Hardware Bet: From GPUs to TPUs and TensorFlow

    As deep learning demand explodes inside Google, GPU dependence becomes both a scaling and cost problem. Google responds by building TPUs—specialized matrix-multiplication chips—and by open-sourcing TensorFlow, creating a scalable ML platform across CPUs, GPUs, and TPUs.

  11. Transformers: ‘Attention Is All You Need’ and Google’s Missed Platform Shift

    Google Brain develops the Transformer to overcome LSTM limitations, enabling better context handling and extreme parallelism. Despite creating the foundational architecture for modern LLMs, Google treats it as an incremental improvement rather than a full platform shift—while key authors later leave to build elsewhere.

  12. ChatGPT Shockwave and Google’s Code Red: Bard, DeepMind–Brain Merger, Gemini

    ChatGPT’s viral adoption and Microsoft’s Bing integration trigger an existential crisis inside Google. After a rushed and rocky Bard launch, Sundar Pichai makes two decisive moves: merge Brain and DeepMind, and unify efforts under one flagship model brand—Gemini—to accelerate product shipping and competitiveness.

  13. Waymo’s Long Road: From DARPA Challenge to Scaled Robotaxis

    The episode detours into Waymo as Google’s major ‘Other Bet’ that intersects with AI advancements. Starting from DARPA roots and Sebastian Thrun’s early breakthroughs, Waymo evolves into commercial driverless service—an enormous potential market with safety and operational complexity as the key bottlenecks.

  14. Google Today: Financial Firepower, Cloud as AI Distribution, and Bull vs Bear Cases

    The hosts close by assessing Google’s current business strength, Cloud’s strategic role, and how Gemini/TPUs/Cloud form a vertically integrated AI stack. They outline competing futures: Google’s unmatched distribution and economics versus the risk that AI monetizes worse than Search and dilutes share in a multi-player market.

  15. Wrap-Up: Powers, Quintessence, and Community/Outro Announcements

    The episode ends with a Seven Powers-style reflection (scale economies, brand, cornered resources), concluding that Google is navigating an unprecedented innovator’s dilemma. The hosts share carve-outs and community announcements, including Acquired’s anniversary event and Super Bowl week programming.

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.

Add to Chrome