Skip to content
a16za16z

The Biggest Bottlenecks For AI: Energy & Cooling

In this episode, Jen Kha, Head of Investor Relations, and David George, General Partner, discuss how late-stage private markets are evolving as AI reshapes scale, capital intensity, and growth timelines. They explain why AI-driven companies are staying private longer, how infrastructure spending is changing return profiles, and what this moment means for durability, value creation, and long-term outcomes in private markets. Timestamps: (00:00) Introduction (04:21) The Market Opportunity for AI (26:48) Pricing, Monetization, and Cash Burn (43:15) Companies Staying Private Longer (51:30) Portfolio Composition and Construction (57:18) Team Culture and Collaboration Resources: Follow Jen Kha on X: https://x.com/jkhamehl Follow David George on X: https://x.com/DavidGeorge83 Stay Updated: If you enjoyed this episode, be sure to like, subscribe, and share with your friends! Find a16z on X: https://x.com/a16z Find a16z on LinkedIn: https://www.linkedin.com/company/a16z Listen to the a16z Podcast on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX Listen to the a16z Podcast on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711 Follow our host: https://x.com/eriktorenberg Not an offer or solicitation. None of the information herein should be taken as investment advice; Some of the companies mentioned are portfolio companies of a16z. Please see https://a16z.com/disclosures/ for more information. A list of investments made by a16z is available at https://a16z.com/portfolio.

David GeorgeguestErik Torenberghost
Jan 25, 20261h 3mWatch on YouTube ↗

At a glance

WHAT IT’S REALLY ABOUT

AI growth boom strains energy, cooling, and business-model fundamentals fast

  1. AI infrastructure spending is accelerating sharply, with big tech shouldering much of the capex risk and enabling startups to build on top of a rapidly expanding compute base.
  2. Model access costs have fallen ~99% in two years while frontier capabilities improve quickly, creating a powerful tailwind for AI applications and new product categories.
  3. Unlike past infrastructure booms (e.g., early-2000s broadband), AI demand is materializing faster due to global distribution via the existing internet and cloud, though leverage and build-out financing still matter.
  4. Near-term AI bottlenecks are shifting from chips to energy and then to cooling, driving interest in nuclear power, data-center siting, and new cooling innovation.
  5. AI company economics should be judged primarily by customer value and retention plus efficient acquisition, with more near-term tolerance for lower gross margins given expected declines in model input costs under competition.

IDEAS WORTH REMEMBERING

5 ideas

Big tech capex de-risks the infrastructure layer for startups—up to a point.

George argues large platforms can absorb overbuild risk better than prior cycles, meaning many AI startups benefit from infrastructure they didn’t have to finance; the key watchout is leverage in the broader financing chain (banks/private debt/insurers).

AI’s demand ramp is unusually fast because distribution is already solved.

ChatGPT reaching massive search/query volume far faster than Google is used as evidence that AI rides on mature internet + cloud rails, reducing the “wait for adoption” lag that characterized earlier hardware- or network-dependent waves.

Energy becomes the dominant constraint over the next ~5 years; cooling follows.

They explicitly call energy a bottleneck today and highlight nuclear (restarts like Three Mile Island, colocating data centers near plants) plus natural gas siting; Torenberg adds that once energy is addressed, cooling capacity/innovation becomes the next limiting factor.

Expect more pricing sophistication (price discrimination) in AI than prior consumer tech eras.

They contrast Google/Facebook’s limited ability to price discriminate with AI subscriptions spanning low-price geographies (e.g., India) to high-end tiers ($200–$300/month), implying “P” (price) may rise meaningfully even if “Q” (users) saturates near multi-billion scale.

For AI apps, retention and acquisition efficiency matter more than today’s gross margins.

George prioritizes gross retention (enduring value) and organic pull over strict margin purity, betting that model competition will keep lowering inference/training input costs and lift application margins over time.

WORDS WORTH SAVING

5 quotes

I think our house view now is that AI is gonna end up like, you know, electricity or Wi-Fi.

David George

Just trust me when I tell you the cost of the inputs, um, you know, of accessing these models has declined 99%, or a little more than 99%, over the last two years.

David George

The time to get to 365 billion searches on ChatGPT was two years. The time for Google to get to 365 billion searches was 11 years, so it's five and a half times longer.

David George

I think energy ultimately in the next, call it, five years will probably be the bottleneck, and that's why we're so excited about nuclear and making investments in that area.

David George

The big component that I, I think most folks have not yet, uh, realized or zoned in on is, is the cooling piece.

Erik Torenberg

Big Tech AI capex and data-center buildoutModel cost declines vs capability improvementsAI demand distribution vs dot-com comparisonsEnergy constraints and nuclear power resurgenceCooling as the next infrastructure bottleneckGross margins, retention, and unit economics for AI appsPricing evolution: subscriptions, freemium, price discrimination, task-based monetizationCash burn drivers (R&D) and monetization upsideCompanies staying private longer; tenders and DPIPortfolio construction: champions vs elite research teams; follow-ons vs new dealsDisruption framework for incumbents: UI/UX, data, business modelSticky vs non-sticky AI application categories

High quality AI-generated summary created from speaker-labeled transcript.

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.

Add to Chrome