Skip to content
a16za16z

Amazon CEO Andy Jassy on the $220 Billion AI Buildout

Amazon expects to spend roughly $220 billion in CapEx in 2026, yet CEO Andy Jassy says the company is still leaving meaningful AI demand on the table. He believes the buildout could ultimately help make AWS a $1 trillion annual run-rate business. Andy joins a16z co-founder Ben Horowitz and Erik Torenberg to discuss why AI demand is growing so quickly, how Amazon decides how much infrastructure to build, and why lower inference costs could unlock broader enterprise adoption. They also discuss how AI is reshaping Amazon itself, from smaller teams building products faster to reimagining Alexa, and why Andy sees cybersecurity, human judgment, and critical thinking as increasingly important in the AI era. Timestamps: 00:00 Intro 00:47 Five years as CEO: from pandemic overbuild to the AI boom 09:38 How much AI CapEx is too much? 15:44 Is the backlash against data centers fair? 20:56 AI demand as a barbell, and the capacity crunch 28:12 Annapurna Labs and Amazon’s custom chips 33:36 Why Amazon invested in Anthropic and OpenAI 37:14 Smaller teams, faster security: rebuilding orgs for AI 46:29 Rebuilding Alexa and reinventing existing products 53:06 Advice for an 18-year-old 56:36 How Amazon avoids spreading itself too thin Resources: Follow Andy Jassy on X: https://x.com/ajassy Follow Ben Horowitz on X: https://x.com/bhorowitz Stay Updated: If you enjoyed this episode, be sure to like, subscribe, and share with your friends! Find a16z on X: https://twitter.com/a16z Find a16z on LinkedIn: https://www.linkedin.com/company/a16z Listen to the a16z Show on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX Listen to the a16z Show on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711 Follow our host: https://x.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see http://a16z.com/disclosures.

Erik TorenberghostBen Horowitzhost
Oct 23, 20261h 0mWatch on YouTube ↗

CHAPTERS

  1. 0:00 – 0:52

    $220B AI buildout: demand is sold out through 2027 (and beyond)

    Jassy opens with the scale of Amazon’s AI infrastructure push and the reality that even record CapEx won’t satisfy demand. He frames data centers as foundational to modern life and explains why capacity planning is now the core constraint.

    • •Even with ~$220B CapEx, AWS is “leaving demand on the table”
    • •Forward capacity is effectively pre-allocated: 2026 sold out, 2027 largely sold out, 2028 partly sold out
    • •Data centers underpin finance, healthcare, commerce, and now AI workloads
    • •Big labs’ willingness to pay for compute/power highlights scarcity pressure
  2. 0:52 – 5:20

    Five years as CEO: pandemic overbuild, cost-to-serve pain, and regionalizing fulfillment

    Looking back to 2021, Jassy describes the operational hangover from hyper-scaling fulfillment and last-mile during the pandemic. He explains how the crisis forced a rethink that ultimately improved both speed and unit economics.

    • •Retail network doubled in ~18 months; last-mile built at UPS-scale in ~20 months
    • •Rapid build created inefficiencies and a “cost to serve” challenge
    • •Regionalizing a flat national network brought inventory closer to customers
    • •Shorter shipping distances reduced cost while increasing delivery speed and demand
  3. 5:20 – 9:35

    Operating through tension: leadership principles, trade-offs, and truth-telling metrics

    Ben Horowitz presses on how Amazon maintains high standards while moving fast. Jassy explains Amazon’s leadership principles as intentionally tensioned, and emphasizes metrics-driven transparency as the mechanism to correct course.

    • •Leadership principles are designed with real-world trade-offs (speed vs. standards)
    • •Pandemic-era choice: move fast for customers even if it requires later cleanup
    • •Remote/fragmented planning amplified execution friction
    • •Truth-telling culture + hard metrics surface issues early and enable re-architecture
  4. 9:35 – 13:16

    From early AWS signals to generative AI’s unprecedented growth curve

    Jassy compares AWS’s origins with today’s generative AI wave. He highlights how internal AWS demand validated cloud early, but generative AI adoption is growing hundreds of times faster than cloud did in its first years.

    • •AWS began as internal infrastructure acceleration; external growth exceeded expectations
    • •Earlier “AI waves” produced meaningful services but not today’s scale
    • •GenAI AWS AI run-rate: $25B within ~3 years vs. AWS ~$60M after 3 years originally
    • •Magnitude and speed of demand redefine investment decisions
  5. 13:16 – 15:44

    How much AI CapEx is too much? Understanding the AWS build-and-monetize cycle

    Jassy breaks down the mechanics behind massive CapEx numbers and why free cash flow faces near-term headwinds. He differentiates long-lead data center construction from shorter-lead server/network purchases to explain risk management.

    • •2026 CapEx guidance: ~$220B; scale is historically “mind-blowing”
    • •Two CapEx buckets: data centers (≈2 years lead, ≈30-year life) vs. servers/network (months lead, 5–6-year life)
    • •Visibility into demand reduces risk: you can delay server/network buys if utilization won’t materialize
    • •Rapid simultaneous builds pressure free cash flow before monetization catches up
  6. 15:44 – 21:04

    Data center backlash: myths, water/energy claims, and the national competitiveness argument

    Jassy responds to political resistance to data centers, arguing the U.S. must build infrastructure comparable to highways/bridges eras. He addresses common critiques (water, pollution, rates) and frames data centers as a public–private partnership issue.

    • •Digital economy already relies on data centers; AI amplifies need dramatically
    • •Infrastructure buildout compared to 1950s highways/bridges in scale and importance
    • •Rebuttals: golf/almond industries use far more water; generator “pollution” filings overstate real usage
    • •Grid underinvestment is the underlying driver of rate pressures; data centers also contribute major local tax revenue
  7. 21:04 – 23:12

    AI demand is a barbell: labs and breakout apps vs. enterprise productivity—plus the coming crunch

    Jassy describes current AI usage patterns and why the biggest wave is still ahead. He then explains why shortages extend beyond 2027 and how AWS balances scarce components across AI and ‘core’ workloads.

    • •One end: frontier labs + runaway apps consuming massive compute
    • •Other end: enterprises using AI for cost avoidance (customer service, fraud, automation)
    • •Middle (largest future segment): enterprise production apps not yet pervasively using inference
    • •Constraints aren’t just data centers—memory (HBM vs. DRAM) and other components create multi-year trade-offs
  8. 23:12 – 28:12

    Customer-first allocation under scarcity: why AWS won’t ‘squeeze the old guys’

    Facing extreme demand and willingness-to-pay from AI labs, Jassy insists AWS will protect long-term customer relationships. He cites pandemic-era cost-optimization help as precedent and focuses on expanding capacity rather than price gouging.

    • •Capacity is scarce, but both AI and non-AI (“core”) workloads are growing fast
    • •Explicit trade-offs in memory allocation: accelerators (HBM) vs. traditional compute (DRAM)
    • •Amazon’s stance: don’t squeeze core customers running mission-critical systems
    • •Strategy: build as much capacity as possible while keeping economics sustainable
  9. 28:12 – 31:59

    Annapurna Labs and vertical integration: from Nitro to Graviton to Trainium

    Jassy recounts why Amazon acquired Annapurna Labs and how custom silicon became a strategic advantage. The initial goal wasn’t AI chips but freeing server resources and improving price-performance, which later extended naturally into AI accelerators.

    • •Original motivation: offload virtualization/network/storage/security to the NIC (Nitro) to maximize customer compute
    • •Nitro ended up in essentially every EC2 server
    • •Graviton CPU: ~40% better price-performance; adopted broadly by top EC2 customers
    • •Trainium AI accelerator: ~30–40% better price-performance vs. comparable alternatives; aimed at reducing AI costs
  10. 31:59 – 33:56

    Why inference cost matters: unlocking the ‘middle of the barbell’ for enterprises

    Jassy argues the largest blocker to pervasive enterprise inference is economics. Lower inference cost reduces the required ROI threshold for rewriting CPU-based apps to use accelerators and makes AI-native features viable everywhere.

    • •Inference cost has fallen but remains ~an order of magnitude too high for broad adoption (in Jassy’s view)
    • •High accelerator cost raises the bar for enterprises to rewrite/modernize apps
    • •Cheaper inference enables more apps to become ‘smarter’ with AI by default
    • •Custom chips are positioned as a primary lever for cost reduction
  11. 33:56 – 37:14

    Investing in Anthropic and OpenAI: strategic partnerships, Bedrock distribution, and chips commitments

    Jassy explains why Amazon made large investments: team quality, long-term belief in AI, and deep technical/commercial partnerships. He emphasizes Bedrock as the distribution layer and highlights mutual learning on Trainium and agent infrastructure.

    • •Rationale: exceptional teams, transformative market, expectation of durable winners
    • •Anthropic: strong Bedrock usage + deep Trainium collaboration
    • •OpenAI: customer demand to run OpenAI on AWS; prior arrangements limited availability
    • •Joint work on agent-building primitives (stateful runtime) and multi-year compute commitments
  12. 37:14 – 46:29

    Rebuilding organizations for AI: smaller teams, faster prototyping, and agent-driven security

    The conversation shifts to how AI changes internal execution. Jassy describes dramatic productivity examples, predicts smaller cross-functional teams, and warns that cybersecurity response times must shrink from weeks to minutes via agentic systems.

    • •Bedrock rebuild anecdote: ~6 engineers in ~76 days vs. ~40 people for a year (historical baseline)
    • •AI pushes de-specialization: more ‘Renaissance’ builders and smaller teams
    • •Prediction: fewer humans doing today’s roles; new jobs emerge, but org shapes change materially
    • •Near-term AI risk focus: cybersecurity—agents will find vulnerabilities; systems must patch/deploy in minutes
  13. 46:29 – 53:06

    Reinventing Alexa (and everything else): beyond cost-cutting to full reimagination

    Jassy argues incumbents must rebuild products from scratch rather than make incremental improvements. Alexa is the clearest case—genAI changes the ‘brains’—but he claims every major Amazon consumer experience must be rethought to remain competitive.

    • •Three AI modes: cost-cutting, net-new inventions, and reinvention of existing products
    • •Alexa required rewiring due to generative AI’s step-change in capability
    • •Change management is hard: teams are attached to legacy architectures and learned constraints
    • •Amazon is reimagining retail, Prime Video, Fire TV, Music, etc., either as new experiences or rapid iterative integration
  14. 53:06 – 56:36

    Advice for an 18-year-old: use AI deeply—but keep critical thinking and judgment

    Jassy offers guidance for young people entering an AI-shaped world. He encourages active experimentation with AI tools while emphasizing that human reasoning, synthesis, and decision-making remain differentiators.

    • •Don’t fight AI adoption in education—learn and use it extensively
    • •Use AI to push beyond comfort zones (even non-developers can build apps)
    • •AI can accelerate preparation (reading/summarizing), but not replace synthesis and strategy
    • •Human judgment, experimentation, and connecting dots remain essential skills
  15. 56:36 – 1:00:38

    Avoiding ‘spread too thin’: decentralized single-thread leadership across AI, robotics, and space

    Closing out, Jassy explains Amazon’s portfolio logic: major era-defining waves (AI, robotics, space) and a customer-focused mission. He argues Amazon can pursue many bets in parallel through decentralized ownership and disciplined investment sizing.

    • •Amazon is operating within three major transformations: AI, robotics, and space
    • •Unifying thread: improving customer lives across many experiences
    • •Mechanism to scale breadth: decentralized ‘single-threaded’ teams with dedicated leaders
    • •Decision filters: differentiated idea, underserved space, potential to move the needle, and willingness to invest long-term

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.

iOSAndroidClaudeChromeChatGPTComing soon