Gavin Baker: Why AI Demand Is Outrunning Compute Supply
Gavin Baker: Why AI Demand Is Outrunning Compute Supply
Podcast1 hr 15 min
Listen to Episode
Note: AI-generated summary based on third-party content. Not financial advice. Read more.
Quick Insights

Accumulate pullbacks in NVIDIA (NVDA), as its 70% to 80% supply chain dominance and institutional credit backing solidify its market moat heading into its 2027–2028 compute rollout.

Allocate capital directly into the physical AI enablement layer—specifically copper, power producers, and US natural gas infrastructure—to profit from an acute, structural data center capacity shortage that will persist through at least 2028.

Seek private market or venture trust exposure to SpaceX and xAI to capture accelerated sub-one-year compute payback periods and entry into a $2 trillion global telecommunications market.

Monitor and target dedicated cloud providers like CoreWeave and Nebius, which are achieving rapid 9- to 10-month asset payback periods by servicing unmet high-density compute demand.

Build a foundational position in Alphabet (GOOGL) to capitalize on its proprietary TPU hardware ecosystem, which serves as the premier alternative institutional compute platform and continues to generate strong operational cash flow.

Detailed Analysis

NVIDIA (NVDA)

  • Market Dominance and Full-Stack Integration: NVIDIA holds a structural competitive moat by providing a comprehensive system architecture (nine distinct chips across accelerators, CPUs, networking switches, and DPUs) rather than just standalone graphics chips.
    • The company has secured an estimated 70% to 80% of global critical supply chain capacity, including fabrication capacity, DRAM, NAND memory, capacitors, and optics.
    • Custom ASICs (application-specific integrated circuits) from competitors only challenge narrow slices of NVIDIA's full-system ecosystem.
  • Financing and Low Cost of Capital: NVIDIA-based data centers have become standardized institutional assets, attracting low-cost private credit financing from firms like Blackstone, KKR, and Apollo.
    • Projects can be structured with as little as a 30% equity check, backed by residual value guarantees that carry minimal downside risk relative to the gross profit generated.
  • Open-Source AI as a Demand Driver: Contrary to bear arguments, open-source AI models are highly bullish for NVIDIA because lower end-user token margins stimulate higher overall compute and hardware demand.
  • Orbital Compute Collaboration: Partnering with SpaceX to co-design the Rubin rack architecture intended for space-based orbital data centers targeted for late 2027 or 2028.

Takeaways

  • View pullbacks in NVDA as accumulation opportunities, as deep supply chain lock-in and institutional credit support make its competitive moat resilient against competing custom chips.
  • Monitor execution around next-generation rack systems and orbital compute partnerships as long-term growth drivers beyond traditional terrestrial data centers.

SpaceX & xAI (Private)

  • Compute Monetization and ROI: xAI's rapid cluster buildouts are achieving rapid payback periods estimated well under one year (and potentially near six months on high-utilization or spot market pricing).
  • Rapid Adoption of Grok: Enterprise and developer token consumption for Grok and GrokBot is accelerating significantly, driving rapid annual recurring revenue (ARR) growth.
  • Orbital Data Center Thesis: Terrestrial data center development faces rising structural inflation on Earth (labor costs for specialized electricians, power constraints, and cooling).
    • Leveraging Starship reusability could lower launch costs below $1 billion per gigawatt, making space-based compute (powered by solar and cooled via space radiation) economically superior for swing inference capacity.
  • Large Addressable Market (TAM): Beyond compute, broadband and the upcoming Starlink Mobile direct-to-cell service address a global telecommunications market approaching $2 trillion.
  • Long-Term Frontier Upside: Radical long-term economic opportunities include Mars colonization infrastructure (utilizing humanoid Optimus robots) and asteroid mining for precious metals (such as Asteroid Psyche).

Takeaways

  • Seek indirect exposure to SpaceX via private market vehicles, secondary funds, or venture trusts, as it functions simultaneously as a telecommunications disruptor, compute platform, and aerospace monopoly.
  • Track Starship launch cadence and reusable landing milestones as the primary leading indicator for orbital data center viability.

Microsoft (MSFT)

  • Shift to the Enterprise Abstraction Layer: After struggling to build a proprietary frontier model, Microsoft is well-positioned to serve as the enterprise "intelligence abstraction layer" through Copilot and hybrid multi-model routing.
  • Ensemble Model Strategy: Large enterprises increasingly prefer deploying open-source base models fine-tuned on proprietary internal data, paired with a router that calls frontier models only when necessary.
  • Capex and Competitive Pressure: Microsoft previously decelerated some infrastructure spending, which created ground for rivals, but its enterprise distribution gives it strong positioning against competitors like Databricks, Salesforce, and Palantir.

Takeaways

  • Evaluate MSFT based on its ability to monetize software seat expansion and retain enterprise data context rather than pure proprietary model benchmarks.
  • Watch for execution in Copilot multi-model routing features to see if Microsoft can protect its position as the primary enterprise software interface.

Alphabet (GOOGL)

  • TPU Monetization Engine: Google continues to generate substantial operating cash flow by deploying and externally commercializing its custom TPU (Tensor Processing Unit) infrastructure.
  • Second-Most Financeable Compute Asset: TPUs represent the only major compute alternative to NVIDIA with meaningful institutional acceptance, though they require higher equity financing commitments and higher borrowing costs.
  • Long-Term Training Optionality: High ongoing cash flow allows Google to remain patient, scale external compute revenue, and fund multi-billion-dollar frontier training runs as open-source approaches frontier performance.

Takeaways

  • Consider GOOGL as a durable AI infrastructure and compute monetization play that benefits from internal hardware design even during shifting frontier model dynamics.

AI Data Center Infrastructure & Commodities

  • Structural Under-Supply Through 2028: The market is significantly underestimating future compute demand; rather than an AI bubble or overbuild, physical constraints are causing an acute structural shortage through at least 2028.
  • US Energy Cost Advantage: Low domestic natural gas prices ($2 to $3 in the US versus $20 to $25 in Europe and Asia) provide a massive cost advantage for US power generation and domestic data center development.
  • Physical Bottlenecks and Commodity Tailwinds:
    • Critical infrastructure bottlenecks include power availability, transformer/switchgear supply, cooling hardware, and skilled trade labor (electricians and HVAC technicians).
    • Raw materials, especially Copper, face sustained industrial demand from the expansion of data center grids.
  • Neocloud Economics: Dedicated GPU cloud providers (such as CoreWeave and Nebius) are achieving rapid asset payback periods of 9 to 10 months on data center buildouts due to upfront customer commitments and high spot-market pricing.

Takeaways

  • Allocate capital toward the physical enablement layer of AI: power producers, natural gas infrastructure, electrical component suppliers, and copper producers.
  • Monitor public and private specialized cloud providers ("neoclouds") trading at reasonable valuations relative to their net property, plant, and equipment (PP&E) and cash generation.

Frontier AI Labs (OpenAI / Anthropic - Private)

  • Cash Flow Dynamics: Leading labs are generating substantial operating cash flow but will likely show minimal near-term free cash flow because they immediately reinvest profits into compute, research, and training runs.
  • Model Monetization Rates: Leading labs are monetizing compute capacity at high rates (estimated around $100 billion per gigawatt equivalent).
  • Public Market Preparedness: As these companies eventually head toward IPOs, public markets will need to adapt to revenue trade-offs where capacity is dynamically shifted between monetized inference and internal training.

Takeaways

  • Anticipate significant market interest upon eventual IPOs, but evaluate these businesses on operating cash flow and compute efficiency rather than traditional near-term free cash flow multiples.
Ask about this postAnswers are grounded in this post's content.
Episode Description
a16z’s David George sits down with Gavin Baker to unpack the state of the AI boom, why demand for intelligence may still be dramatically underestimated, and why the outcome doesn't necessarily have to be winner-take-all. David and Gavin explore the possibility that frontier labs, open-source models, applications, clouds, and NVIDIA can all capture significant value as AI adoption expands. They dig into the economics of the infrastructure buildout, why compute investments can have unusually fast payback periods, and what happens when today's relatively small group of heavy AI users expands to hundreds of millions of people. They also debate the risk of an AI bubble versus an AI shortage, the backlash against data centers, orbital compute, the rise of multi-model architectures, and NVIDIA's position at the center of the AI supply chain. Gavin makes the case that the AI buildout could help reindustrialize America, while David explores whether the bigger near-term risk is not overbuilding, but failing to build enough.   Resources: Follow Gavin Baker on X: https://x.com/GavinSBaker Follow David George on X: https://x.com/DavidGeorge83 Stay Updated: Find a16z on YouTube: YouTube Find a16z on X Find a16z on LinkedIn Listen to the a16z Show on Spotify Listen to the a16z Show on Apple Podcasts Follow our host: https://twitter.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
About The a16z Show
The a16z Show

The a16z Show

By Andreessen Horowitz

The a16z Podcast discusses tech and culture trends, news, and the future – especially as ‘software eats the world’. It features industry experts, business leaders, and other interesting thinkers and voices from around the world. This podcast is produced by Andreessen Horowitz (aka “a16z”), a Silicon Valley-based venture capital firm. Multiple episodes are released every week; visit a16z.com for more details and to sign up for our newsletters and other content as well!