Building the Cloud for an Agentic World | AWS CEO Matt Garman
Building the Cloud for an Agentic World | AWS CEO Matt Garman
Podcast56 min 17 sec
Listen to Episode
Note: AI-generated summary based on third-party content. Not financial advice. Read more.
Quick Insights
  • AWS demand is accelerating, with revenue around $169–170 billion, up 37%, and strong AI workload growth; monitor whether that growth generates returns on Amazon’s planned $220 billion 2026 spend before treating it as a buy signal.
  • NVIDIA (NVDA) has a demand tailwind from Amazon’s plan to purchase 2 million GPUs over the next couple of years, though chip, power, and data-center constraints could delay deployment.
  • Track data-center power and infrastructure as a research theme: access to electricity, construction capacity, and specialized equipment may determine how quickly AI demand becomes revenue.
Detailed Analysis

Amazon.com (AMZN) / Amazon Web Services (AWS)

  • AWS CEO Matt Garman described strong demand from AI workloads and continued migration of on-premises computing to the cloud. AWS revenue was cited at about $169–170 billion, growing 37%.
  • Amazon plans to spend $220 billion in 2026 and does not expect to slow its investment pace soon. The buildout is intended to meet demand for cloud and AI infrastructure.
  • Amazon is trying to reserve computing capacity for startups as well as large AI labs and enterprise customers. The company said it eventually fulfills about 60% of GPU requests, sometimes with a delay, in a different region, or with a different configuration.
  • AWS is investing in its own chips, including Graviton for general computing and Trainium for AI. Garman said Graviton offers about 20% lower cost and 20% better performance than alternatives, and that most of AWS’s top 100 customers use it. Trainium is used for both AI inference and training; AWS’s Trainium 3 capacity was described as effectively sold out well into the following year.
  • AWS’s Bedrock service emphasizes keeping customers’ data within their own environment. Garman said the service is growing as companies move AI projects from proofs of concept into production.
  • The company is also building services for AI agents, including tools for agent permissions, sandboxes, and security. Garman sees agents as a source of new cloud demand, while noting that enterprises are still working through safety and reliability concerns.

Takeaways

  • The discussion is bullish on AWS demand and investment opportunities in cloud infrastructure, but it is not a recommendation to buy AMZN shares.
  • For investors evaluating Amazon, monitor whether cloud growth and AI-related usage translate into returns that justify the exceptionally large capital spending.
  • Capacity is constrained by factors including power, memory, chips, networking components, and data-center construction. These bottlenecks could affect how quickly AWS can turn spending into usable capacity.
  • Garman argued that diversified customers and production workloads reduce the risk of overreliance on a single AI customer. Still, the transcript acknowledges that some startups will fail and that large infrastructure investments carry uncertainty.

NVIDIA (NVDA)

  • Amazon said it plans to buy 2 million NVIDIA GPUs over the next couple of years as part of its infrastructure expansion.
  • NVIDIA GPUs are among the scarce resources sought by frontier AI labs, large enterprises, and startups. AWS is expanding supply but said demand remains greater than available capacity.

Takeaways

  • The transcript points to continued demand for NVIDIA GPUs from cloud providers and AI companies, but offers no price target or specific recommendation for NVDA.
  • Investors can watch GPU availability and the broader supply chain—including memory, power, and data-center construction—as factors that may shape how quickly AI infrastructure demand becomes deployed capacity.

Trainium and Graviton (Amazon custom silicon)

  • These are AWS-designed chips rather than separately traded securities. Graviton is used for general-purpose cloud computing; Trainium supports AI workloads.
  • Garman presented Graviton as a cost-and-performance advantage for AWS customers and said Trainium powers much of the inference traffic on Bedrock. AWS is also working with large AI labs and startups on Trainium-based systems.

Takeaways

  • AWS’s custom silicon is a potential cost-efficiency and differentiation lever for Amazon: broader adoption could help it serve workloads without relying entirely on outside chip suppliers.
  • The transcript also indicates strong demand and limited Trainium capacity. Watch whether AWS can expand supply and whether customers continue adopting the chips in production.

AI companies and cloud customers

  • Anthropic and OpenAI were described as major AWS customers and partners; Amazon is working with them on Trainium. These companies are private, so the transcript does not identify a directly investable stock ticker for either.
  • Meta (META) was named among large customers with substantial AI compute needs.
  • Salesforce (CRM) and JPMorgan Chase (JPM) were cited as large enterprise customers with demand for cloud and AI computing.

Takeaways

  • The examples suggest AI infrastructure demand is coming from both frontier labs and established enterprises—not just startups.
  • The discussion gives no company-specific valuation, price target, or stock recommendation for Meta, Salesforce, or JPMorgan. Their mentions are evidence of AWS’s customer mix, not a standalone investment thesis.

Data centers, power, and renewable energy

  • Garman said data-center expansion depends on access to power, land, construction capacity, and specialized equipment. Amazon is planning years ahead for power and component needs and sometimes funds renewable-energy projects, including solar and nuclear projects.
  • He also noted public concern about data centers and said the industry needs to communicate more clearly about community benefits and environmental practices.

Takeaways

  • The transcript highlights a broader investment theme in data-center infrastructure and power supply, including renewable generation and the equipment needed to connect and operate facilities.
  • These are opportunities to research further, not named stock recommendations. The key constraint may shift over time—from power to memory, chips, or another supply-chain component—and can vary by region.
Ask about this postAnswers are grounded in this post's content.
Episode Description
a16z’s Raghu Raghuram sits down with AWS CEO Matt Garman to discuss how AI is reshaping the cloud, from the needs of AI-native startups to infrastructure increasingly designed for agents. Matt explains how AWS is adapting as agents write code and manage infrastructure, why it’s reserving scarce GPU capacity for startups, and where custom chips like Trainium and Graviton fit into the AI stack. They also discuss Amazon's $220 billion capital investment, the shifting bottlenecks in the infrastructure buildout, what enterprises need to trust autonomous agents, and how AWS's own teams are building with agents. Resources: Follow Matt Garman on X:  https://x.com/mattsgarman  Follow Matt Garman on LinkedIn: https://www.linkedin.com/in/mattgarman Follow Raghu Raghuram on X: https://x.com/RaghuRaghuram Learn more about AWS: https://aws.amazon.com/ Stay Updated: Find a16z on YouTube: YouTube Find a16z on X Find a16z on LinkedIn Listen to the a16z Show on Spotify Listen to the a16z Show on Apple Podcasts Follow our host: https://twitter.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
About The a16z Show
The a16z Show

The a16z Show

By Andreessen Horowitz

The a16z Podcast discusses tech and culture trends, news, and the future – especially as ‘software eats the world’. It features industry experts, business leaders, and other interesting thinkers and voices from around the world. This podcast is produced by Andreessen Horowitz (aka “a16z”), a Silicon Valley-based venture capital firm. Multiple episodes are released every week; visit a16z.com for more details and to sign up for our newsletters and other content as well!