Chips, Memory, and Power | Pat Gelsinger
Chips, Memory, and Power | Pat Gelsinger
Podcast54 min 15 sec
Listen to Episode
Note: AI-generated summary based on third-party content. Not financial advice. Read more.
Quick Insights
  • Treat AI accelerator startups as high-risk: favor companies with proven customer demand, software support, funding, and a credible path to manufacturing and deployment; the discussion offered no specific stock picks.
  • Consider optical networking a longer-term AI infrastructure theme, with broader in-package adoption projected for 2028–2029, subject to supply, reliability, and integration challenges.
  • Track data-center power and cooling as potential bottlenecks and investment themes, including nuclear power, grid equipment, power conversion, and liquid cooling; prioritize firms able to deliver at scale.
  • Don’t interpret the discussion as a buy or sell call on NVIDIA (NVDA), Intel (INTC), or Oracle (ORCL); it provided no stock recommendations or price targets.
Detailed Analysis

AI Accelerator Chips and Startups

  • The speakers described roughly 100 AI inference-accelerator chip efforts, with designs targeting different workloads and trade-offs.
  • Pat Gelsinger expects the field to narrow over time. He argued that shifting AI workloads, high costs to build and deploy chips at scale, and the need to secure customers and software support will make it difficult for every specialist to succeed.
  • He also expects major buyers and platform companies to help select winners, while some specialized designs may be absorbed or hidden within broader platforms.
  • Chip design may be getting faster with AI tools, but manufacturing, packaging, rack integration, and financing remain slow and expensive. Gelsinger estimated that a design might take three months, followed by about nine months before it can be used at scale; elsewhere he described the full path as taking as long as a year and a half.
  • Graphcore was cited as an example of a chip design that was overtaken as the market moved on.

Takeaways

  • Treat the proliferation of AI-chip startups as a high-risk, competitive theme—not evidence that all, or even most, designs will become viable businesses.
  • When assessing a chip company, look beyond its architecture to customer traction, software support, access to capital, manufacturing and packaging timelines, and the cost of deploying it at scale.
  • The discussion offered no specific stock picks or valuations in this area.

NVIDIA (NVDA)

  • NVIDIA was discussed as a major AI-platform company likely to have influence over which specialized chip designs gain adoption.
  • Gelsinger said large companies such as NVIDIA may incorporate specialized architectures into broader platforms, making the underlying differences less visible to customers.
  • The speakers also discussed the shift from copper toward optical connectivity for large AI systems. Gelsinger said NVIDIA had indicated a move in that direction, and he expects optical approaches to become important for scaling large clusters.

Takeaways

  • NVIDIA’s potential advantage, as framed in the discussion, extends beyond chips to its ability to combine hardware, software, networking, and scale.
  • The transcript does not provide a valuation, price target, or explicit buy or sell recommendation.

Intel (INTC)

  • Intel was discussed mainly through Gelsinger’s career and the history of chip design, including his work on the 386 and 486.
  • The conversation highlighted how chip designers once had to create their own design languages, compilers, and automated placement and routing tools.
  • The speakers discussed AI as a possible new phase in chip design, but did not make a specific assessment of Intel’s current products, financial outlook, or stock.

Takeaways

  • The historical discussion illustrates how new design tools can reshape the semiconductor industry, but it is not a current investment thesis for Intel.
  • No price target or stock recommendation was mentioned.

Memory and High-Bandwidth Memory (HBM)

  • Gelsinger called HBM a poor solution in several respects, while acknowledging it is currently the best option available for many AI workloads.
  • He described AI as a memory-intensive workload and identified memory bandwidth, heat, power use, and the limits of current memory designs as important constraints.
  • He believes new memory approaches may finally be close to a breakthrough after decades without a major new memory type. Areas of research he mentioned include ferroelectric materials, denser memory, and memory that can be stacked near compute.
  • He was skeptical of using flash or MRAM as a general high-performance solution, and argued against relying on optical links between compute and large, distant memory pools because of conversion losses and power use.
  • He expects more modest memory stacks—roughly two to four layers in many cases—rather than extremely tall stacks, citing manufacturing complexity and yield challenges.
  • D-Matrix and Cerebras were mentioned in the context of bringing memory and compute closer together. Gelsinger also said he had funded a new, unnamed memory company that was still in stealth.

Takeaways

  • Memory innovation is a potentially important investment theme because it addresses a stated bottleneck in AI infrastructure, but the discussion emphasized that technical promise does not guarantee manufacturability or commercial success.
  • For companies in this area, consider whether their approach can deliver useful bandwidth, density, power efficiency, yield, and cost at scale.
  • Treat the unnamed company and any specific private-company references as discussion points, not public investment recommendations.

Optical Networking and AI Cluster Connectivity

  • Gelsinger expects optical technology to replace more copper-based input/output connections as AI clusters grow. He said copper becomes difficult and costly over longer distances, while optical components face their own supply-chain, thermal, and package-integration challenges.
  • He identified 2028–2029 as a possible timeframe for broader adoption of in-package optical approaches, including NPO or CPO. This was his expectation, not a guaranteed timeline.
  • The discussion also suggested that AI workloads often involve large, relatively predictable data flows, potentially making optical switching more suitable than conventional packet-network approaches in some settings.
  • Gelsinger cautioned that the optical supply chain has not yet been tested at the scale required for very large GPU deployments.

Takeaways

  • Optical connectivity is a longer-term infrastructure opportunity tied to the need to connect increasingly large AI clusters.
  • The key considerations are whether suppliers can scale production, manage heat and package integration, and deliver the required reliability and economics.
  • The 2028–2029 timeframe is a forecast from the discussion, not a firm adoption date.

Data-Center Power, Energy, and Cooling

  • Gelsinger argued that energy capacity equals economic capacity in an AI-driven economy, and that limited electricity could constrain data-center and GPU expansion.
  • He warned that some data-center projects could default if power is unavailable, and cited an Oracle-related project as an early indication of this risk. The transcript does not provide details sufficient to assess that specific project.
  • He described several constraints: slow additions to energy capacity, long lead times for gas turbines, and supply-chain dependence on China for some renewable-energy equipment.
  • He favored expanding nuclear power as a source of baseload electricity and also highlighted power delivery, conversion, and cooling as areas needing innovation.
  • Specific technologies and companies mentioned included 800-volt DC data centers, solid-state transformers, Vertical GaN, turbines, refrigerants, and liquid cooling.
  • Gelsinger also cited Snowcat, a superconducting company, as pursuing a technology he said could potentially improve power performance substantially. That claim was presented as his view, not independently substantiated in the conversation.

Takeaways

  • Power availability is a material risk to AI infrastructure growth: a data center or chip deployment may be delayed or uneconomic if electricity and cooling cannot be secured.
  • The discussion points to possible opportunities in nuclear power, grid and power-conversion equipment, and data-center cooling, but these areas face substantial execution and supply-chain challenges.
  • Investors evaluating AI infrastructure should consider power access and cooling capacity alongside GPU demand and announced data-center spending.

Oracle (ORCL) and Data-Center Project Risk

  • Oracle was mentioned in connection with a project that Gelsinger described as an early sign of potential data-center financing or power-related difficulties.
  • His broader warning was that projects may face defaults if developers commit to data centers, racks, and GPU purchases without securing enough electricity.
  • The transcript does not identify the project clearly enough to establish its status or quantify any financial exposure.

Takeaways

  • The discussion raises a risk for companies and investors exposed to data-center construction: announced demand does not ensure that projects can obtain power or reach operation.
  • The podcast did not make a specific judgment on Oracle’s overall business or its stock.

VMware and Virtualization for AI Agents

  • Gelsinger argued that virtualization and infrastructure-management tools may need to be rebuilt for a world in which AI agents, rather than people, are the primary users.
  • Potential needs he identified included agent security and policies, performance management, abstraction, migration, and human-facing dashboards and controls.
  • He described this as an opportunity for new companies, but did not name a specific investment target or make a recommendation on VMware.

Takeaways

  • Agent infrastructure and management is a potential software theme, particularly tools that help organizations secure, coordinate, and monitor fleets of AI agents.
  • The opportunity remains conceptual in the discussion; commercial demand and winning products were not established.

AI-Driven Chip Design

  • Gelsinger said AI tools could make parts of chip design faster, including logic design and software-related tasks, while some analog work still depends heavily on silicon data and expert judgment.
  • He cautioned that faster design does not eliminate the longer bottlenecks: fabrication, advanced packaging, validation, rack integration, memory, and power.
  • The discussion did not identify a specific publicly traded AI chip-design software company as an investment pick.

Takeaways

  • AI-assisted design may improve productivity, but the investment case should account for the full path from design to usable hardware.
  • A faster design cycle alone may not create a durable advantage if manufacturing and deployment timelines remain long.
Ask about this postAnswers are grounded in this post's content.
Episode Description
a16z's Raghu Raghuram and Guido Appenzeller sit down with Playground Global General Partner and former Intel CEO Pat Gelsinger to discuss the next wave of semiconductor innovation and the physical constraints shaping the AI buildout. Drawing on his experience designing Intel's 386 and 486 processors, Pat explains how AI could transform chip design, but also why faster design alone won't solve the industry's biggest problems. They examine the bottlenecks in manufacturing, memory bandwidth, advanced packaging, and power, and why today's explosion of specialized AI chips may eventually consolidate around a smaller number of architectures. They also discuss the potential for new memory technologies, the shift from copper to optical networking, and why energy capacity could become a major constraint on AI growth. Finally, they revisit Pat's VMware years to ask what virtualization might look like when infrastructure is built for agents rather than humans. Resources: Follow Pat Gelsinger on X:  https://x.com/PGelsinger Follow Raghu Raghuram on X: https://x.com/RaghuRaghuram Follow Guido Appenzeller: https://x.com/appenz Stay Updated: Find a16z on YouTube: YouTube Find a16z on X Find a16z on LinkedIn Listen to the a16z Show on Spotify Listen to the a16z Show on Apple Podcasts Follow our host: https://twitter.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
About The a16z Show
The a16z Show

The a16z Show

By Andreessen Horowitz

The a16z Podcast discusses tech and culture trends, news, and the future – especially as ‘software eats the world’. It features industry experts, business leaders, and other interesting thinkers and voices from around the world. This podcast is produced by Andreessen Horowitz (aka “a16z”), a Silicon Valley-based venture capital firm. Multiple episodes are released every week; visit a16z.com for more details and to sign up for our newsletters and other content as well!