What the Internet Boom Teaches Us About the AI Buildout | Mike Volpi
What the Internet Boom Teaches Us About the AI Buildout | Mike Volpi
Podcast56 min 50 sec
Listen to Episode
Note: AI-generated summary based on third-party content. Not financial advice. Read more.
Quick Insights

NVIDIA (NVDA) remains the clearest near-term AI infrastructure play, benefiting from constrained chip supply and strong demand, but account for a possible correction among financially weak cloud providers and a reshuffling of asset ownership. For a broader, longer-term theme, consider ASML (ASML) and TSMC (TSM) as exposure to semiconductor capacity and advanced packaging constraints that may persist for years; the discussion provides no price targets. Prioritize companies with durable balance sheets: AI infrastructure may remain useful even if leveraged builders or neoclouds struggle, so asset growth alone is not a reason to invest.

Detailed Analysis

NVIDIA (NVDA)

  • NVIDIA was described as the central player in today’s AI infrastructure market: demand for AI capacity is extremely high, while supply is constrained. The guest said that, for now, “we all just live in Jensen’s world.”
  • The guest expects the infrastructure being built to remain useful and potentially be fully utilized. But he cautioned that the companies that own the assets today may not be the ones that own them later; an economic correction could reshuffle ownership.
  • Chip supply and fab capacity were identified as major constraints that may persist for years. The guest also said the AI industry could face a correction, particularly among some newer cloud providers with weak balance sheets.
  • NVIDIA’s acquisitions were viewed as a reasonable place to take risks: some may fail, while a standout success like Mellanox could create significant value. The guest also noted that financing the industry may help NVIDIA broaden its customer base, though the long-term industry could still consolidate around a few large providers.
  • The guest argued that AI infrastructure should increasingly be considered as an integrated system—chips, memory, networking, and racks—rather than as interchangeable components.

Takeaways

  • NVIDIA has strong near-term exposure to constrained AI capacity, but the discussion does not imply that today’s ownership structure or high demand will persist unchanged.
  • When assessing the business, consider both the supply bottleneck and the possibility of a correction among customers or infrastructure providers. The transcript gives no price target or specific stock recommendation.

Cisco (CSCO)

  • Cisco’s late-1990s experience was presented as a cautionary parallel for today’s infrastructure build-out. During the internet boom, customers placed more orders than they ultimately needed, while Cisco committed to supply-chain purchases based on demand expectations.
  • When demand weakened, customers sharply reduced or canceled orders. Cisco missed a quarter by roughly 35%–40%, and its stock fell from the low-$80s to about $9 over roughly six months, according to the guest.
  • The guest said Cisco’s acquisition strategy worked through a repeatable process and a willingness to accept failures: some acquisitions did not work, while others became major product lines. He cited an acquisition bought for $500 million that was earning $1 billion two years later.
  • Cisco’s ability to integrate networking acquisitions was helped by open standards that let products work together relatively easily.

Takeaways

  • The historical lesson is to distinguish durable demand from over-ordering. A sudden drop in orders can hit both revenue and companies that have taken on supply-chain commitments.
  • Cisco’s acquisition story illustrates the potential value—and execution demands—of disciplined, repeatable M&A. The transcript discusses historical results, not a current recommendation on the stock.

Alphabet (Google) (GOOGL)

  • Google’s TPU architecture was described by the guest as a strong example of designing AI infrastructure as a complete system.
  • TPUs are currently mostly sold by Google, and the discussion noted that there are not enough of them to meet demand.
  • The guest suggested that model designs are becoming more diverse, which could support a wider range of chip architectures rather than a single universal design.

Takeaways

  • Google’s in-house chips and integrated infrastructure could be strategically valuable, but the transcript provides no financial valuation or stock-specific recommendation.
  • The investment theme is system-level optimization: chips, models, memory, and networking may be more competitive when designed together.

Advanced Micro Devices (AMD)

  • AMD was mentioned as a potential future participant in shipping complete rack-scale AI systems, alongside NVIDIA and Google.
  • The discussion did not provide a timeline, specific product assessment, or forecast for AMD’s competitive position.

Takeaways

  • AMD is a possible beneficiary if the market broadens beyond today’s dominant AI infrastructure providers, but the transcript offers no specific evidence or recommendation to support a near-term investment view.

Broadcom (AVGO)

  • Broadcom’s Tomahawk switching architecture was discussed as an example of conventional packet-switching technology used in data centers.
  • The guest argued that AI data-center traffic is often more predictable and consistently heavy than traditional internet traffic. He suggested that future AI networks may use architectures better suited to that workload, potentially with simpler and cheaper switches.
  • He framed this as an opportunity for new entrants, while noting that adopting a new architecture would require the broader system—including GPU vendors and buyers—to change.

Takeaways

  • The discussion raises a potential technology-transition risk for established networking approaches, but it does not say Broadcom will lose share or identify a specific replacement.
  • Watch whether AI networking shifts toward architectures designed for predictable, high-utilization traffic; the transcript suggests that the transition depends on adoption across the whole system.

ASML (ASML)

  • ASML was mentioned in the context of the semiconductor manufacturing chain: the guest described advanced chip production as dependent on specialized equipment and said additional fab capacity is unlikely to appear quickly.
  • Silicon manufacturing was identified as a key constraint on AI infrastructure supply, potentially lasting several years.

Takeaways

  • The investment theme is the semiconductor equipment and manufacturing bottleneck behind AI compute growth.
  • The transcript does not quantify how much ASML could benefit or provide a stock recommendation.

Taiwan Semiconductor Manufacturing Company (TSMC) (TSM)

  • TSMC was discussed in relation to advanced chip packaging, including the manufacturing challenges of combining logic and memory in the same package.
  • The guest highlighted heat and manufacturability as important complications for more advanced chip designs.

Takeaways

  • Advanced packaging could become increasingly important as AI chips seek higher memory bandwidth and tighter integration.
  • The transcript identifies technical complexity as a challenge but does not assess TSMC’s financial outlook or make a stock recommendation.

Cerebras (Private)

  • The guest said his fund is an investor in Cerebras. The company was described as having designed a large chip intended to deliver high speed when a model fits in on-chip SRAM.
  • A limitation raised in the discussion is that performance may suffer when a model has to go off-chip for memory. The guest noted that OpenAI had to do work to make a large model fit on the Cerebras chip.

Takeaways

  • Cerebras represents a specialized AI-chip approach, but the discussion highlights a key consideration: how much of the model can fit in fast on-chip memory.
  • Cerebras is private, so it is not a publicly traded stock. The transcript does not provide a valuation or investment terms.

Anthropic, OpenAI, and AI Model Providers (Private)

  • Anthropic and OpenAI were cited as examples of AI providers experiencing revenue growth faster than internet businesses did during the late-1990s build-out, in the guest’s view.
  • Open-source model infrastructure providers Fireworks, Together, and Modal were also mentioned as seeing rapid growth, though not necessarily at the same margins as the largest providers.

Takeaways

  • The discussion supports the broader theme that AI infrastructure demand has real, rapidly growing applications—not just speculative expectations.
  • These companies are private, and the transcript gives no valuation, specific recommendation, or comparison of their long-term profitability.

AI Infrastructure: GPUs, Data Centers, and Cloud Providers

  • The guest’s overall view was optimistic about the usefulness of AI infrastructure: he expects it to remain valuable and believes it may be fully utilized or more.
  • He also expects an economic correction and industry reshuffling. Some infrastructure assets may remain useful even if their original owners fail or sell them, as happened with fiber assets during the internet build-out.
  • GPU useful life may be longer than initially expected while supply remains scarce. However, newer chips can produce more revenue per watt, which could make older chips less attractive if supply becomes abundant.
  • The discussion identified weak balance sheets among some neoclouds as a specific concern and noted that debt-financed infrastructure owners could be vulnerable if demand or financing conditions change.
  • A key distinction from the 1990s is that today’s infrastructure build-out relies more on capital markets, while the earlier build-out involved more equipment-vendor balance-sheet financing, according to the guest.

Takeaways

  • Consider AI infrastructure as a long-term asset theme, but separate the usefulness of the assets from the financial durability of their owners.
  • For infrastructure businesses, pay attention to customer demand, financing, chip supply, and whether newer hardware makes older equipment less efficient.
  • The transcript expresses optimism about the long-run opportunity, not a guarantee that every builder or cloud provider will survive.

AI Networking and Optical Interconnects

  • The guest argued that AI workloads may need networking designed for high, relatively predictable utilization, rather than systems built primarily for variable internet traffic.
  • He suggested that future data-center networks could use circuit-based, time-based, or other non-stochastic approaches, potentially making some switching functions simpler and cheaper.
  • Optical links were described as important for some rack-scale and data-center connections, but the guest cautioned that optics can be sensitive to heat. He preferred copper where it can meet the requirements.

Takeaways

  • AI networking is a potential area for new products and companies, particularly if a new architecture can deliver more efficient communication between chips and racks.
  • This is an early-stage infrastructure theme, not a specific stock recommendation. The guest emphasized that a new switch architecture would need support from the wider system and its buyers.

AI Chips, Memory, and Advanced Packaging

  • The discussion linked chip architecture to the increasing diversity of AI models. Different model designs and tasks may favor different chips.
  • Reasoning-intensive workloads were said to increase the importance of memory bandwidth, including the movement of data between chips and memory.
  • The guest expressed interest in 3D memory architectures and hybrid copper bonding, while noting that packaging and thermal management are difficult challenges.

Takeaways

  • The potential opportunity extends beyond GPU manufacturers to memory, advanced packaging, and other technologies that improve performance per watt or memory bandwidth.
  • The transcript identifies technical promise alongside manufacturing and heat-related challenges; it gives no specific stock targets or timelines.
Ask about this postAnswers are grounded in this post's content.
Episode Description
The internet boom built bandwidth. The AI boom is building intelligence. Mike Volpi, who helped shape Cisco’s strategy during the internet buildout, asks what that era can teach us about this one. Mike joins a16z’s Raghu Raghuram and Guido Appenzeller to compare today’s investment in GPUs, data centers, and power with the fiber boom of the late 1990s, and explain why the infrastructure could prove valuable even if the market corrects. They also discuss NVIDIA, custom silicon, networking, and the changing economics of GPUs, plus lessons from Cisco’s acquisition machine. And Mike explains why he thinks this technology cycle could be even more consequential than the last. Resources: Follow Mike Volpi on X: https://x.com/mavolpi Follow Raghu Raghuram on X: https://x.com/RaghuRaghuram Follow Guido Appenzeller on X: https://x.com/appenz Stay Updated: Find a16z on YouTube: YouTube Find a16z on X Find a16z on LinkedIn Listen to the a16z Show on Spotify Listen to the a16z Show on Apple Podcasts Follow our host: https://twitter.com/eriktorenberg Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
About The a16z Show
The a16z Show

The a16z Show

By Andreessen Horowitz

The a16z Podcast discusses tech and culture trends, news, and the future – especially as ‘software eats the world’. It features industry experts, business leaders, and other interesting thinkers and voices from around the world. This podcast is produced by Andreessen Horowitz (aka “a16z”), a Silicon Valley-based venture capital firm. Multiple episodes are released every week; visit a16z.com for more details and to sign up for our newsletters and other content as well!