The 80-Year Bet: Why Naveen Rao Is Rebuilding the Computer from Scratch
The 80-Year Bet: Why Naveen Rao Is Rebuilding the Computer from Scratch
Podcast30 min 11 sec
Listen to Episode
Note: AI-generated summary based on third-party content. Not financial advice. Read more.
Quick Insights

Consider TSMC (TSM) as a core "picks and shovels" investment, as it is positioned to manufacture chips for both current AI leaders and future innovators. The massive energy demand from AI also creates a critical investment theme in related infrastructure. Look for opportunities in Power Generation and Grid Modernization companies that are essential to support the industry's explosive growth. While NVIDIA (NVDA) currently dominates, its long-term position faces risks from the high energy consumption of its hardware. As an alternative, Google (GOOGL) is a strong, vertically integrated competitor developing its own custom AI chips to control costs and reliance on others.

Detailed Analysis

NVIDIA (NVDA)

  • NVIDIA is described as the dominant incumbent in the AI hardware space, having built the GPU-based platform that "everyone programs on today."
  • The discussion frames new approaches, like analog computing, as an attempt to build a "better substrate than Matrix Multiply," which is the core mathematical operation that NVIDIA's GPUs are optimized for.
  • The podcast questions whether a new company like Unconventional AI will be "at odds with NVIDIA going forward," suggesting a potential long-term competitive dynamic.

Takeaways

  • NVIDIA's current market leadership is tied to the prevailing digital computing paradigm for AI.
  • A significant long-term risk to NVIDIA's dominance is the energy consumption problem associated with scaling current GPU-based data centers. The transcript highlights this as a fundamental bottleneck for the AI industry.
  • Investors should monitor the development of alternative computing architectures (like analog computing). While this is a very long-term threat (5-10+ years), a breakthrough in energy efficiency could disrupt the current market structure where NVIDIA is the leader.

Taiwan Semiconductor Manufacturing Company (TSMC)

  • TSMC is explicitly identified as a key partner for future chip innovation. The founder of Unconventional AI states, "TSMC is absolutely going to be a partner."
  • This highlights TSMC's role as the essential manufacturer (foundry) that enables chip design companies to bring their products to life, regardless of the underlying technology (digital or analog).

Takeaways

  • TSMC is presented as a classic "picks and shovels" investment in the semiconductor and AI revolution.
  • The company is positioned to benefit whether current leaders like NVIDIA continue to dominate or if new disruptors with different architectures emerge, as TSMC will likely be the manufacturer for all of them.
  • This suggests that investing in TSMC is a way to gain exposure to the growth of the entire semiconductor industry, potentially with less risk than betting on a single chip designer.

Google (GOOGL)

  • Google is described as a highly self-sufficient player in the AI space, noting that it "has everything internally" and is pursuing "continual improvements for their hardware" with its custom TPUs (Tensor Processing Units).
  • Their strategy is characterized as "lower risk" and focused on improving margins for their own massive AI workloads.

Takeaways

  • Google is a major, vertically integrated competitor in AI hardware. By developing its own custom chips, it reduces its reliance on third-party vendors like NVIDIA.
  • This internal capability gives Google a potential long-term advantage in cost and performance for its own services (Search, Cloud, etc.).
  • For investors, this reinforces that the AI hardware market is not a monopoly. Google's significant, ongoing investment in TPUs makes it a formidable force that competes for both talent and technological leadership.

Investment Theme: AI & Energy Infrastructure

  • The central problem discussed in the podcast is the unsustainable energy demand of AI. The current digital approach is creating a massive energy bottleneck.
  • Key statistics mentioned:
    • AI data centers already consume 4% of the entire U.S. power grid.
    • An estimated 400 additional gigawatts of power capacity are needed over the next decade just to meet AI demand.
    • The current U.S. transmission grid, described as a "1970s-era" system, will likely "melt under the load."

Takeaways

  • The continued growth of the AI industry is fundamentally dependent on solving this energy crisis. This is a critical risk factor for the entire sector.
  • This challenge creates a massive investment opportunity in the infrastructure required to power the AI revolution. This is a "second-order" investment thesis that benefits from the AI boom.
  • Potential investment areas highlighted by the discussion include:
    • Power Generation: Companies involved in building new power capacity, including traditional utilities and developers of nuclear, solar, and other energy sources.
    • Grid Modernization: Companies that manufacture components for and help upgrade the electrical grid, such as transformers, high-voltage lines, and smart grid technology.
    • Energy Efficiency: While the company discussed (Unconventional AI) is private, the theme points to high future valuations for any company—hardware or software—that can drastically reduce the energy cost of computation.
Ask about this postAnswers are grounded in this post's content.
Episode Description
Naveen Rao is cofounder and CEO of Unconventional AI, an AI chip startup building analog computing systems designed specifically for intelligence. Previously, Naveen led AI at Databricks and founded two successful companies: Mosaic (cloud computing) and Nervana (AI accelerators, acquired by Intel).  In this episode, a16z’s Matt Bornstein sits down with Naveen at NeurIPS to discuss why 80 years of digital computing may be the wrong substrate for AI, how the brain runs on 20 watts while data centers consume 4% of the US energy grid, the physics of causality and what it might mean for AGI, and why now is the moment to take this unconventional bet.   Stay Updated: If you enjoyed this episode, please be sure to like, subscribe, and share with your friends. Follow Naveen on X: https://x.com/NaveenGRao Follow Matt on X: https://x.com/BornsteinMatt Follow a16z on X: https://twitter.com/a16z Follow a16z on LinkedIn:https://www.linkedin.com/company/a16z Follow the a16z Podcast on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX Follow the a16z Podcast on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711 Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details, please see http://a16z.com/disclosures. Stay Updated: Find a16z on X Find a16z on LinkedIn Listen to the a16z Show on Spotify Listen to the a16z Show on Apple Podcasts Follow our host: https://twitter.com/eriktorenberg   Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
About a16z Podcast
a16z Podcast

a16z Podcast

By Andreessen Horowitz

The a16z Podcast discusses tech and culture trends, news, and the future – especially as ‘software eats the world’. It features industry experts, business leaders, and other interesting thinkers and voices from around the world. This podcast is produced by Andreessen Horowitz (aka “a16z”), a Silicon Valley-based venture capital firm. Multiple episodes are released every week; visit a16z.com for more details and to sign up for our newsletters and other content as well!