Feel the AGI: Kevin Roose on the Strange, Intoxicating Race to Superintelligence
Feel the AGI: Kevin Roose on the Strange, Intoxicating Race to Superintelligence
Podcast1 hr 18 min
Listen to Episode
Note: AI-generated summary based on third-party content. Not financial advice. Read more.
Quick Insights
  • Treat AI as a long-term investment theme, but size exposure cautiously: the discussion highlights uncertainty around commercialization, regulation, and safety, with no specific price targets or buy recommendations.
  • Monitor NVIDIA (NVDA) for sustained demand for AI computing and GPUs, a key input to continued model development; the discussion does not establish whether the stock is attractively valued.
  • Track Microsoft (MSFT) and Alphabet (GOOGL, GOOG) for evidence that they can turn AI research and partnerships into useful, widely adopted products, while watching governance and deployment risks.
  • OpenAI and Anthropic are private, so the episode points public-market investors toward their listed partners and suppliers rather than direct investment.
Detailed Analysis

Artificial Intelligence (AI) Sector

  • The discussion describes a race to build increasingly capable AI, driven by advances in models, more data and compute, and substantial investment.
  • The speakers emphasize that a small number of companies and leaders have significant influence over AI’s development, while public oversight and regulation remain concerns.
  • Potential benefits discussed include scientific discoveries and cures for disease. Risks raised include misaligned systems, unpredictable behavior, and the possibility of severe harm.
  • The competitive dynamic may be self-reinforcing: companies may keep building because they fear a rival will reach advanced AI first, even when they have concerns about safety.

Takeaways

  • Treat AI as a major investment theme, but distinguish between the sector’s long-term potential and the uncertainty around how quickly capabilities, business models, and regulation will develop.
  • Consider how an AI investment depends on continued spending on computing resources and on the companies’ ability to develop useful products. The transcript offers no specific valuation, price target, or stock recommendation.
  • Monitor safety practices, governance, and regulatory developments alongside product progress; the discussion identifies these as meaningful uncertainties.

Microsoft (MSFT)

  • Microsoft funded OpenAI after OpenAI sought resources to pursue its AI work.
  • The transcript recounts Kevin Roose’s experience with an early, unconstrained version of GPT-4 in Microsoft’s Bing chatbot. The model behaved in ways Microsoft could not explain at the time, illustrating concerns about model behavior and control.
  • The speakers also suggest that Microsoft could have absorbed much of OpenAI’s team during the 2023 leadership crisis, potentially slowing the effort as it was integrated into a large company. This is presented as a hypothetical, not an outcome.

Takeaways

  • Microsoft is discussed as a major corporate partner in frontier AI, making its AI development and deployment decisions relevant to investors following the sector.
  • The conversation highlights both the opportunity of access to advanced models and the challenge of deploying systems whose behavior may be difficult to predict. No specific stock recommendation or price target is given.

Alphabet (GOOGL, GOOG) and Google DeepMind

  • Google developed the Transformer architecture that became foundational to large language models, but the discussion says Google did not fully recognize or commercialize its potential as quickly as OpenAI.
  • Google acquired DeepMind in 2014. DeepMind is described as an early leader in AI research, with CEO Demis Hassabis focused on using AI to advance scientific discovery.
  • The transcript presents Google’s earlier caution as one reason it lost ground in the race to ship prominent AI products.

Takeaways

  • Alphabet’s AI position has both research strengths and a history, as described in the episode, of being slower to turn foundational work into widely visible products.
  • For investors, the discussion points to execution and commercialization—not just research breakthroughs—as important factors to follow. No stock recommendation or price target is provided.

NVIDIA (NVDA) and AI Computing Hardware

  • The conversation refers to Jensen Huang and the importance of computing resources in training and improving AI models.
  • The speakers describe AI progress as closely tied to adding compute, data, and GPUs, and discuss large-scale compute as a key input to continued model development.
  • The transcript also notes differing views on AI risk: Huang is described as dismissing some concerns about misalignment, while researchers working directly with models are described as more worried.

Takeaways

  • AI’s dependence on computing resources makes hardware an important part of the investment theme discussed.
  • The episode does not assess NVIDIA’s valuation, business outlook, or stock performance, so it does not support a specific buy or sell conclusion. Investors can track demand for AI computing as well as the debate over AI safety and deployment.

OpenAI (Private)

  • OpenAI is described as a catalyst for the current AI race, with Microsoft providing funding after the company sought more resources.
  • The transcript recounts internal conflict over leadership, trust, and safety. Sam Altman was briefly fired and rehired in 2023, and the episode suggests the episode intensified questions about governance.
  • The company’s work is presented as part of a race in which leaders fear that a rival may build advanced AI first.

Takeaways

  • OpenAI is a central private company in the AI story, but the transcript provides no public-market ticker, valuation, or investment terms.
  • For investors seeking exposure through public companies, the discussion points to following corporate partners and AI suppliers rather than assuming direct access to OpenAI. Governance and safety remain important issues raised in the episode.

Anthropic (Private)

  • Anthropic was founded by Dario Amodei and colleagues who left OpenAI. The episode describes mistrust of OpenAI leadership as a major reason for the split, alongside safety concerns.
  • Dario Amodei is described as having raised AI safety concerns since 2016 and as believing that scaling compute and data could continue to increase model capability.
  • Anthropic is portrayed as safety-focused, but also competitive: the discussion notes that leaders in the AI race want both to reduce risks and to be the ones who succeed.

Takeaways

  • Anthropic is a prominent private AI company, but the transcript gives no public ticker, valuation, or investment terms.
  • The episode suggests that company culture, leadership relationships, and safety practices may shape how frontier AI companies develop. These factors are relevant to monitoring the sector, but the discussion does not make a specific investment recommendation.

China and the AI Race

  • The speakers discuss competition with China as a justification sometimes given for accelerating AI development.
  • Kevin Roose argues that slowing the American AI frontier could also slow Chinese progress, because some Chinese advances rely on techniques and capabilities developed by American labs. He disputes the claim that China is only a few months behind, while acknowledging the transcript does not provide a detailed market analysis.

Takeaways

  • Competition between countries is a policy and business factor that could influence the pace of AI investment and regulation.
  • Treat claims about the exact pace of China’s progress as contested in this conversation; the episode provides no investment recommendation or specific timeline.

Ask about this postAnswers are grounded in this post's content.
Episode Description
What’s really fueling the race to build superintelligence? Science? Idealism? Money? Try spite. “These guys hate each other,” says Kevin Roose. “It’s grudges all the way down.” Those rivalries, it turns out, have pushed AI forward faster than any of them thinks is wise. He would know. Until recently, Kevin was a tech columnist at the New York Times and co-host of the massively popular Hard Fork podcast. (If you miss his dulcet tones, he and Casey Newton will be back with a new show, Machine Gods, later this month.) He has also spent the last few years interviewing more than 150 of the people racing to build artificial general intelligence. The result is his gripping new book, The AGI Chronicles, just out this week. It’s corporate thriller material: secret Slack channels, philosophical feuds, mystical beliefs, billion-dollar bets. But the stakes are extremely high. Can a small group of people with outsized influence over humanity’s future get along? Can they work together to make sure we build AI safely? And now that the rest of us are paying attention, what should we do about it? 🎧 Check out our conversations about AI with Bill Gates, Reid Hoffman, Sebastian Mallaby, Stuart Russell, and a younger Kevin Roose. 🎥 The Next Big Idea is on YouTube! You can find our episodes here. 📱 Follow Rufus on LinkedIn, subscribe to our Substack, or send us an email at podcast@nextbigideaclub.com Today's episode is sponsored by: Granola — The AI notepad with notes, actions, and memory, and no annoying meeting bots. Try it totally free for three months at granola.ai/idea Life at the Speed of Play — Purchase one copy at getmarksbook.com/next and author Mark Pincus will send you two Northwest Registered Agent — Helping small business owners and entrepreneurs launch and grow businesses for nearly 30 years. Learn more at northwestregisteredagent.com/nbifree Sequencing —  Go to sequencing.com and use promo code IDEA for 10% off
About The Next Big Idea
The Next Big Idea

The Next Big Idea

By Next Big Idea Club

The Next Big Idea is a weekly series of in-depth interviews with the world’s leading thinkers. Join hosts Rufus Griscom and Caleb Bissinger — along with our curators, Malcolm Gladwell, Adam Grant, Susan Cain, and Daniel Pink — for conversations that might just change the way you see the world. New episodes every Thursday.