Will AWS Buy Google’s TPUs, Remembering Claude The Gator, Ricursive Raises $35M | Diet TBPN
Will AWS Buy Google’s TPUs, Remembering Claude The Gator, Ricursive Raises $35M | Diet TBPN
Podcast27 min 10 sec
Listen to Episode
Note: AI-generated summary based on third-party content. Not financial advice. Read more.
Quick Insights

Google (GOOGL) is emerging as a key challenger to NVIDIA, with its TPU chips attracting major customers like Meta, potentially creating a significant new revenue stream. Amazon (AMZN) is also competing by developing its own Tranium 3 AI chip to reduce costs and reliance on NVIDIA. While NVIDIA (NVDA) remains the dominant leader, investors should monitor this rising competition which could pressure its high margins. Keep an eye on AI model developer Anthropic, which has reportedly hired IPO lawyers, signaling a potential public offering in the near future. Be extremely cautious of investing in private companies through secondary markets, as these often involve prohibited deals, extreme fees, and inflated valuations.

Detailed Analysis

NVIDIA (NVDA)

  • Market Position: The podcast reinforces NVIDIA's absolute dominance in the GPU market for AI. However, this dominance is now facing a "broadside" of new competition.
  • Financial Performance: The company's growth is described as "insane."
    • Revenue is projected to ramp from $27 billion in 2023 to $130 billion in 2025.
    • Net profit margin has grown from 16% to an incredible 56%. This high margin is a major incentive for competitors to enter the market.
  • Competitive Landscape: An "anti-NVIDIA alliance" is forming among hyperscalers (like Amazon and Google) and other AI firms who are incentivized to reduce their reliance on NVIDIA and drive down chip costs.
    • OpenAI has reportedly struck deals with NVIDIA rivals AMD and Broadcom.
  • Performance Gap: One analysis mentioned in the podcast suggests that the performance gap between NVIDIA's next-generation chips (Rubin) and Amazon's Tranium 3 may actually be increasing, indicating NVIDIA could maintain its technological lead.

Takeaways

  • NVIDIA remains the undisputed leader in the AI chip space with unprecedented financial growth.
  • However, its high profitability has made it a target. Investors should monitor the progress of competitors like Amazon, Google, and AMD, as increased competition could eventually put pressure on NVIDIA's premium pricing and massive profit margins.
  • The key question is whether competitors can close the performance gap or if NVIDIA will continue to out-innovate them.

Amazon (AMZN) / AWS

  • Custom AI Chip: AWS has publicly launched its Tranium 3 custom AI chip, developed by its subsidiary Annapurna Labs.
    • It's stated to be 4 times as fast as the previous generation.
    • It can potentially reduce the cost of training and running AI models by up to 50% compared to equivalent GPUs from competitors.
  • Customer Adoption: The chip is seeing some success.
    • The startup Descartes (valued at $3.1 billion) had a major breakthrough in real-time AI video generation using an early version of the Tranium 3 chip, after trying other chips including NVIDIA's.
    • However, the podcast also mentions a rumor that Anthropic, another major AI company, may not have had a great experience with Tranium and could be shifting more workloads to Google's TPUs.
  • Business Strategy: The hosts highlight Amazon's "customer obsessed" philosophy. This means AWS might be willing to offer competitor chips (like Google's TPUs) in its data centers if that's what customers demand, even if it means partnering with a rival.
  • Potential Synergy: Amazon owns the streaming platform Twitch. This could create a powerful internal use case for the real-time video technology being developed by Descartes on Tranium chips.

Takeaways

  • Amazon is making a serious, long-term investment in custom silicon to challenge NVIDIA's dominance and lower its own operational costs.
  • The success of Tranium 3 is a mixed bag so far. While there are promising case studies like Descartes, its broad adoption is not yet guaranteed.
  • Investors should see this as a defensive and offensive move. It defends against over-reliance on NVIDIA and offers a new, potentially lower-cost option to attract and retain AWS customers. The company's willingness to offer choice means it can profit from the AI boom regardless of which chip wins.

Google (GOOGL)

  • TPU Chips: Google's custom AI processors, known as TPUs (Tensor Processing Units), are positioned as a strong competitor in the AI chip market.
  • Major Deals: Other big tech companies are looking to buy Google's chips to diversify away from NVIDIA.
    • Meta Platforms (META) is reportedly in talks with Google to buy billions of dollars worth of TPUs.
  • Strategic Partnerships: Google and AWS have announced a partnership to allow customers to create private, high-speed connections between the two cloud platforms. This acknowledges that customers on AWS still want access to Google's superior AI tools.
  • The Big Question: The podcast speculates whether AWS would go a step further and buy TPUs directly from Google to offer to its cloud customers. Given AWS's "customer-first" mantra, this is presented as a real possibility.

Takeaways

  • Google's TPU is a significant asset that makes its cloud platform (GCP) highly competitive in the AI space.
  • Google is showing a pragmatic willingness to partner with rivals to get its AI tools and chips into the hands of more users.
  • If Google starts selling its TPUs to other cloud providers like AWS, it could open up a massive new revenue stream and further challenge NVIDIA's market share.

Investment Theme: Private AI Startups

  • Recursive Intelligence: An AI startup founded by ex-Google researchers that aims to automate the design of cutting-edge chips.
    • It recently raised $35 million in funding from investors including Sequoia Capital at a $750 million valuation.
  • Anthropic: A major AI model developer.
    • The podcast notes that the company has recently hired IPO lawyers, signaling a potential move to go public.
    • It also faces a $1.5 billion judgment for including copyrighted books in its AI training data. One author mentioned that the potential payout could be $1,500 per book. This highlights a significant legal and financial risk for AI model developers.
  • Descartes: A startup focused on real-time AI video generation, now valued at $3.1 billion. Its success is directly tied to the performance of Amazon's new Tranium 3 chip.

Takeaways

  • The private market for AI is extremely active, with startups raising significant capital at high valuations.
  • Key investment areas include using AI to solve fundamental industry problems (like chip design) and developing new AI-powered applications (like real-time video).
  • Investors should be aware of the significant legal risks surrounding AI training data. The outcome of lawsuits like the one against Anthropic could have major financial implications for the entire industry.

Warning: Secondary Markets & SPVs (Special Purpose Vehicles)

  • Context: The podcast highlights a direct warning from a founder of a major private company (Anduril is implied) about investing in his company through unauthorized secondary market deals.
  • The Scam: A fund called Ignite VC was allegedly soliciting investment for a complex, double-layered SPV to buy Anduril shares via a "forward contract."
  • Red Flags Mentioned:
    • Prohibited by the Company: The forward contracts were explicitly disallowed by Anduril's bylaws, meaning the investment had "zero chance" of ever resulting in actual share ownership.
    • Extreme Fees: The deal included an 8% upfront fee, a 3% annual fee, and 20% carried interest.
    • Inflated Valuation: The implied price per share was 115% higher than Anduril's most recent funding round from just nine months prior.
    • High Risk: The founder noted that forward contracts are notoriously difficult to settle and carry extreme counterparty risk.

Takeaways

  • This serves as a strong warning for retail investors: be extremely cautious of unsolicited offers to invest in hot private startups.
  • If a deal memo focuses more on fees and complex structures than on the company's fundamental performance, it is a major red flag.
  • Always be skeptical of deals with opaque terms, exorbitant fees, and valuations that seem absurdly high compared to recent, official funding rounds. The founder's advice was to "run for the hills."
Ask about this postAnswers are grounded in this post's content.
Episode Description
Our favorite moments from today's show, in under 30 minutes.  TBPN.com is made possible by:  Ramp - https://ramp.com Figma - https://figma.com Vanta - https://vanta.com Linear - https://linear.app Eight Sleep - https://eightsleep.com/tbpn Wander - https://wander.com/tbpn Public - https://public.com AdQuick - https://adquick.com Bezel - https://getbezel.com  Numeral - https://www.numeralhq.com Polymarket - https://polymarket.com Attio - https://attio.com/tbpn Fin - https://fin.ai/tbpn Graphite - https://graphite.dev Restream - https://restream.io Profound - https://tryprofound.com Julius AI - https://julius.ai turbopuffer - https://turbopuffer.com fal - https://fal.ai Privy - https://privy.io Cognition - https://cognition.ai Gemini - https://gemini.google.com Follow TBPN:  https://TBPN.com https://x.com/tbpn https://open.spotify.com/show/2L6WMqY3GUPCGBD0dX6p00?si=674252d53acf4231 https://podcasts.apple.com/us/podcast/technology-brothers/id1772360235 https://www.youtube.com/@TBPNLive
About TBPN
TBPN

TBPN

By John Coogan & Jordi Hays

Technology's daily show (formerly the Technology Brothers Podcast). Streaming live on X and YouTube from 11 - 2 PM PST Monday - Friday. Available on X, Apple, Spotify, and YouTube.