🟠 YC Demo Day, Will AWS Buy TPUs From Google? | Harj Taggar, Paul Graham & Jessica Livingston, Richard Wang, Philip Ho, Ali Attar, Kurush Dubash & More
🟠 YC Demo Day, Will AWS Buy TPUs From Google? | Harj Taggar, Paul Graham & Jessica Livingston, Richard Wang, Philip Ho, Ali Attar, Kurush Dubash & More
Podcast2 hr 54 min
Listen to Episode
Note: AI-generated summary based on third-party content. Not financial advice. Read more.
Quick Insights

Google (GOOGL) is a key investment opportunity as its TPU AI chips gain significant traction, with potential multi-billion dollar deals from major customers like Meta and Anthropic. To invest in the broader theme of AI supply chain diversification away from NVIDIA, consider AMD (AMD) and Broadcom (AVGO) as they are positioned to be key secondary suppliers. While NVIDIA (NVDA) remains dominant, investors should monitor its high 56% net profit margin as a key indicator of whether competition is eroding its pricing power. Watch for announcements on whether Amazon (AMZN) will offer competitor chips on AWS, which would be a major victory for Google and a pragmatic win for Amazon. Finally, retail investors should be extremely cautious with private secondary market deals, which often carry inflated valuations and high counterparty risk.

Detailed Analysis

NVIDIA (NVDA)

  • The podcast highlights the intense competition NVIDIA is facing. While it remains the dominant force in AI chips, major tech companies are actively trying to reduce their dependence on them.
  • Amazon's new Tranium 3 chip and Google's TPU are presented as the primary threats. Major AI labs and companies like Meta, Anthropic, and OpenAI are actively seeking to diversify their chip suppliers.
  • NVIDIA's financial performance has been astronomical, with revenue projected to jump from $27 billion in 2023 to $130 billion in 2025.
  • Its net profit margin has soared from 16% to 56%. This incredible profitability is the main reason customers are forming an "anti-NVIDIA alliance" to find cheaper alternatives and bring those margins down.
  • Despite the competition, some analysis mentioned in the podcast suggests NVIDIA's technological lead over competitors like Amazon's Tranium may actually be increasing, especially when considering the total cost of ownership (TCO).

Takeaways

  • NVIDIA is a high-growth, high-profit company, but it comes with the risk of increasing competition. The 56% net profit margin is a key metric to watch; any significant decrease could signal that competitors are successfully eating into its market share.
  • Investors should monitor the adoption rates of Google's TPUs and Amazon's Tranium chips by major AI players. Deals like Meta buying TPUs or Anthropic shifting away from NVIDIA are important indicators of the competitive landscape.
  • The formation of two "complexes" was discussed: the OpenAI complex (including NVIDIA, Microsoft, AMD) and the Google complex (including Google, Broadcom). This framing suggests a large-scale strategic battle for the future of AI infrastructure.

Amazon (AMZN)

  • Amazon Web Services (AWS) has launched its new custom AI chip, Tranium 3, which it claims is 4x faster than the previous generation and can reduce AI model costs by up to 50% compared to GPUs.
  • A startup called Descartes (valued at $3.1 billion) had a major breakthrough using Tranium 3 for real-time AI video generation, validating the chip's potential in specific use cases.
  • There are rumors that Anthropic, a major AI company that Amazon has invested heavily in, had a poor experience with Tranium and may be shifting to Google's TPUs.
  • The key question raised is whether AWS would offer Google's TPUs in its data centers. The AWS CEO's response emphasized "customer choice," and the podcast references Jeff Bezos's "customer obsessed, not competitor obsessed" philosophy. This suggests AWS might prioritize keeping customers on its platform, even if it means offering a competitor's hardware.
  • AWS and Google Cloud recently announced a partnership to create high-speed links between their platforms, acknowledging that customers are already using services from both clouds.

Takeaways

  • Amazon's custom silicon efforts with Tranium are a significant long-term strategy to reduce costs and dependence on NVIDIA. Success here could significantly boost AWS margins.
  • The "customer choice" strategy is a double-edged sword. While offering competitor chips could keep customers within the AWS ecosystem, it could also signal a lack of confidence in their own Tranium chips for general-purpose workloads.
  • Investors should watch for announcements about which chips major AI companies choose to use on AWS. If large customers start demanding and getting TPUs on AWS, it would be a bullish sign for Google and a pragmatic, defensive win for Amazon.

Google (GOOGL)

  • Google's custom AI chips, TPUs, are gaining significant traction as a viable alternative to NVIDIA's GPUs.
  • Meta Platforms is reportedly in talks to buy billions of dollars worth of Google's advanced TPUs.
  • Anthropic, a leading AI lab, is also rumored to be buying and leasing TPUs, potentially moving away from other providers.
  • Google is seen as the leader of the "Google complex," an informal alliance of companies (including Broadcom) working to challenge NVIDIA's dominance in the AI hardware market.
  • The new partnership allowing high-speed connections between AWS and Google Cloud highlights that customers are actively seeking out Google's superior AI capabilities, even if their main infrastructure is elsewhere.

Takeaways

  • Google's TPU business appears to be a powerful and potentially underappreciated growth driver for the company. Securing massive orders from companies like Meta would be a major validation of its technology.
  • Success with TPUs not only generates direct revenue but also strengthens the Google Cloud Platform (GCP) ecosystem, attracting more AI workloads and developers.
  • Google is a key player to watch in the "anti-NVIDIA" movement. Its success could reshape the economics of the entire AI industry.

Other Public Companies

  • AMD (AMD) & Broadcom (AVGO): Both are positioned as key beneficiaries of the trend to diversify the AI supply chain away from NVIDIA. OpenAI has struck deals with both companies, signaling their role as important secondary suppliers in the "OpenAI complex."
  • Intel (INTC): Mentioned as a potential turnaround story, heavily supported by the US government's CHIPS Act. Its former CEO, Pat Gelsinger, is involved with a lithography startup, Xlight, that just received a $150 million government award. While Intel is considered great for gaming, its future success hinges on its ability to build manufacturing facilities (fabs) that can compete with industry leader TSMC.

Takeaways

  • AMD and Broadcom are direct ways to invest in the theme of AI supply chain diversification. As the AI market grows, there is room for more than one winner, and these companies are well-positioned to capture a piece of the pie.
  • Intel is a high-risk, high-reward bet on a US-led resurgence in semiconductor manufacturing. It's a long-term play that depends heavily on execution and government support.

Investment Themes & Private Markets

  • AI-Native Startups: A major theme from YC Demo Day is the rise of "full-stack" or "AI-native" companies. Instead of selling AI software to existing businesses (like law firms or ad agencies), these startups are using AI to become the business itself.
    • Examples mentioned: Absurd (an AI-native creative agency charging upwards of $30,000 per video), Sava (an AI-powered trust company), and Fernstone (an AI-native insurance brokerage).
  • Prediction Markets: This sector is gaining momentum. The discussion highlights platforms like Polymarket and Kalshi, and the entry of major players like Robinhood. The YC company Dome is building a unified API to trade across all these platforms, indicating a growing and fragmenting market with arbitrage opportunities.
  • Robotics: The podcast discusses the emerging robotics landscape, focusing on the software layer. Lightberry, a YC company, is building an operating system for robots, partnering with hardware manufacturers like Unitree. The conversation suggests that the first mainstream use cases might be in public-facing roles like security guards or event staff, rather than complex domestic chores.
  • Secondary Markets (Warning): A segment detailed a warning from Anduril's CEO about fraudulent secondary market deals. He described an SPV (Special Purpose Vehicle) soliciting investment in Anduril shares through a complex, high-fee structure that was explicitly against company bylaws. The implied valuation was 115% higher than the last official funding round.

Takeaways

  • For venture investors, the "AI-native" model is a key trend. The biggest opportunities may not be in selling tools to old industries, but in funding the companies that use AI to replace them entirely.
  • The prediction market ecosystem is an emerging investment area. One can invest in the exchanges themselves or in the "picks and shovels" infrastructure plays like Dome that benefit from the overall growth of the sector.
  • Retail investors should be extremely cautious with private market investments, especially in hyped companies. The Anduril example shows these deals can have insane fees, inflated valuations, and high counterparty risk, and may not even be honored by the company. Always do your due diligence.
Ask about this postAnswers are grounded in this post's content.
Episode Description
(01:23) - Will AWS Buy TPUs From Google? (20:51) - 𝕏 Timeline Reactions (46:33) - Harj Taggar, a Managing Partner at Y Combinator and co-founder of Triplebyte and Auctomatic, discusses the evolving landscape for startups, highlighting the increased ease of selling to both government entities and Fortune 500 companies. He emphasizes that the choice between these paths depends on the product type, noting that AI advancements have opened new opportunities for startups to secure large clients directly. Taggar also observes a trend where companies are adopting AI-native, full-stack approaches, integrating AI into their core operations rather than merely offering AI tools to existing firms. (59:39) - Richard Wang is co-founder and CEO of Clad Labs, a startup building “CHAD: The Brainrot IDE,” an AI-powered development environment designed to blend coding with leisure workflows. (01:06:32) - Philip Ho, Absurd is a San-Francisco–based startup that builds AI-powered brand and performance ads at scale. (00:00) - produce production-quality marketing videos scripted, generated, and edited by a multi-agent AI system in about 72 hours. Their work has already seen traction: one of their launch videos reportedly hit over 1 million views, and they average hundreds of thousands of organic views across their campaigns. (01:18:23) - Ali Attar, co-founder of Lightberry, discusses the company's mission to develop an operating system that enables humanoid robots to interact with humans through natural language, eliminating the need for coding. He highlights their collaboration with manufacturers like Unitree to integrate this software, allowing robots to perform tasks such as emceeing events autonomously. Attar also emphasizes the potential for diverse robot applications, including security roles, and envisions a future where robots are prevalent in public spaces, interacting seamlessly with people. (01:29:59) - Kurush Dubash, co-founder and CEO of Dome, discusses how Dome provides a unified API for prediction markets, enabling users and developers to trade and analyze data across multiple platforms simultaneously. He highlights that their clientele includes application developers, sports books, and hedge funds interested in high-frequency trading and internal pricing. Kurush also notes the increasing number of platforms entering the prediction market space, each targeting specific regions or verticals, and emphasizes Dome's role in aggregating fragmented liquidity to support professional traders. (01:38:40) - David Alade, co-founder of Sorce, introduces the app as a "Tinder for Jobs," where users upload their resumes, swipe right on job listings, and AI agents automatically complete applications on company websites. He discusses the current hiring market, noting that while inbound applications are still used, the process is ripe for disruption due to its inefficiencies. Alade also highlights Sorce's growth, mentioning over 25,000 interviews facilitated in the past year, and shares that their marketing strategy relies heavily on viral social media content, particularly on TikTok and Instagram. (01:45:23) - Karim Rahme, co-founder and CEO of Metorial, discusses how their platform enables AI agents to securely access various applications and data sources, such as Gmail, SAP, and Salesforce, while providing essential access control for large organizations. He highlights Metorial's open-source success, noting over 3,600 GitHub stars and nearly 1,000 weekly active users within five weeks of launch, and mentions ongoing discussions with Fortune 500 companies for large-scale deployment. Rahme also shares his background, including graduating from NYU Abu Dhabi in May and previously leading an Abu Dhabi-based ticketing startup for over three years. (01:52:54) - Michael Sakowski, co-founder and COO of Crunched, an AI software company, discusses how their Excel-native AI analyst is tailored for top finance professionals, distinguishing itself from Microsoft's broader Copilot by focusing on the specific needs of the top 1% of Excel users. He highlights Crunched's unique ability to detect errors in complex financial models, sharing an instance where the software identified a £10 million overvaluation in a private equity deal, thereby preventing significant financial misrepresentation. Sakowski also addresses concerns about data security, emphasizing that Crunched does not train on client data and cannot access user prompts, ensuring confidentiality for their clients. (02:01:00) - Nimit Maru, co-founder and CEO of Sava, discusses building an AI-powered trust company to modernize trust administration by treating the trust charter as programmable infrastructure, enabling efficient, compliant, and scalable services. He shares his experience with the outdated trust industry after selling his previous company, Fullstack Academy, and highlights how Sava's platform allows for real-time tracking and management of trusts, aiming to make sophisticated wealth planning more accessible. (02:08:34) - Ben Koska, co-founder of SF Tensor, discusses how their platform collaborates with various cloud providers to streamline AI model training by managing GPU allocations and optimizing for different hardware, allowing researchers to focus solely on their work. He emphasizes SF Tensor's exclusive focus on the training phase, addressing a gap in the market, and highlights the diverse clientele ranging from individual researchers to large-scale labs tackling unsolved problems in areas like drug discovery and protein folding. Koska also notes the potential for companies to enhance base models with proprietary data, indicating SF Tensor's capability to support such training needs. (02:15:51) - Henry Kwan, founder and CEO of Icarus, is an aerospace engineer with experience at NASA and Orbital, where he built drones and satellites. He discusses Icarus's development of solar-powered autonomous drones capable of flying at 60,000 feet for extended periods, offering advantages over satellites due to their proximity and cost-effectiveness. Initially targeting defense applications, Kwan envisions broader uses for these stratospheric drones, including enhanced connectivity and surveillance capabilities. (02:24:20) - Cole Dermott, co-founder of Locus, a Y Combinator-backed startup, discusses the company's development of payment infrastructure for AI agents, enabling them to autonomously pay for services while maintaining control through defined budgets and permissions. He highlights that initial adopters are developers creating autonomous agents capable of discovering and paying for services independently, with broader consumer adoption expected as trust in the technology grows. Dermott also shares that Locus has processed approximately 3,500 transactions and has around 80 projects built using their platform. (02:28:06) - Paul Graham & Jessica Livingston. Graham is an English-American computer scientist and entrepreneur, co-founded Y Combinator, a prominent startup accelerator that has funded over 3,000 startups, including Airbnb, Dropbox, Stripe, and Reddit. Jessica Livingston is a co-founder of Y Combinator and one of the most influential figures in modern startup culture. She helped build YC from a small experiment into the world’s most successful startup accelerator, backing companies like Airbnb, Stripe, Reddit, and Dropbox. Jessica is also the author of Founders at Work and a long-time advocate for early-stage founders. TBPN.com is made possible by:  Ramp - https://ramp.com Figma - https://figma.com Vanta - https://vanta.com Linear - https://linear.app Eight Sleep - https://eightsleep.com/tbpn Wander - https://wander.com/tbpn Public - https:...
About TBPN
TBPN

TBPN

By John Coogan & Jordi Hays

Technology's daily show (formerly the Technology Brothers Podcast). Streaming live on X and YouTube from 11 - 2 PM PST Monday - Friday. Available on X, Apple, Spotify, and YouTube.