Carmen Li's Plan to Build a Futures Market for Compute
Carmen Li's Plan to Build a Futures Market for Compute
45 days agoOdd LotsBloomberg
Podcast32 min 56 sec
Listen to Episode
Note: AI-generated summary based on third-party content. Not financial advice. Read more.
Quick Insights

Investors should prepare for the launch of GPU compute futures on the CME Group exchange, which will allow for direct trading and hedging of AI processing power as a commodity. High-conviction opportunities exist in NVIDIA (NVDA) hardware, as even older A100 chips have seen recent price increases of 10-15% due to massive supply-demand imbalances. Consider diversifying into the infrastructure layer—specifically companies providing power, cooling, and fiber—to capture value from the "stars aligning" requirements of new data centers. Monitor the high resale value of H100 chips, which currently retain 85% of their value after a year, providing a significant safety net for capital expenditures in the sector. For those seeking exposure to AI demand without picking individual stocks, these upcoming financially settled futures offer a way to trade the 20-30% daily volatility of compute prices.

Detailed Analysis

GPU Compute Futures (CME Group)

The podcast discusses the emergence of a financialized market for AI compute power. Carmen Li (CEO of Compute Exchange and Silicon Data) highlights a partnership with CME Group to launch GPU future options. This allows compute power to be traded as a commodity, similar to oil (WTI/Brent).

  • Market Structure: The goal is to allow companies to hedge the volatility of GPU prices.
  • Participants:
    • Natural Longs: "Neo-clouds" and data centers that own GPUs and want to lock in stable revenue.
    • Natural Shorts: AI startups and enterprises that need to buy compute and want to control cost volatility.
  • Settlement: The CME futures will be financially settled (cash), while Compute Exchange handles physical forward contracts (actual access to chips via API).
  • Normalization: Because GPUs aren't perfectly fungible (different RAM, CPUs, and locations), Silicon Data uses an index model to normalize prices into a "base case" for trading.

Takeaways

  • Institutional Access: Investors can soon gain exposure to AI demand through CME futures without buying individual stocks like NVIDIA.
  • Hedging for Startups: AI companies can use these instruments to protect their margins against sudden spikes in compute costs.
  • Volatility as an Asset: Daily volatility for A100 and H100 chips is currently between 20% and 30%, making it a healthy environment for commodity traders.

NVIDIA (NVDA) / GPU Hardware

While the focus is on the "compute" as a service, the underlying hardware—specifically NVIDIA chips—is the primary driver of the market.

  • Chip Performance Variance: Research shows a 38% performance variance between identical chips (e.g., A100) depending on the provider and data center configuration.
  • Price Trends:
    • H100 prices have risen roughly 8% in the last three months.
    • Even older chips like the A100 have seen price increases of 10-15% recently due to shifting supply-demand curves.
  • Residual Value: Contrary to "bubble" fears, H100 chips retain high value. A one-year-old refurbished chip can sell for $0.85 on the dollar, showing much slower depreciation than typical electronics.

Takeaways

  • Bullish Sentiment for Older Tech: The price rise in older A100 chips suggests that demand for AI compute is so high that it is spilling over into legacy hardware, not just the latest Blackwell (B200) chips.
  • Asset-Backed Value: For those investing in data centers, the high resale value of used GPUs provides a significant "safety net" for capital expenditures.

AI Compute Sector (Neo-Clouds & Marketplaces)

The discussion identifies a shift in how companies acquire compute, moving away from just the "Big Three" (AWS, Google, Azure).

  • The "Neo-Cloud" Rise: New specialized cloud providers are the primary suppliers in the compute exchange market.
  • Token Pricing: The market is also tracking LLM Token Indices. The price for a basket of open-source and closed-source models has roughly doubled since December 2023 to approximately $2.21 per million tokens.
  • Supply Constraints: Bringing GPUs online is not just about buying chips; it requires "stars to align" regarding land, power, fiber optics, and specialized cooling.

Takeaways

  • Diversification: Investors should look beyond the "Hyperscalers" (Microsoft/Google) to the infrastructure layer—companies providing power, cooling, and fiber for these new data centers.
  • Software Efficiency: A key risk/opportunity mentioned is "model compression." If software gets better at running on cheaper, older chips, the premium for the newest NVIDIA hardware might eventually compress.

Investment Themes & Risks

Themes

  • Compute as the "New Oil": The financialization of compute suggests it will become a foundational macro indicator for the digital economy.
  • Basis Trading: Just like in oil, there will be "basis risk" where the price in a specific data center (e.g., US East) differs from the global index.

Risks

  • Overbuild Risk: If too many data centers are built simultaneously, it could lead to an oversupply and a crash in compute rental prices.
  • Contract Default: While futures are cleared, private forward contracts between startups and neo-clouds carry credit risk if the startup fails.
  • Non-Fungibility: Unlike a barrel of oil, compute is highly dependent on the "software layer" and specific hardware configurations, which could make some indices less effective for certain users.
Ask about this postAnswers are grounded in this post's content.
Episode Description
When we spoke to DRW's Don Wilson last year, he talked about building out a GPU market that might be bigger than oil. Now, a year later, he is working with Carmen Li to do just that. Li is the CEO of two companies — Silicon Data and Compute Exchange (where she works alongside Wilson). The former company is building the index for GPU pricing while the latter is a spot marketplace for GPU procurement. Today's episode — recorded at our live show at City Winery in New York — gets into how Li is building a whole new market for GPUs at her two companies. We talk about the challenge of standardizing compute, GPU price volatility, if used GPUs are like used cars, what goes into constructing a GPU index, and what it means to win the GPU lottery. Read more: Jane Street Plans New Data Center as Computing Power Runs Scarce SpaceX Inks $30 Billion Computing Power Deal With Google Only Bloomberg - Business News, Stock Markets, Finance, Breaking & World News subscribers can get the Odd Lots newsletter in their inbox each week, plus unlimited access to the site and app. Subscribe at  bloomberg.com/subscriptions/oddlots Subscribe to the Odd Lots Newsletter Join the conversation: discord.gg/oddlots See omnystudio.com/listener for privacy information.
About Odd Lots
Odd Lots

Odd Lots

By Bloomberg

<p>Bloomberg's Joe Weisenthal and Tracy Alloway explore the most interesting topics in finance, markets and economics. Join the conversation every Monday and Thursday.</p>