Inside Hudson River Trading's Blistering Token Burn
Inside Hudson River Trading's Blistering Token Burn
3 hours agoOdd LotsBloomberg
Podcast31 min 20 sec
Listen to Episode
Note: AI-generated summary based on third-party content. Not financial advice. Read more.
Quick Insights

The most direct way to play the AI revolution is through NVIDIA (NVDA), which maintains a dominant "moat" in model training as the next-generation Rubin chips are expected to be sold out through 2027. Investors should shift focus toward physical infrastructure, as the scarcity of data center space and electricity makes copper, steel, and utility providers essential "bottleneck" investments. Within the financial sector, high-frequency trading firms are utilizing AI to predict market movements across equities, crypto, and options, suggesting a "winner-take-all" environment for firms with the largest compute budgets. Be prepared for increased market volatility and faster trend cycles as AI-driven "black box" models move beyond millisecond trades to influence longer-term market behavior. Finally, monitor the rising operational "token spend" in tech companies, where AI is delivering 50% productivity gains but creating a divide between "token rich" firms and their smaller competitors.

Detailed Analysis

Hudson River Trading (HRT) / Quantitative Trading Sector

Hudson River Trading (HRT) is a prominent high-frequency trading (HFT) firm. The discussion focuses on how HRT and its peers are integrating generative AI and massive compute power into their core trading strategies and research workflows.

  • Exponential Compute Growth: HRT reports that the amount of compute power they utilize is growing exponentially year-over-year.
  • Unified Trading Approach: AI technology is being applied across all asset classes—equities, futures, crypto, and options—using a unified approach rather than separate models for each market.
  • Market Prediction: AI is increasingly capable of predicting market movements further out in time, moving beyond just ultra-short-term (millisecond) windows.
  • The "Magic Model" & Interpretability: Traders are becoming comfortable with "black box" models. While humans may not understand why a model identifies a specific signal (e.g., a correlation between certain ticker symbols and days of the week), the rigorous backtesting and automated risk checks provide the confidence to trade them.
  • Emergent Phenomena: AI models have shown the ability to understand "meme stocks" and "crypto stocks" as being fundamentally linked in a "hyper-dimensional space," even without explicit human instruction on these categories.

Takeaways

  • Diminishing Human Intuition: In the quant space, the "human story" or logical explanation for a trade is becoming less relevant than pure data-driven performance.
  • Margin Compression Risk: As all major trading shops (HRT, Citadel, etc.) invest heavily in the same AI technology, there is a risk that profit margins could eventually be driven toward zero as the "arms race" for predictive superiority levels out.
  • Risk Management is Key: For investors looking at AI-driven funds, the "safety layer" (automated risk checks) is more important than the model's logic, as the models themselves are often uninterpretable.

NVIDIA (NVDA) / Semiconductor Sector

The transcript highlights the critical role of hardware, specifically GPUs, as the foundational layer of the current AI trading revolution.

  • Supply Constraints: While chips like the Blackwell series may be available, the "total solution" (chips plus the data center space and power to run them) is extremely scarce.
  • Future Roadmap: The next generation of GPUs (Rubin) is expected to be sold out immediately upon release in 2027.
  • NVIDIA’s Moat: While many firms are trying to build their own "inference" chips (simpler chips for running models), NVIDIA maintains a massive "moat" in the "training" side (complex chips used to create models).

Takeaways

  • Long-term Demand: Demand for high-end GPUs remains structural and long-term; trading firms are currently signing 3-to-5-year contracts for compute capacity.
  • Vendor Lock-in: Firms using Google’s TPUs or Amazon’s Trainium face "vendor lock-in," making NVIDIA the preferred "neutral" and high-performance choice for many.

Data Centers & Infrastructure (Real Assets)

The "bottleneck" for investment opportunities has shifted from just the chips to the physical infrastructure required to house them.

  • Power is the New Gold: Access to electricity and data center "shells" is the primary constraint. HRT mentions they are forced to take whatever power they can find (e.g., "one megawatt here, one megawatt there") regardless of favorable terms.
  • Neo-Clouds: Smaller, specialized cloud providers (Neo-Clouds) are emerging to compete with hyperscalers (AWS/Google), but they carry higher counterparty and credit risk.

Takeaways

  • Infrastructure Investment: The "AI trade" is increasingly a play on copper, steel, and electricity.
  • Compute as a Commodity: There is an emerging market for "Compute Futures" or financial instruments that allow firms to hedge the cost of future compute capacity, similar to oil or gas futures.

AI Software & LLMs (Anthropic, OpenAI, DeepSeek)

The discussion touches on the utility of Large Language Models (LLMs) in professional environments.

  • Token Spend: HRT reports an average "token spend" (cost of using AI models) of $100–$200 per day per employee, with some power users reaching $1,000 per day.
  • Productivity Gains: AI is estimated to provide a roughly 50% boost in productivity for researchers and engineers.
  • The "Token Rich" vs. "Token Poor": A new competitive divide is forming between firms that can afford massive AI spending and those that cannot.

Takeaways

  • Operational Expense: For tech and finance companies, "Token Spend" is becoming a significant new line item in budgets, replacing or augmenting traditional software costs.
  • Talent Shift: The value of "implementers" (people who just write code) may decrease, while the value of "dreamers" or "theorists" who can clearly describe complex ideas to an AI (prompting) is increasing.

Investment Themes: "AI Delirium" & Market Sentiment

The guest uses the term "AI Delirium" to describe the feverish pace of progress and the feeling that markets are "hurtling towards some sort of end game."

  • Exponential Pace: The spacing between new, more powerful model releases is compressing (e.g., the jump from Claude Opus 4.0 to 4.5).
  • Market Detachment: There is a suggestion that public markets are becoming "detached" from fundamentals, behaving more like "gambling markets" driven by flows and AI-driven predictions rather than traditional value.

Takeaways

  • High Volatility/High Speed: Investors should prepare for a market environment where trends develop and dissipate faster than ever before due to AI-accelerated trading.
  • Winner-Take-All: The compounding effect of AI (more money -> more compute -> better models -> more money) suggests a "winner-take-all" dynamic for the top-tier quantitative firms and tech giants.
Ask about this postAnswers are grounded in this post's content.
Episode Description
Today’s episode, which was recorded at our recent live show at New York’s City Winery, follows up on a conversation we had with Iain Dunning, head of AI at Hudson River Trading. Last year, we talked about how his firm uses AI. Now, some seven months later, we follow up on how one of the biggest market makers around is deploying this technology. We talk about the price of memory, bottlenecks in compute, how much HRT employees are actually spending on tokens, why the firm might develop its own chips, as well as AI-induced delirium. Read more: Jane Street Plans New Data Center as Compute Power Runs Scarce Nvidia-Backed Robotics Startup Generalist AI Valued at $2 Billion Only Bloomberg - Business News, Stock Markets, Finance, Breaking & World News subscribers can get the Odd Lots newsletter in their inbox each week, plus unlimited access to the site and app. Subscribe at  bloomberg.com/subscriptions/oddlots Subscribe to the Odd Lots Newsletter Join the conversation: discord.gg/oddlots See omnystudio.com/listener for privacy information.
About Odd Lots
Odd Lots

Odd Lots

By Bloomberg

<p>Bloomberg's Joe Weisenthal and Tracy Alloway explore the most interesting topics in finance, markets and economics. Join the conversation every Monday and Thursday.</p>