Krishna Rao - Anthropic's CFO on Compute, Scaling to $30B ARR, and the Returns to Frontier Intelligence - [Invest Like the Best, EP.471]
Krishna Rao - Anthropic's CFO on Compute, Scaling to $30B ARR, and the Returns to Frontier Intelligence - [Invest Like the Best, EP.471]
Podcast1 hr 16 min
Listen to Episode
Note: AI-generated summary based on third-party content. Not financial advice. Read more.
Quick Insights

Investors should prioritize Amazon (AMZN) and Google (GOOGL) as they secure long-term revenue moats through multi-billion dollar compute commitments from Anthropic. While NVIDIA (NVDA) remains a core holding, Anthropic’s successful use of Trainium and TPU chips suggests a growing trend of hardware diversification that reduces single-vendor dependency. For exposure to the "Enterprise-Ready" bottleneck, look toward private infrastructure leaders like WorkOS and Vanta which enable AI startups to meet the security standards of the Fortune 500. Specialized "Vertical AI" agents like Rogo are high-conviction plays for disrupting specific industries like financial services by automating complex Excel and PowerPoint workflows. The most significant growth opportunity lies in the $40 trillion global knowledge work market as AI shifts from simple chat interfaces to autonomous "Virtual Collaborators" with internal company memory.

Detailed Analysis

Anthropic (Private)

• Anthropic is a leading AI research lab and creator of the Claude family of models. • The company is experiencing hyper-growth, scaling from a $9 billion run rate to over $30 billion run rate in just one quarter. • Compute Strategy: Anthropic treats compute as its "lifeblood" and "canvas." • They utilize three different chip platforms fungibly: Amazon’s Trainium, Google’s TPUs, and NVIDIA’s GPUs. • They build their own compilers and orchestration layers to remain "bare metal" and maximize ROI on every dollar of compute. • Business Model: Primarily a platform play (API and infrastructure), but they build vertical applications like Claude Code and Claude Coworker to demonstrate model capabilities.

Takeaways

Enterprise Dominance: Anthropic is seeing massive adoption in the Fortune 500 (serving 9 of the top 10) because their focus on "AI Safety" and "Interpretability" appeals to risk-averse corporate legal and security teams. • Model-Led Growth: The "returns to frontier intelligence" remain high. Every leap in model capability (e.g., from Claude 3 to 3.5) unlocks new Total Addressable Markets (TAM) rather than just improving existing tasks. • Investment Scale: The company has raised $75 billion recently, with another $50 billion committed from partners like Amazon and Google, signaling the massive capital intensity required to stay competitive.


NVIDIA (NVDA), Amazon (AMZN), Google (GOOGL)

• These companies serve as the primary infrastructure providers for frontier AI labs like Anthropic. • Amazon & Google: Anthropic recently inked deals for up to 5 gigawatts of compute from each provider, totaling over $100 billion in commitments. • NVIDIA: While Anthropic uses custom chips (Trainium/TPUs), NVIDIA GPUs remain a core part of their "fungible" compute pool.

Takeaways

Diversification of Hardware: Anthropic’s ability to use Trainium and TPUs as effectively as GPUs suggests that while NVIDIA is the current leader, sophisticated AI labs are successfully building software layers to reduce dependency on a single chip architecture. • Long-term Revenue Visibility: The multi-year, multi-billion dollar commitments from Anthropic provide significant long-term revenue "moats" for the cloud divisions of Amazon (AWS) and Google (GCP).


AI Infrastructure & Software (WorkOS, Vanta, Ramp, Rogo)

• The transcript highlights several "picks and shovels" companies that enable the AI ecosystem to function at an enterprise level. • WorkOS: Provides the "Enterprise Ready" features (SSO, SCIM, Audit Logs) that AI startups like OpenAI, Perplexity, and Anthropic use to sell to large corporations. • Vanta: Automates compliance and security, used by Ramp and Snowflake. • Rogo (Felix): A specialized AI agent for financial services that automates Excel modeling and PowerPoint deck creation.

Takeaways

The "Enterprise-Ready" Bottleneck: For an AI tool to be invested in by a large firm, it must have security and compliance features. Companies like WorkOS and Vanta are essential infrastructure for the current AI boom. • Specialized Financial AI: General models are being replaced by specialized agents like Rogo that understand specific Wall Street workflows, suggesting a trend toward "Vertical AI."


Investment Theme: The "Returns to Frontier Intelligence"

• The discussion emphasizes that we have not yet hit a "wall" in AI scaling laws. • Recursive Self-Improvement: Anthropic uses its own models to write the code for its next generation of models. Over 90% of Anthropic’s internal code is written by Claude Code. • Jevons Paradox in AI: As Anthropic makes models more efficient and lowers the price, demand doesn't just stay steady—it explodes. Lowering the price of the "Opus" model led to a massive spike in consumption.

Takeaways

Bullish Sentiment on Scaling: Investors should note that Anthropic leadership believes scaling laws are "alive and well." This justifies the massive capital expenditures (CapEx) seen in the tech sector. • Knowledge Work Disruption: The "Virtual Collaborator" is the next frontier. Anthropic is targeting the $40 trillion global knowledge work market, moving from simple chat interfaces to agents that have "memory" and can use internal company tools autonomously. • Risk Factor: The "Diffusion Wall." The primary risk to the "Bull Case" is not the technology failing, but human organizations being too slow to adopt and integrate these tools into their workflows.

Ask about this postAnswers are grounded in this post's content.
Episode Description
My guest today is Krishna Rao, the CFO of Anthropic. The center of our conversation is how he navigates the decision around procuring and allocating compute, which he describes as the canvas on which everything else gets built. We talk about what he calls the cone of uncertainty, the three chip platforms Anthropic uses fungibly across Trainium, TPUs, and GPUs, and the daily meetings they run to allocate compute between model development, internal use, and serving customer demand. He explains why the returns to frontier intelligence keep getting higher, especially in enterprise, and how Anthropic thinks about the line between platform and application and why they choose to build their own products like Claude Code. Krishna has such a unique seat watching one of the fastest growing businesses in history, and he is generous in sharing what he has learned since joining the company two years ago. For the full show notes, transcript, and links to mentioned content, check out the episode page ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠here⁠⁠⁠⁠⁠.  ----- Become a Colossus member to get our quarterly print magazine and private audio experience, including exclusive profiles and early access to select episodes. Subscribe at ⁠colossus.com/subscribe⁠. ----- ⁠Ramp’s⁠ mission is to help companies manage their spend in a way that reduces expenses and frees up time for teams to work on more valuable projects. Go to⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ ⁠ramp.com/invest⁠⁠ to sign up for free and get a $250 welcome bonus. ----- Trusted by thousands of businesses, ⁠Vanta⁠ continuously monitors your security posture and streamlines audits so you can win enterprise deals and build customer trust without the traditional overhead. Invest Like the Best listeners get a special offer of $1,000 off Vanta when you go to ⁠vanta.com/invest⁠.  ----- WorkOS⁠ is the infrastructure B2B and AI-native companies use to sell to enterprise. It covers everything enterprise security requires: SSO, SCIM, RBAC, Audit Logs, AI governance, and more. Trusted by 2,000+ fast-growing companies, including OpenAI, Anthropic, Cursor, and Vercel. ----- Rogo is the AI platform for finance. They're building agents for Wall Street that are trained to understand how bankers and investors actually do work: from diligence and modeling, to turning analysis into deliverables. To learn more, visit rogo.ai/invest. ----- ⁠Ridgeline⁠ has built a complete, real-time, modern operating system for investment managers. It handles trading, portfolio management, compliance, customer reporting, and much more through an all-in-one real-time cloud platform. Visit⁠ ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ridgelineapps.com⁠. ----- Editing and post-production work for this episode was provided by The Podcast Consultant (⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://thepodcastconsultant.com⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠). Timestamps: (00:00:00) Welcome to Invest Like The Best (00:02:29) Episode Intro: Krishna Rao (00:03:14) Compute as Anthropic's Lifeblood (00:05:17) Three Fungible Chip Platforms (00:07:31) The Cone of Uncertainty (00:09:08) Competing Ways to Allocate Compute (00:10:36) What Drives Compute Efficiency (00:12:38) Why Frontier Returns Are So High (00:16:32) How Claude Code Writes Its Own Code (00:18:46) Will Talent Become Obsolete? (00:20:07) How Scaling Laws Are Holding (00:21:54) Exponential Thinking (00:23:17) The Layer Cake of Compute (00:26:36) How Anthropic Deploys New Compute (00:27:53) Platform v. Application Layer (00:32:42) Why Model Pricing Has Stayed Stable (00:35:26) Measuring Return on Compute (00:37:22) Working With Chip Providers (00:38:32) How Anthropic's Finance Team Uses Claude (00:41:32) The Jevons Paradox for Labor (00:43:08) Anthropic's Fundraising & Growth Journey (00:47:31) The Exponential Revenue Curve (00:49:02) The Hardest Thing to Explain to Investors (00:52:15) AI's Public Perception Problem (00:55:38) Mythos (00:57:31) Relationship With Government (00:58:51) Inside Anthropic's Culture (01:03:48) The Next Frontier: Virtual Collaborators (01:06:22) How Leaders Scale With a Business (01:10:55) The Biggest Risks to Continued Progress (01:12:09) What Krishna is Excited About  (01:13:45) The Kindest Thing
About Invest Like the Best with Patrick O'Shaughnessy
Invest Like the Best with Patrick O'Shaughnessy

Invest Like the Best with Patrick O'Shaughnessy

By Colossus | Investing & Business Podcasts

Conversations with the best investors and business leaders in the world. We explore their ideas, methods, and stories to help you better invest your time and money. Hear stock market and boardroom insights you can't find anywhere else. If you're a professional investor, CEO, entrepreneur, or business strategist, this is for you. Explore all our episodes and learn more at https://www.joincolossus.com