Goldman CIO Marco Argenti on the Warp-Speed Improvements in AI
Goldman CIO Marco Argenti on the Warp-Speed Improvements in AI
40 days agoOdd LotsBloomberg
Podcast52 min 29 sec
Listen to Episode
Note: AI-generated summary based on third-party content. Not financial advice. Read more.
Quick Insights

Investors should prioritize companies that own "Systems of Record," such as CRMs and General Ledgers, as their proprietary data creates a defensive moat against AI disruption. Be cautious of "Thin" SaaS providers that only offer user interfaces for simple tasks, as these are increasingly being replaced by cheaper, internally built AI tools. NVIDIA (NVDA) remains a high-conviction play because the shift toward "Agentic AI" requires constant background processing, which will drive a massive surge in total token consumption and hardware demand. Goldman Sachs (GS) serves as a prime example of a legacy leader successfully integrating Anthropic and GitHub Copilot to increase developer output and maintain a competitive information advantage. Focus on firms implementing "Model Gateways" to manage costs, as the ability to balance high-end reasoning with cheap local models will be the key to maintaining profit margins through 2026.

Detailed Analysis

Artificial Intelligence (AI) Sector

The discussion highlights a shift from the "age of experimentation" (2022–2024) to the "age of production" (2026). AI is no longer viewed as a "toy" or a simple search function but as a reasoning engine capable of planning and executing complex business workflows.

  • Advanced Reasoning & Agents: The evolution from simple chatbots to "agentic AI" allows systems to plan, schedule, and execute multi-step tasks (e.g., rebooking travel based on delays or rebalancing portfolios based on geopolitical shifts).
  • Data Quality as a Moat: The "determinant between good AI and not so good AI" is curated, high-quality internal data. Companies are moving toward "Lake House" architectures to connect raw data to AI answers in clicks.
  • Token Economics: Large corporations are moving toward centralizing AI access through "Model Gateways." These gateways intelligently route queries to the most cost-effective model (e.g., using a cheap local model for simple questions and a high-end model like Claude or GPT for complex reasoning).

Takeaways

  • Bullish on Infrastructure & Model Providers: Direct partnerships with model creators (e.g., Anthropic) are becoming more valuable than using third-party intermediaries.
  • Focus on "Systems of Record": Companies that own authoritative data (CRMs, General Ledgers) are better positioned to implement AI than those providing mere user interfaces (UX).
  • Investment Theme: Look for companies successfully managing "Token Anxiety" by optimizing the Pareto frontier of quality vs. cost.

Legacy Software & SaaS (Software as a Service)

The transcript suggests a "cycle of renewal" where legacy software is being disrupted by internal AI-driven builds.

  • Buy vs. Build Shift: The cost and time to build internal applications have dropped dramatically. Simple third-party SaaS contracts are already being terminated in favor of internally "vibe-coded" tools.
  • Disruption Risk: Software that is primarily a "UX layer" on simple processes (surveys, expense reports, basic monitoring) is at high risk.
  • Defensive Moats: Highly regulated software (e.g., accounting/closing books) is safer because the underlying processes are rigid and jurisdiction-specific.

Takeaways

  • Bearish on "Thin" SaaS: Legacy providers that do not adapt to agentic workflows may lose market share to internal developer teams.
  • Selective Bullishness: SaaS companies that sit on "Systems of Record" and integrate AI deeply into the data source remain robust.

Goldman Sachs (GS)

Goldman Sachs is positioned as an early adopter, moving beyond experimentation to full-scale deployment across its 47,000-person workforce.

  • GSA Assistant: An internal tool handling over a million prompts per month, used for complex research and client inquiries.
  • Developer Productivity: Every developer is enabled with agentic assistants (e.g., Devin, GitHub Copilot, Cloud Code). This hasn't led to headcount cuts but rather an increase in "output" and projects finishing ahead of schedule.
  • Forward Deployed Engineers: Goldman is utilizing engineers from Anthropic to work directly on-site, bypassing intermediaries to speed up innovation.

Takeaways

  • Efficiency Gains: The firm is using AI to handle "toil" (repetitive tasks like library upgrades or cloud migration), allowing human talent to focus on high-level strategy and "what good looks like."
  • Information Advantage: Goldman maintains its edge through "the extra 10%"—proprietary data, global relationships, and complex asset correlations that public AI models cannot replicate.

NVIDIA (NVDA) / Hardware Hyperscalers

While not the primary focus, the transcript touches on the underlying economics of AI hardware.

  • Token Costs: While per-unit token costs are expected to drop due to GPU power increases and hardware optimization, the total volume of tokens used will likely skyrocket as agentic loops (constant observation and verification) become standard.
  • The "Barber" Analogy: Reference to Jensen Huang’s (NVIDIA CEO) comment that engineers should spend heavily on tokens, suggesting a high ROI on compute spend compared to human wages.

Takeaways

  • Long-term Growth: The shift toward "Agentic AI" (which uses more tokens through constant loops and verifiers) suggests sustained demand for high-performance compute.

Investment Themes & Risks

Themes

  • The Rise of the "Manager-Employee": AI is shifting the required skill set from "doing" to "explaining, delegating, and supervising."
  • Velocity vs. Speed: Large institutions are prioritizing "velocity" (sustained, secure, and scalable progress) over the "speed" of startups that may ignore regulatory or security "walls."

Risks

  • Token Sticker Shock: CFOs may face unexpectedly high bills as AI usage scales across the enterprise.
  • Regulatory Scrutiny: While banks are familiar with "black box" neural networks, the scale of LLMs requires rigorous "Model Risk Management" and human-in-the-loop controls.
  • Information Asymmetry Erosion: AI allows smaller players to reach "90% accuracy" on complex financial questions, potentially pressuring the margins of traditional investment banks.
Ask about this postAnswers are grounded in this post's content.
Episode Description
When we last spoke to Marco Argenti, chief information officer at Goldman Sachs, we were talking about how the bank was deploying AI, including the development of its own internal tools. But that was a year and a half ago and a lot has changed since then, especially with the arrival of agentic platforms like Claude Code. So what exactly is Goldman Sachs doing with AI now? And what has its experience with the new tech been like so far? On this episode, we catch up with Marco to discuss what AI deployment at the bank actually looks like at the moment — including how AI coding is changing the work of its developers and engineers — to all the data challenges and regulatory concerns that come with integrating this technology at scale. Subscribe to the Odd Lots Newsletter Join the conversation: discord.gg/oddlots See omnystudio.com/listener for privacy information.
About Odd Lots
Odd Lots

Odd Lots

By Bloomberg

<p>Bloomberg's Joe Weisenthal and Tracy Alloway explore the most interesting topics in finance, markets and economics. Join the conversation every Monday and Thursday.</p>