Open Models Change The Economics of AI
Open Models Change The Economics of AI
Podcast57 min 15 sec
Listen to Episode
Note: AI-generated summary based on third-party content. Not financial advice. Read more.
Quick Insights

Investors should maintain strong exposure to NVIDIA Corporation (NVDA) to benefit from sustained pricing power on high-end chips like the B200 and B300, alongside new enterprise hardware growth from its desktop DGX Station systems.

Apple Inc. (AAPL) offers a compelling edge-AI play as Apple Silicon drives recurring hardware upgrade cycles by enabling developers to run advanced models locally via the MLX project.

As basic AI generation commoditizes, investors should rotate capital toward the Open-Source AI Infrastructure theme, specifically targeting middleware focused on Model Orchestration and Routing.

Additionally, prioritize enterprise Cybersecurity and Governance software, which is positioned for rapid growth as major corporations like AT&T Inc. (T) shift massive data workloads to open-source models to cut operating costs.

Detailed Analysis

NVIDIA Corporation (NVDA)

  • NVIDIA continues to benefit from massive demand for high-end AI chips like the B200 and B300, where supply volatility and pricing remain high.
  • The company is expanding from cloud data centers into desktop hardware with new workstation products such as the DGX Spark (featuring 128 GB of unified memory) and DGX Station (featuring the GB300 chip).
    • These desktop devices allow businesses and developers to run 20-billion to 120-billion+ parameter open AI models locally without cloud latency.
    • Many enterprise customers, including banks and industrial firms, already maintain tens of thousands of NVIDIA workstation GPUs across engineering teams.
  • NVIDIA maintains an ecosystem moat by actively supporting and optimizing open-source software and model architectures, driving further hardware demand.

Takeaways

  • NVIDIA is well-positioned to capture a secondary hardware cycle as AI workloads shift toward hybrid local-and-cloud execution on desktop AI workstations.
  • High enterprise demand and tight supply for B200/B300 hardware underline sustained near-term pricing power for high-performance computing hardware.

Apple Inc. (AAPL)

  • Apple Silicon architecture (integrated with unified memory) is proving highly effective at running medium-to-large open AI models locally on consumer and pro-grade computers like the MacBook and Mac Studio.
  • The open-source MLX project has matured the software stack for running large language models on Apple hardware, making it a viable lower-cost alternative to dedicated GPU servers for developers.
  • Benchmark parity has advanced rapidly, allowing models that rival frontier closed models for coding to run directly on standard MacBooks.

Takeaways

  • Apple is establishing a strong edge-AI hardware footprint among developers and corporate technical staff, supporting regular hardware upgrade cycles without requiring external cloud inference for everyday tasks.

AT&T Inc. (T)

  • AT&T serves as a leading enterprise case study for cost optimization in AI, having already transitioned 40% of its total AI token consumption to open-source models.
  • The shift is driven primarily by internal coding agents and non-developer automation across finance, marketing, support, and sales.
  • Security and governance remain the primary gating factors for AT&T and similar Fortune 500 enterprises when evaluating foreign or open model architectures.

Takeaways

  • Large legacy enterprises can achieve meaningful operating cost reductions by migrating high-volume, automated AI workloads away from expensive closed models to open-weight models.

Open-Source AI Infrastructure and Model Orchestration (Sector Theme)

  • Enterprise token volume is transitioning rapidly toward open models, with industry estimates suggesting 80% to 90% of total tokens will be handled by open models, while capturing only 10% to 20% of enterprise AI budgets due to lower per-token pricing.
  • Rapidly improving open models (such as DeepSeek Flash, Kimi, and GLM) are closing the performance gap with closed frontier models (from OpenAI and Anthropic) to less than three months.
  • The "five-layer AI stack" is unbundling, creating enterprise opportunities in middleware:
    • Coordination and Routing: Routing engines that delegate simple tasks to cheap open models and reserve complex tasks for frontier models.
    • Memory and Context Management: Stateful systems that store company data outside the model weights.
    • Cybersecurity and Governance: Software tooling that screens and sandboxes open models to mitigate software supply chain risks.

Takeaways

  • Investors and enterprises should anticipate margin pressure on basic AI model generation as token costs trend toward zero, with enterprise value shifting toward orchestration, routing, and data security layers.
Ask about this postAnswers are grounded in this post's content.
Episode Description
Ollama (YC W21) is used by 9 million developers and 85% of the Fortune 500, giving co-founder and CEO Jeffrey Morgan a unique view into which AI models people are actually using and how that’s changing.Right now, the biggest shift he sees is toward open models, driven by coding agents, falling costs, and capabilities that are rapidly catching up to the frontier labs. On Ollama Cloud, that shift has driven a 150x increase in token usage since the start of the year.In this episode of the Lightcone, Jeff joins us to talk about the future of open models and the story behind Ollama, from two years of searching for the right idea to building one of the most widely used AI developer tools in the world.
About Y Combinator Startup Podcast
Y Combinator Startup Podcast

Y Combinator Startup Podcast

By Y Combinator

We help founders make something people want.