
Investors should pivot toward the Retrieval and Model Efficiency layers of the AI stack, as the high cost of running massive LLMs is forcing enterprises like Microsoft (MSFT) and ServiceNow (NOW) to adopt smaller, cheaper models. Consider a bearish long-term outlook on Google (GOOGL), as its ad-based search moat is increasingly bypassed by AI agents that prioritize deep data retrieval over consumer-facing clicks. Monitor private infrastructure plays like Exa that power the "Agentic Economy," as search for AI agents is projected to eventually surpass the current consumer search market in value. Focus on companies with proprietary, "closed" data sets, as high-quality private data will become the primary bottleneck and most valuable asset for AI training and retrieval. Prioritize investments in tools that enable "Semantic Search" and specialized B2B intelligence, which offer a high-growth alternative to traditional keyword-based search engines.
• Exa is a search engine built specifically for AI agents rather than human consumers. • The company focuses on "semantic search" and "retrieval," aiming to provide a more controllable, comprehensive, and high-quality alternative to Google (GOOGL). • Key technical differentiators: • Agent-Centric Design: Unlike humans who want 10 quick results, agents often require thousands of results (1,000 to 10,000) to ensure complete information for complex tasks. • Semantic Handling: The engine can process complex chemical formulas or nuanced business queries that traditional keyword-based search engines struggle to interpret. • Efficiency: Exa claims to save customers up to 20x on token costs by extracting only the most relevant information, allowing smaller, cheaper AI models to perform like larger ones. • Current use cases include Go-To-Market (GTM) intelligence, recruiting, and powering coding agents like Cognition’s Devin.
• Monitor the "Agentic Economy": As AI agents become the primary users of the internet, the infrastructure they use (like Exa) may become more valuable than consumer-facing portals. • B2B Search Opportunity: There is a significant investment theme in "Deep Search" for specialized business needs (e.g., finding every biotech competitor in Asia) where Google currently fails. • Infrastructure over Intelligence: While LLMs are becoming commoditized, the "Retrieval" layer (finding the right data to feed the LLM) is a growing bottleneck and a high-value area for investment.
• The transcript characterizes Google as a "tech monopoly" optimized for human clicks and surface-level consumer answers. • Limitations Mentioned: • Google is optimized for "billions of people" making simple queries, which leads to failure when users (or agents) need to go "really deep" into a topic. • It lacks the "controllable toggles" that AI agents need to filter data by domain, keyword, and semantic meaning simultaneously. • The "click data" advantage Google has built over 20 years is less relevant for training AI agents, potentially neutralizing one of Google's biggest moats.
• Bearish Sentiment on Search Dominance: The rise of AI agents represents a "paradigm shift" that could erode Google's search dominance, as agents don't care about the ads or UI that Google is built around. • Innovator's Dilemma: Google's focus on maintaining its consumer-facing ad model may prevent it from building the high-latency, high-comprehensiveness search tools that the next generation of AI software requires.
• The "Tokenpocalypse": Large companies (e.g., Uber, ServiceNow, Microsoft) are reportedly facing budget constraints due to the high cost of running massive AI models. • Trend Toward Small Models: There is a shift toward using smaller, "hyper-intelligent but unknowledgeable" models (e.g., 1 billion parameters) that use search tools to find facts, rather than storing all world knowledge in their weights. • Commoditization: The CEO predicts that LLMs will commoditize faster than search because open-source models are becoming "good enough" for most knowledge work.
• Investment Shift: Investors should look toward companies that enable "Model Efficiency"—tools that allow businesses to use cheaper, smaller models without sacrificing accuracy. • RL (Reinforcement Learning) Integration: Search tools are becoming a critical part of the "Training" process. Using high-quality search data during Reinforcement Learning leads to more efficient and higher-performing AI agents.
• Search as a Utility: The discussion suggests that by the 2030s, "Agentic Search" (search performed by AI) will be a larger business than the current Google Ads-driven search market. • Data as the Next Bottleneck: As retrieval technology improves, the primary constraint will be "unrecorded data"—information in people's heads, satellite imagery, and private databases that are not yet on the public web. • Monetization of Content: A new "Agentic Economy" could emerge where content providers are paid directly for the value their data provides to AI agents, potentially reaching a $1 trillion annual value.
• Long-term Bullishness on Data Providers: Companies with proprietary, high-quality data sets that are "closed" to the general web may have significant leverage as AI agents seek "perfect" information. • Sector Growth: "Search" is being redefined from a text box to a "coordination layer" for the human species, impacting everything from political polarization to loneliness (social discovery).

By Andreessen Horowitz
The a16z Podcast discusses tech and culture trends, news, and the future – especially as ‘software eats the world’. It features industry experts, business leaders, and other interesting thinkers and voices from around the world. This podcast is produced by Andreessen Horowitz (aka “a16z”), a Silicon Valley-based venture capital firm. Multiple episodes are released every week; visit a16z.com for more details and to sign up for our newsletters and other content as well!