AI's next bottleneck? It might not be GPUs. Memory prices have risen 700% this year, while power, cooling and data transfer are all becoming major constraints on the AI infrastructure buildout. At the same time, the semiconductor industry is approaching the physical limits of simply making transistors smaller.
I sat down with Steven Latré, VP of AI at imec and Thema Board Member, and Adam Chambers of Strike Capital, to talk about what comes after the GPU and where the next wave of value in AI infrastructure could be created.
We get into
› Why memory is already one of AI's biggest bottlenecks
› The power, cooling and data transfer constraints behind inference
› Why photonics could become a critical technology for the next generation of chips
› What happens as Moore's Law approaches the limits of physics
› Why Steven thinks we'll laugh at today's AI in 5–10 years
Steven describes imec as the “hidden gem” of semiconductors. The organization works years ahead of the commercial market, with the world's biggest chip companies coming through its facilities to develop technologies that may not reach the market for another 7–10 years.
His hottest take is that today's LLMs will eventually look like dial-up internet.
“I think we're gonna laugh 5-10 years from now at how old-fashioned AI was today.”
Recorded at the Strike x Sourcery Summit in the South of France.
Steven Latre: https://x.com/slatre
Adam Chambers: https://www.linkedin.com/in/adam-chambers-0b2009274
Molly O’Shea: https://x.com/MollySOShea
Sourcery: https://x.com/sourceryy
𝐄𝐏𝐈𝐒𝐎𝐃𝐄 𝐋𝐈𝐍𝐊
YouTube: https://youtu.be/6-q_8T_m5GM
𝐒𝐏𝐎𝐍𝐒𝐎𝐑𝐒
• Brex—The modern finance platform, combining the world’s smartest corporate card with integrated expense management, banking, bill pay, & travel. https://brex.com/sourcery
• Zone—develops next-generation data center campuses, partnering with AI companies, site developers and technology leaders to bring compute online faster and at scale. Visit: https://zonefrontier.com
• Turing—Turing delivers top-tier talent, data, and tools to help AI labs improve model performance—and enables enterprises to turn those models into powerful, production-ready systems. https://turing.com/sourcery
• VCX—VCX is the public ticker for private tech, allowing investors of all sizes to invest in venture capital. View The Portfolio at http://GetVCX.com
• Deel—Deel is the global people platform that helps startups hire, manage, pay, and equip anyone, anywhere. Trusted by more than 35,000 fast-growing companies, Deel is the people platform that just works, so teams can scale without the chaos. Visit: https://www.deel.com/sourcery
• Public–Investing platform Public just launched Generated Assets, which lets you turn any idea into an investable index with AI. With Generated Assets, you can build, backtest, refine, and invest in any thesis with AI. Gone are the days of one-size-fits-all ETFs. https://public.com/sourcery
Follow Sourcery for the latest updates!
https://www.sourcery.vc
Disclosure
Paid Endorsement. Brokerage services by Open to the Public Investing Inc, member FINRA & SIPC. Advisory services by Public Advisors LLC, SEC-registered adviser. Crypto trading provided by Zero Hash LLC, licensed by the NYSDFS. Generated Assets is an interactive analysis tool by Public Advisors. Output is for informational purposes only and is not an investment recommendation or advice. See disclosures at public.com/disclosures/ga. Matched funds must remain in your account for at least 5 years. Match rate and other terms are subject to change at any time.