
Running inference is currently an 80%+ margin business, while renting compute yields approximately 40% margins. Nvidia GPUs represent a high cost of goods for model companies, giving a significant competitive advantage to those utilizing Tranium and TPU due to their superior cost structures and one-time NRE costs. The author expects cloud companies to see a significant resurgence in strength within two years.