Inference Is the New Oil: Who Controls the Pipe

Inference Is the New Oil- And Most of It Is Sitting Idle That single number — flagged by hardware analyst Derek Colley when comparing Trainium3 and Nvidia's NVL72 rack specs — reframes the entire AI infrastructure conversation. Training built the models. Inference is where the money actually prints. And the industry is only just catching up to that reality. The Shift Nobody Announced Then inference quietly ate the workload. McKinsey projects inference will surpass training's share of total AI co