Demand for inference, not training runs, is what drives AI infrastructure spending and its economics.
Watched: 3 source(s) hold a position on this claim, fewer than the four that make it rankable. The disagreement is recorded; the evidence behind it is still thin.
3 source(s) assert this claim, 0 deny it.
Who asserts it
- OpenRouter CEO: Why Chinese Open Models Are Beating the US — 20VC Interview
alex-atallah-openrouter-20vc-interview-2026-08-10 - China, Open Source & AI Competitiveness | Andrew Ng
andrew-ng-open-source-ai-competitiveness-2026-07-29 - Jensen Huang GTC 2026 Keynote — Full Transcript
jensen-huang-gtc-2026-keynote
Every part of AI, every time it has to think, it has to reason, it has to do, it has to generate tokens, it has to inference. It's way tokens, it has to inference. It's way past training now. It's in the in the past training now. It's in the in the field of inference. So the in the field of inference. So the in the inference inflection has arrived inference inflection has arrived at the time when the amount of tokens, the amount of compute necessary the amount of compute necessary increased by roughly 10,000 times.
We wanted to make sure that not only were we good at make sure that not only were we good at training and post-training, that we were training and post-training, that we were incredibly good at every single phase of incredibly good at every single phase of AI, so that the investments that were AI, so that the investments that were made, investments made in our made, investments made in our infrastructure could scale out for as long as they would like to use it. And long as they would like to use it. And the useful life of Nvidia's the useful life of Nvidia's infrastructure would be long.
The amount of computation in the last two years, we know that everybody last two years, we know that everybody in this room knows the computing demand in this room knows the computing demand for Nvidia GPU is off the charts. Spot for Nvidia GPU is off the charts. Spot pricing is skyrocketing. You couldn't pricing is skyrocketing. You couldn't find a GPU if you tried. And yet, in the meantime, we're shipping GPUs out, meantime, we're shipping GPUs out, incredible amounts of it, and demand just keeps on going up. There's a reason for that. This fundamental inflection. for that.
Who denies it
Every quotation on this page was fetched from the archive when the page was built. A quotation the archive cannot supply fails the build, so nothing here is paraphrased and no source is quoted beyond what it actually wrote.