Patrick T. Fallon / AFP via Getty Images
Justin Sullivan/Getty
- Inference made up 40% of Nvidia's $26.3 billion Q2 data center revenue.
- Inference computing demand will increase as AI matures.
- Companies like Groq and Cerebras are launching inference chips to compete with Nvidia.
In AI hardware circles almost everyone is talking about inference.