artificial-intelligence

• Inference made up 40% of Nvidia's $26.3 billion Q2 data center revenue.
• Inference computing demand will increase as AI matures.
• Companies like Groq and Cerebras are launching inference chips to compete with Nvidia.

In AI hardware circles almost everyone is talking about inference.