Patrick T. Fallon / AFP via Getty Images
Stefanie Keenan/Getty Images for Village Global; Tsai Hsin-Han/Reuters; Kimberly White/Getty Images for Wired
Tech, AI, Enterprise, nvidia, chips, GPUs, ai-inference
Caroline Brehman / AFP via Getty Images
Caroline Brehman / AFP via Getty Images
Justin Sullivan/Getty
- Inference made up 40% of Nvidia's $26.3 billion Q2 data center revenue.
- Inference computing demand will increase as AI matures.
- Companies like Groq and Cerebras are launching inference chips to compete with Nvidia.
In AI hardware circles almost everyone is talking about inference.