Tech Insider
Amazon logo sign displayed outside an office
Amazon won a partial dismissal of a Federal Trade Commission antitrust lawsuit.
Tech Insider
Scott Guthrie
Scott Guthrie is Microsoft's executive vice president of its cloud and AI group.
Tech Insider
three mile island nuclear power plant steam towers GettyImages 110954016
The Three Mile Island nuclear plant in Middletown, Pennsylvania.
Tech Insider
Jensen Huang wih Nvidia hardware
  • Inference made up 40% of Nvidia's $26.3 billion Q2 data center revenue.
  • Inference computing demand will increase as AI matures.
  • Companies like Groq and Cerebras are launching inference chips to compete with Nvidia.

In AI hardware circles almost everyone is talking about inference.