AI to run on CPUs instead of GPUs

[Arthur Hanson]

MSN

Is this real or just hype, any thoughts or comments appreciated

 

[DanX]

If it's for AI inference, it's possible.It's for the privicy.

 

[blueone]

A CPU can do anything a GPU can do. The variation between the two processor types is only performance for a given problem.

 

[KevinK]

There’s definitely going to be inference at the edge, on AI accelerated CPUs and even microcontrollers. But location/host hardware is going to depend on the size of the problem (and associated models) and where the training and reference (RAG and agent support) data is coming from.

Nvidia Thinks It Has a Better Way of Building AI Agents — The Wall Street Journal

The chip giant’s agent-building platform relies on open-source models like those from Meta Platforms and Mistral

apple.news