Sam Altman says local AI inference wastes scarce memory

Photo: Crypto Briefing
OpenAI's CEO argues that running AI on personal devices leaves DRAM sitting idle while data centers could put it to work Sam Altman has a problem with the AI model running on your laptop. It’s not that it doesn’t work. It’s that your computer barely uses the memory it’s hoarding. The OpenAI CEO argued that local inference, meaning AI that runs directly on consumer devices instead of in the cloud, leaves scarce DRAM sitting idle on individual machines. With memory chips in short supply, he framed that idle capacity as something the industry can’t afford.
Source: Crypto Briefing







