Microsoft has gone all-in with its plans to turn the Windows PC into an AI-powered 'agentic OS.' But at least one PC maker says consumers aren't buying the Copilot hype.
It’s a big matrix multiplier that is tailored for machine learning model evaluation (not training). Often they are low precision as that’s all you need for model evaluation (or “inference”).
Think of it as a much less useful GPU because it won’t do graphics.
The fuck even is an NPU? Is it like a NUC? I guess at least the N in NPU actually means something but I still hate this.
It stands for Neural Processing Unit. It’s a processor for running AI. They multiply lots of small numbers really quickly.
I know what it stands for, it just seems kind of unnecessary and dumb. Maybe there were people saying the same things about GPUs back in the day, idk
It’s a big matrix multiplier that is tailored for machine learning model evaluation (not training). Often they are low precision as that’s all you need for model evaluation (or “inference”).
Think of it as a much less useful GPU because it won’t do graphics.