What exactly is the use-case for a laptop or a tablet with ML acceleration? I can see the need in embedded devices; a self-driving car is a good example. Large-scale AI services are going to run in a datacenter. Who exactly is the target consumer for a laptop or tablet with an NPU?
Look at Apple for some on device examples of this.They’ve been using their ML silicon for photo editing, accessibility stuff, image classification, language, etc.
What exactly is the use-case for a laptop or a tablet with ML acceleration? I can see the need in embedded devices; a self-driving car is a good example. Large-scale AI services are going to run in a datacenter. Who exactly is the target consumer for a laptop or tablet with an NPU?
A person who wants to filter out noise from calls but doesn’t have an Nvidia GPU
A person who wants to translate things, but doesn’t want to send work documents to the internet, etc.
I’m sure Microsoft will respect their privacy…
Who said anything about using Microsoft?
The NPU is inside the machine whether you use windows or Linux
It’s the Microsoft surface. And those NPU optimised networks from Microsoft aren’t available for Linux (yet)
I have no interest in the networks themselves, I want the NPU to use with my programs
With what drivers
Look at Apple for some on device examples of this.They’ve been using their ML silicon for photo editing, accessibility stuff, image classification, language, etc.