search

google-ai-edge / mediapipe

Cross-platform, customizable ML solutions for live and streaming media.
https://mediapipe.dev
Apache License 2.0
26.6k stars 5.07k forks source link

NPU Support #5249

Open nskaiser opened 5 months ago

nskaiser commented 5 months ago

MediaPipe Solution (you are using)

Holistic

Programming language

Javascript

Are you willing to contribute it

None

Describe the feature and the current behaviour/state

Utilize NPUs

Will this change the current API? How?

Minimally

Who will benefit with this feature?

Newer "AI Computers" from HP, Dell, etc will start featuring NPUs

Please specify the use cases for this feature

The future of GPUs is NPUs. There is a big push with all the major hardware providers and they are hitting market now. Clients have asked us if our application (which uses Mediapipe) can run on their NPUs.

Any Other info

No response

schmidt-sebastian commented 5 months ago

Thanks for filing this - and we totally agree with you. At this moment, NPU differ greatly among platforms and as such, we cannot yet build a cross-platform framework easily. We have lots of people working on NPU support for our various projects though, so there is some hope :)

nskaiser commented 2 months ago

Hi @schmidt-sebastian , just wondering if there have been any updates to share related to NPU support? Thanks!