Can the model be deployed to the Micro NPU in the Sensing Hub?

quic / ai-hub-apps

The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

BSD 3-Clause "New" or "Revised" License

66 stars 15 forks source link

Can the model be deployed to the Micro NPU in the Sensing Hub? #13

Closed AndreaChiChengdu closed 1 week ago

AndreaChiChengdu commented 2 weeks ago

Supported compute units CPU, GPU, NPU (includes hexagon HTP)

Hi, I noticed that my SM8750 sensing hub includes a micro NPU and DSP. Is it supported to deploy on the sensing hub? Thank you.

mestrona-3 commented 1 week ago

HI @AndreaChiChengdu , can you give us a bit more information on your question? Qualcomm AI Hub supports compiling, profiling and inference jobs across various devices, including the SM8750 (Snapdragon 8 Elite). We encourage you to submit a model on this device via AI Hub and you can use our options to target specific compute units. Check out more, here around our --compute_unit flag