quic / ai-hub-apps

The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.
BSD 3-Clause "New" or "Revised" License
65 stars 14 forks source link
deeplearning demos inference inference-api inference-engine machine-learning machinelearning onnx pytorch qnn tensorflow-lite

Qualcomm® AI Hub Apps

Qualcomm® AI Hub Apps

The Qualcomm® AI Hub Apps are a collection of sample machine learning apps ready to deploy on Qualcomm® devices.

Each app is designed to work with one or more models from Qualcomm® AI Hub Models.

With this repository, you can...

Supported runtimes

Supported Deployment Targets

Supported compute units

Chipsets supported for NPU Acceleration

Weight and activation type required for NPU Acceleration:

NOTE: These apps will run without NPU acceleration on non-Snapdragon® chipsets.

Getting Started

  1. Search for your desired OS & app in this folder, or in the app directory at the bottom of this file.

  2. The README of the selected app will contain build & installation instructions.

Android App Directory

Task Language Inference API Special Tags
Image Classification Java TensorFlow Lite
Semantic Segmentation Java TensorFlow Lite OpenCV, Live Camera Feed
Super Resolution Java TensorFlow Lite
WhisperKit (Speech to Text) Various TensorFlow Lite

Windows App Directory

Task Language Inference API Special Tags
Image Classification C++ ONNX OpenCV
Llama 2 Chat C++ ONNX
Object Detection C++ ONNX OpenCV
Super Resolution C++ ONNX OpenCV
Whisper Speech-to-Text Python ONNX

LICENSE

Qualcomm® AI Hub Apps is licensed under BSD-3. See the LICENSE file.