Qualcomm® Innovators Development Kit - QIDK
Qualcomm® Innovators Development Kit (QIDK) provides sample applications to demonstrate the capability of Hardware Accelerators for AI, and Software AI stack.
This repository contains sample android applications, which are designed to use components from the following products:
- Qualcomm® Neural Processing SDK for AI Also referred to as SNPE
- Qualcomm® AI Engine Direct SDK Also referred to as QNN
- AI Model Efficiency Tool Kit (AIMET)
- AIMET Model Zoo
Contents of this repository are verified on Snapdragon 8 Gen2, and Snapdragon 8 Gen3 platforms. If users want to try this content on other Qualcomm platforms - please do check with the support e-mail mentioned below.
This Repository is divided into following categories
QWA Course - AI on Qualcomm Innovators Development Kit
Qualcomm Wireless Academy has a free course on "AI on Qualcomm Innovators Development Kit".
Course Link : https://qwa.qualcomm.com/course-catalog/AI-on-QIDK
This course is geared toward AI application developers, university students, and AI enthusiasts. This course is applicable, even if a developer is AI SDK on Qualcomm platforms other than QIDK.
All QIDK deliverables are covered in this course in detail with hands-on lab sessions.
Download AI SDK
Please note the change in steps to download AI SDK (Steps in QWA course will be modified later) Users need to follow below procedure do download AI SDK.
- Download sdk from this link https://softwarecenter.qualcomm.com/api/download/software/qualcomm_neural_processing_sdk/v2.25.0.240728.zip
Or
-
Visit qpm.qualcomm.com
-
Download AI SDK for Linux (Linux is the host platform for development, QIDK has Android as target platform)
-
Follow SDK documentation for setup, or refer to QWA course.
-
Once SDK is setup, please revert back to QWA course for model conversion, and deployment.
Examples
Contain examples to use features of above SDKs
| Type | SDK | Details | Link |
|---|---|---|---|
| Model | AI Engine Direct | Model - EnhancementGAN | ReadMe |
| Model | AI Engine Direct | Model - SESR | ReadMe |
| Android App | NA | Python pre/post in Android App | ReadMe |
Model Enablement
Contains examples for :
- Using models, that are not directly supported with AI SDK
- Debug Quantizatin accuracy loss
| Type | SDK | Details | Link |
|---|---|---|---|
| Model Conversion Guide | Neural Processing SDK | Model-Accuracy-Mixed-Precision | ReadMe |
| Model Conversion Guide | Neural Processing SDK | Model-Conversion-Layer-Replacement | ReadMe |
| Model Conversion Guide | Neural Processing SDK | Model-Conversion-UDO-SELU | ReadMe |
Solutions
Contain end-to-end ready-to-run solutions
| Type | Solution | SDK | sdk version | API | Model | ReadMe | Demo |
|---|---|---|---|---|---|---|---|
| NLP | Question Answering | Neural Processing SDK | v2.25.0 | Native API | Electra-small | ReadMe | Demo |
| NLP | Sentiment Analysis | Neural Processing SDK | v2.25.0 | Native API | MobileBERT | ReadMe | Demo |
| NLP | ASR | Neural Processing SDK | v2.25.0 | Native API | Whisper | ReadMe | Demo |
| Vision | Object Detection | Neural Processing SDK | v2.10.0 | Java API | Mobilenet SSD V2 | ReadMe | Demo |
| Vision | Object Detection YoloNAS | Neural Processing SDK | v2.25.0 | Native API | YoloNAS | ReadMe | Demo |
| Vision | Image Super Resolution | Neural Processing SDK | v2.25.0 | Java API | SESR XL | ReadMe | Demo |
| Vision | Image Enhancement | Neural Processing SDK | v2.25.0 | Java API | EnhancedGAN | ReadMe | Demo |
| Vision | Pose Estimation | Neural Processing SDK | v2.25.0 | Native API | YoloNAS + HRNet | ReadMe | Demo |
| Vision | Detection Transformer | Neural Processing SDK | v2.25.0 | Native API | DETR | ReadMe | Demo |
Tools
Contain tools to simplify workflow
| Tool | SDK | Version | Details | Link |
|---|---|---|---|---|
| PySNPE | Neural Processing SDK | - | Python Interface to SDK tools | ReadMe |
| snpe_qnn_docker | Neural Processing SDK & AI Engine Direct |
2.25.0+ | Docker container for SDK | ReadMe |
| snpe-helper | Neural Processing SDK | - | Python wrapper for C++ API | ReadMe |
Report Issues
All deliverables were periodically verified on latest Qualcomm AI Stack SDK releases. Please report any issues in issues section of GitHub repository.
Pls write to qidk@qti.qualcomm.com for any questions/suggestions
Team
Qualcomm Innovators Development Kit (QIDK) software repository is a project maintained by Qualcomm Innovation Center, Inc.
License
Please see the LICENSE for more details.