Qualcomm® Innovators Development Kit - QIDK

Qualcomm® Innovators Development Kit (QIDK) provides sample applications to demonstrate the capability of Hardware Accelerators for AI, and Software AI stack.

This repository contains sample android applications, which are designed to use components from the following products:

1. Qualcomm® Neural Processing SDK for AI Also referred to as SNPE
2. Qualcomm® AI Engine Direct SDK Also referred to as QNN
3. AI Model Efficiency Tool Kit (AIMET)
4. AIMET Model Zoo

Contents of this repository are verified on Snapdragon 8 Gen2, and Snapdragon 8 Gen3 platforms. If users want to try this content on other Qualcomm platforms - please do check with the support e-mail mentioned below.

This Repository is divided into following categories

QWA Course - AI on Qualcomm Innovators Development Kit

Qualcomm Wireless Academy has a free course on "AI on Qualcomm Innovators Development Kit".

Course Link : https://qwa.qualcomm.com/course-catalog/AI-on-QIDK

This course is geared toward AI application developers, university students, and AI enthusiasts. This course is applicable, even if a developer is AI SDK on Qualcomm platforms other than QIDK.

All QIDK deliverables are covered in this course in detail with hands-on lab sessions.

Download AI SDK

Please note the change in steps to download AI SDK (Steps in QWA course will be modified later) Users need to follow below procedure do download AI SDK.

1. Download sdk from this link https://softwarecenter.qualcomm.com/api/download/software/qualcomm_neural_processing_sdk/v2.25.0.240728.zip

Or

1. Visit qpm.qualcomm.com

2. Download AI SDK for Linux (Linux is the host platform for development, QIDK has Android as target platform)

   

3. Follow SDK documentation for setup, or refer to QWA course.

4. Once SDK is setup, please revert back to QWA course for model conversion, and deployment.

Examples

Contain examples to use features of above SDKs

Type	SDK	Details	Link
Model	AI Engine Direct	Model - EnhancementGAN	ReadMe
Model	AI Engine Direct	Model - SESR	ReadMe
Android App	NA	Python pre/post in Android App	ReadMe

Model Enablement

Contains examples for :

1. Using models, that are not directly supported with AI SDK
2. Debug Quantizatin accuracy loss

Type	SDK	Details	Link
Model Conversion Guide	Neural Processing SDK	Model-Accuracy-Mixed-Precision	ReadMe
Model Conversion Guide	Neural Processing SDK	Model-Conversion-Layer-Replacement	ReadMe
Model Conversion Guide	Neural Processing SDK	Model-Conversion-UDO-SELU	ReadMe

Solutions

Contain end-to-end ready-to-run solutions

Type	Solution	SDK	sdk version	API	Model	ReadMe	Demo
NLP	Question Answering	Neural Processing SDK	v2.25.0	Native API	Electra-small	ReadMe	Demo
NLP	Sentiment Analysis	Neural Processing SDK	v2.25.0	Native API	MobileBERT	ReadMe	Demo
NLP	ASR	Neural Processing SDK	v2.25.0	Native API	Whisper	ReadMe	Demo
Vision	Object Detection	Neural Processing SDK	v2.10.0	Java API	Mobilenet SSD V2	ReadMe	Demo
Vision	Object Detection YoloNAS	Neural Processing SDK	v2.25.0	Native API	YoloNAS	ReadMe	Demo
Vision	Image Super Resolution	Neural Processing SDK	v2.25.0	Java API	SESR XL	ReadMe	Demo
Vision	Image Enhancement	Neural Processing SDK	v2.25.0	Java API	EnhancedGAN	ReadMe	Demo
Vision	Pose Estimation	Neural Processing SDK	v2.25.0	Native API	YoloNAS + HRNet	ReadMe	Demo
Vision	Detection Transformer	Neural Processing SDK	v2.25.0	Native API	DETR	ReadMe	Demo

Tools

Contain tools to simplify workflow

Tool	SDK	Version	Details	Link
PySNPE	Neural Processing SDK	-	Python Interface to SDK tools	ReadMe
snpe_qnn_docker	Neural Processing SDK & AI Engine Direct	2.25.0+	Docker container for SDK	ReadMe
snpe-helper	Neural Processing SDK	-	Python wrapper for C++ API	ReadMe

Report Issues

All deliverables were periodically verified on latest Qualcomm AI Stack SDK releases. Please report any issues in issues section of GitHub repository.

Pls write to qidk@qti.qualcomm.com for any questions/suggestions

Team

Qualcomm Innovators Development Kit (QIDK) software repository is a project maintained by Qualcomm Innovation Center, Inc.

License

Please see the LICENSE for more details.

Qualcomm Neural Processing SDK, and Qualcomm Innovators Development Kit are products of Qualcomm Technologies, Inc. and/or its subsidiaries. AIMET is a product of Qualcomm Innovation Center, Inc.