ai-hub-apps  by quic

On-device AI apps for Snapdragon

Created 1 year ago
288 stars

Top 91.2% on SourcePulse

GitHubView on GitHub
Project Summary

The Qualcomm® AI Hub Apps repository provides a collection of open-source sample applications and tutorials for deploying machine learning models on Qualcomm® devices. It targets developers looking to optimize on-device AI performance, offering recipes for various ML tasks and end-to-end workflow guidance.

How It Works

The apps leverage Qualcomm® AI Hub Models and support multiple runtimes including TensorFlow Lite, ONNX, and the Genie SDK for generative AI. Deployment targets are Android (API v30+) and Windows 11, with compute options spanning CPU, GPU, and NPU (Hexagon HTP). NPU acceleration requires specific Snapdragon chipsets and FP16 or INT8 precision.

Quick Start & Requirements

To get started, locate the desired OS and app within the repository's folders. Each app's README contains specific build and installation instructions. Supported deployment targets include Android 11 (API v30+) and Windows 11. NPU acceleration is optimized for Snapdragon chipsets (e.g., 8 Elite, 8 Gen 3/2/1, 888/888+).

Highlighted Details

  • Supports TensorFlow Lite, ONNX, and Genie SDK runtimes.
  • Optimized for on-device deployment on Android and Windows.
  • NPU acceleration available on a wide range of Snapdragon chipsets.
  • Includes sample apps for LLMs (GenAI), image classification, object detection, super-resolution, and speech-to-text.

Maintenance & Community

This repository is maintained by Qualcomm. Specific community channels or roadmaps are not detailed in the provided README.

Licensing & Compatibility

The Qualcomm® AI Hub Apps are licensed under BSD-3. This permissive license generally allows for commercial use and integration into closed-source projects.

Limitations & Caveats

While apps run on non-Snapdragon chipsets, NPU acceleration is exclusive to supported Qualcomm hardware. The README does not specify minimum hardware requirements beyond OS compatibility.

Health Check
Last Commit

1 day ago

Responsiveness

1+ week

Pull Requests (30d)
2
Issues (30d)
11
Star History
27 stars in the last 30 days

Explore Similar Projects

Starred by Didier Lopes Didier Lopes(Founder of OpenBB), John Resig John Resig(Author of jQuery; Chief Software Architect at Khan Academy), and
1 more.

launchables by brevdev

0%
2k
Notebook templates for AI/ML tasks
Created 2 years ago
Updated 3 weeks ago
Starred by Anton Bukov Anton Bukov(Cofounder of 1inch Network), Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and
14 more.

exo by exo-explore

0.4%
31k
AI cluster for running models on diverse devices
Created 1 year ago
Updated 6 months ago
Feedback? Help us improve.