DeliteAI is an on-device AI platform for building agentic workflows on mobile applications, targeting developers seeking to create privacy-aware, high-performance AI-native experiences. It simplifies AI agent integration for Android and iOS, enabling complex workflows with tool calling, memory, and on-device LLMs through a Python interface.

How It Works

DeliteAI abstracts the complexities of mobile AI development with a unified API and a Python interface for orchestrating agentic workflows. It supports cross-platform compatibility and various compute runtimes like ONNX and ExecuTorch, optimizing for resource-constrained environments with efficient CPU/memory usage and hardware-accelerated model execution for enhanced security and privacy.

Quick Start & Requirements

To get started, users can build the core C++ SDK with Python bindings via coreruntime, or explore the Android/iOS SDK and sample apps. The project supports Python and requires building the C++ core.

Highlighted Details

• On-device processing for privacy-first AI experiences.
• Python interface for orchestrating complex AI agentic workflows.
• Cross-platform compatibility and support for ONNX/ExecuTorch runtimes.
• Optimized for resource-constrained mobile environments.

Maintenance & Community

Community engagement is encouraged via Discord. Contributions are welcomed for new Python operators, runtime enhancements, documentation, and bug reporting.

Licensing & Compatibility

This project is licensed under the Apache License 2.0, permitting commercial use and integration with closed-source applications.

Limitations & Caveats

The README focuses on core features and getting started with the SDK; detailed performance benchmarks or specific hardware requirements beyond general mobile optimization are not immediately apparent.