AubAI is a Flutter/Dart package enabling on-device generative AI, specifically offline text generation, for mobile and desktop applications. It targets Flutter developers seeking to integrate advanced AI capabilities without relying on external services, offering a user-friendly and cross-platform solution.

How It Works

AubAI leverages the llama.cpp C++ library to run AI models locally. This approach is advantageous for its efficiency and ability to operate offline. Developers can easily integrate various GGUF-formatted models from sources like HuggingFace, allowing for flexible AI model selection within their applications.

Quick Start & Requirements

• Install via pubspec.yaml: aub_ai: ^1.0.0
• Requires GGUF model files.
• See YouTube.com/@BrutalCoding for tutorials and examples.

Highlighted Details

• Supports macOS, Windows, Linux, Android, and iOS/iPadOS.
• Enables downloading and running any GGUF model.
• Provides callbacks for token generation during AI responses.
• Modular design aims to support future capabilities like image and voice generation.

Maintenance & Community

The project is primarily driven by BrutalCoding. Community contributions are encouraged via CONTRIBUTING.md. Links to YouTube tutorials are provided for demonstrations and learning.

Licensing & Compatibility

Licensed under AGPL-3.0. A commercial license is available upon contact with daniel@brutalcoding.com for those who cannot comply with AGPL-3.0 terms.

Limitations & Caveats

Android, Windows, and Linux example apps are listed as "Coming soon." The project's sustainability is dependent on the developer finding new employment or funding by early 2024.