The Google AI Edge Gallery is an experimental Android application designed for users and developers to explore, experience, and evaluate cutting-edge generative AI models running entirely on-device. It offers a fully offline, local experience for diverse AI use cases, enabling users to test various models, interact via chat and image prompts, and gain real-time performance insights without requiring an internet connection.

How It Works

This gallery leverages Google AI Edge core APIs and the LiteRT lightweight runtime for optimized on-device machine learning execution. It integrates with Hugging Face for seamless model discovery and download, powering distinct features like "Ask Image" (image Q&A), "Prompt Lab" (text generation, summarization, code generation), and "AI Chat" (multi-turn conversations) through a dedicated LLM Inference API. This architecture prioritizes local processing for enhanced privacy, reduced latency, and offline accessibility.

Quick Start & Requirements

• Install via the latest APK. Detailed installation instructions, including for corporate devices, and a full user guide are available on the Project Wiki.
• Requires an Android device; iOS support is planned.
• Links: Project Wiki, Hugging Face LiteRT Community, LLM Inference guide for Android, Google AI Edge Documentation.

Highlighted Details

• Enables fully offline, on-device generative AI execution, processing all data locally.
• Supports easy switching between diverse models sourced from Hugging Face.
• Key features include "Ask Image" for visual Q&A, "Prompt Lab" for text manipulation and generation, and "AI Chat" for interactive dialogues.
• Provides real-time performance benchmarks, including Time-To-First-Token (TTFT), decode speed, and latency.
• Allows users to test their own custom local LiteRT .task models.

Maintenance & Community

The project is designated as an "experimental Alpha release," actively soliciting user feedback for bug reports and feature suggestions via provided channels. Relevant community resources include the Hugging Face LiteRT Community and the LLM Inference guide for Android.

Licensing & Compatibility

Licensed under the Apache License, Version 2.0, a permissive license suitable for commercial use and integration into proprietary software. Currently supports Android devices; iOS support is explicitly stated as "coming soon."

Limitations & Caveats

The application is in an experimental Alpha stage, suggesting potential instability, missing features, or breaking changes. iOS platform support is not yet available.