fullmoon-ios  by mainframecomputer

iOS app for local LLM chat, optimized for Apple silicon

Created 11 months ago
2,103 stars

Top 21.3% on SourcePulse

GitHubView on GitHub
Project Summary

FullMoon is an iOS application designed for private, local chat with large language models (LLMs) on Apple devices. It targets iPhone, iPad, and Mac users seeking on-device AI interaction with a focus on privacy and customization, leveraging Apple's MLX framework for optimized performance on Apple Silicon.

How It Works

The app utilizes Apple's MLX Swift framework, an array framework specifically built for machine learning research on Apple Silicon. This allows FullMoon to efficiently run LLMs directly on the device, ensuring data privacy as chat history is saved locally. The architecture is optimized for Apple's hardware, promising smooth performance for supported models.

Quick Start & Requirements

  • Install via the App Store.
  • Requires an Apple device (iPhone, iPad, Mac) with Apple Silicon.
  • Supported models include Llama 3.2 1B, Llama 3.2 3B, and DeepSeek-R1-Distill-Qwen-1.5B-4bit.

Highlighted Details

  • Optimized for Apple Silicon performance.
  • Local chat history storage for enhanced privacy.
  • Customizable app appearance.
  • Built using MLX Swift.

Maintenance & Community

Information regarding maintainers, community channels, or roadmaps is not detailed in the provided README.

Licensing & Compatibility

The README does not specify a license. Compatibility for commercial use or closed-source linking is undetermined.

Limitations & Caveats

The app currently supports a limited set of LLM models. Information on broader model compatibility, advanced customization options, or potential performance limitations on older Apple hardware is not provided.

Health Check
Last Commit

4 months ago

Responsiveness

1 week

Pull Requests (30d)
0
Issues (30d)
1
Star History
27 stars in the last 30 days

Explore Similar Projects

Starred by Sourabh Bajaj Sourabh Bajaj(Cofounder of Uplimit), Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and
3 more.

NextChat by ChatGPTNextWeb

0.1%
86k
AI assistant for web, iOS, MacOS, Android, Linux, and Windows
Created 2 years ago
Updated 3 days ago
Feedback? Help us improve.