minimal-chat  by fingerthief

LLM chat interface for local and remote inference

Created 2 years ago
268 stars

Top 95.9% on SourcePulse

GitHubView on GitHub
Project Summary

MinimalChat is a lightweight, open-source chat client designed for interacting with various large language models, including OpenAI, DeepSeek, and custom local endpoints. It targets users seeking a simple, feature-rich, and responsive LLM interface, offering full mobile PWA support for accessibility. The application streamlines LLM interaction by providing a unified client for diverse models, enhancing user productivity and privacy, especially when self-hosting or using local models.

How It Works

MinimalChat functions as a versatile front-end client, supporting any API endpoint that adheres to OpenAI's response format. A key feature is its integration with WebLLM, enabling popular LLM models like Llama-3-8B-Instruct to be downloaded and cached directly within the user's browser. This approach offers significant advantages in terms of privacy, offline usability, and reduced reliance on external servers for model inference.

Quick Start & Requirements

  • Docker: docker pull tannermiddleton/minimal-chat:latest
  • NPM: Install with npm install, build with npm run build, and run with npm run preview (production) or npm run dev (development).
  • Prerequisites: Node.js is required for npm-based installation. For local API servers (e.g., LM Studio, Ollama), proper CORS (Cross-Origin Resource Sharing) configuration is crucial for browser communication.
  • Links: Detailed configuration and WebLLM information are available in the project's Wiki.

Highlighted Details

  • Minimalist, mobile-responsive layout with PWA support.
  • Voiced interactions via Speech-to-Text (STT) and Text-to-Speech (TTS).
  • Supports OpenAI-formatted APIs and WebLLM for in-browser model hosting.
  • Features include mid-conversation model switching, message editing/regeneration/deletion, Markdown support, code syntax highlighting, and basic DALL-E 3 integration.
  • Intuitive mobile swipe gestures for quick access to settings and conversations.

Maintenance & Community

Contributions are welcomed via GitHub Issues and pull requests. Community support and feedback can be directed to GitHub Issues or the project's Discord server (fingerthief#0453).

Licensing & Compatibility

The project is licensed under the MIT License, which permits broad usage, including commercial applications, with minimal restrictions.

Limitations & Caveats

Interaction with certain language models requires valid API keys. Users hosting local API servers must ensure correct CORS configuration to avoid communication issues. The DALL-E 3 integration is described as basic, suggesting limited advanced image generation capabilities.

Health Check
Last Commit

10 months ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
0
Star History
35 stars in the last 30 days

Explore Similar Projects

Starred by Andrej Karpathy Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), Gabriel Almeida Gabriel Almeida(Cofounder of Langflow), and
2 more.

torchchat by pytorch

0.1%
4k
PyTorch-native SDK for local LLM inference across diverse platforms
Created 1 year ago
Updated 4 months ago
Starred by Sourabh Bajaj Sourabh Bajaj(Cofounder of Uplimit), Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and
3 more.

NextChat by ChatGPTNextWeb

0.1%
87k
AI assistant for web, iOS, MacOS, Android, Linux, and Windows
Created 2 years ago
Updated 1 month ago
Feedback? Help us improve.