SillyTavern is a feature-rich, locally-run frontend interface for interacting with various Large Language Models (LLMs) and image generation engines. It empowers AI hobbyists and power users with extensive customization and control over prompts, character interactions, and AI-driven content creation, offering a unified experience across numerous backends.

How It Works

SillyTavern acts as a client, connecting to diverse LLM inference APIs (e.g., KoboldAI, OpenAI, OpenRouter) and image generation APIs (e.g., Automatic1111, ComfyUI). It employs a robust architecture that supports features like character cards for defining AI behavior, World Info for lore management, group chats, and a powerful extension system for added functionality like TTS, auto-translation, and RAG. This modular design allows for deep customization and integration with a wide array of AI services.

Quick Start & Requirements

• Installation: Clone the repository using Git (git clone https://github.com/SillyTavern/SillyTavern -b release) and run Start.bat (Windows) or ./start.sh (Linux/macOS). Docker installation is also supported.
• Prerequisites: NodeJS 18+ is required. For local LLM inference, a 3000-series NVIDIA GPU with 6GB+ VRAM is recommended.
• Resources: Minimal hardware requirements for the interface itself; backend LLM requirements vary.
• Documentation: Official Documentation

Highlighted Details

• Supports over 20 LLM and image generation APIs, including KoboldAI, OpenAI, NovelAI, Automatic1111, and ComfyUI.
• Features extensive customization options for UI, character cards, and prompt engineering.
• Extensible via a third-party extension system for TTS, image generation, web search, and more.
• Includes built-in RAG support for incorporating external documents into chat contexts.

Maintenance & Community

• Active development with over 200 contributors.
• Community support available via a Discord server.
• Development branches include release (stable) and staging (latest features).

Licensing & Compatibility

• Licensed under the GNU Affero General Public License (AGPL).
• Includes MIT licensed components from TavernAI 1.2.8.
• AGPL's copyleft provisions may affect integration with closed-source applications.

Limitations & Caveats

• Installation on Windows 7 is not supported due to NodeJS version requirements.
• Android (Termux) support is unofficial and may require manual dependency installation.
• The AGPL license requires derivative works to also be open-sourced under the same license.