AITuberKit is an open-source toolkit for building web applications that enable users to chat with AI characters. It targets individuals and developers looking to create interactive AI experiences, offering extensive customization for dialogue and AITuber streaming functionalities.

How It Works

The application supports various AI services, character models (VRM, Live2D), and speech synthesis engines. It facilitates conversations with AI characters using LLM APIs, incorporating multimodal input (images) and conversation memory. For AITuber streaming, it can process YouTube comments and enable autonomous dialogue.

Quick Start & Requirements

• Install: npm install
• Run: npm run dev
• Requirements: Node.js ^20.0.0, npm ^10.0.0. A .env.example file needs to be copied to .env for configuration.
• Demo: https://aituberkit.com/
• Docs: https://docs.aituberkit.com/

Highlighted Details

• Supports multiple LLMs (OpenAI, Anthropic, Gemini, Groq, etc.) and TTS engines (VOICEVOX, ElevenLabs, etc.).
• Features like Realtime API for low-latency interaction and function execution.
• Includes modes for external integration via WebSocket and AI-driven slide presentations.
• Allows external message reception via a dedicated API for character control.

Maintenance & Community

The project is seeking sponsors for continued development. A list of contributors is available.

Licensing & Compatibility

Version v2.0.0 onwards uses a custom license. Personal, educational, and non-commercial use is free. Commercial use requires a separate commercial license.

Limitations & Caveats

Commercial use requires a separate license, and users are responsible for managing their API keys securely, especially when deploying to production environments. Feature prioritization is available via paid implementation.