This project provides a framework for creating AI-driven virtual characters (VTubers) capable of real-time voice chat and interacting with games like Minecraft and Factorio. It targets developers and enthusiasts interested in AI, game integration, and web technologies, offering a flexible, browser-first architecture.

How It Works

AIRI leverages a suite of web technologies including WebGPU, WebAudio, and WebAssembly for in-browser execution, enabling broad accessibility across devices. It integrates with various LLM providers via the xsai library and supports both Live2D and VRM models for character rendering, with features like auto-blink and eye movement for enhanced realism.

Quick Start & Requirements

• Install: pnpm install
• Development: pnpm -F @proj-airi/stage-web dev (Frontend), pnpm -F @proj-airi/stage-tamagotchi dev (Electron App)
• Prerequisites: Node.js, pnpm. Specific game integrations may require game clients.
• Documentation: CONTRIBUTING.md

Highlighted Details

• Browser-first architecture with PWA support for mobile.
• Supports numerous LLM providers including OpenAI, Groq, and Ollama.
• Integrates with games via RCON API (Factorio) and custom agents (Minecraft).
• Includes sub-projects for speech processing (unspeech) and database integration (@proj-airi/drizzle-duckdb-wasm).

Maintenance & Community

• Actively seeking contributors across various disciplines (modeling, CV, RL, speech, web tech).
• Community support via Discord.
• Related projects include Awesome AI VTuber and xsai-transformers.

Licensing & Compatibility

• The primary license is not explicitly stated in the README. Some sub-projects may have different licenses.
• Compatibility for commercial use or closed-source linking is not specified.

Limitations & Caveats

The project is in an early stage of development, with several features marked as "WIP" (Work in Progress) or not yet implemented, such as advanced memory systems and pure in-browser inference. The licensing status requires clarification for commercial adoption.