This project provides an AI-powered virtual streamer (VUP) that can interact with viewers on Bilibili and Douyin live streams. It aims to automate viewer engagement, respond to chat messages and donations, and even perform actions based on viewer behavior, enhancing the interactivity of live streams for creators.

How It Works

The system utilizes a producer-consumer model for efficient processing. It integrates with OpenAI's GPT-3.5 API for natural language understanding and response generation, leveraging OpenAI embeddings for context. For advanced features like voice interaction and action triggering, it relies on libraries such as pyaudio, speech_recognition, and pyvts, connecting to VTube Studio for avatar animation and lip-sync.

Quick Start & Requirements

• Install: Clone the repository, navigate to the src directory, and run pip install -r requirements.txt.
• Prerequisites: Python 3.8, Windows 10, VPN for global proxy. For advanced features: pyaudio, speech_recognition, keyboard, pyvts, Milvus 2.0 (Docker), MySQL.
• Configuration: Rename config.sample.ini to config.ini and set api_key and proxy.
• Running: python manager.py run bilibili (for Bilibili) or python manager.py run douyin (for Douyin).
• Docs: Bilibili VTube Studio Tutorial

Highlighted Details

• Supports Bilibili and Douyin live stream platforms.
• Features optional plugins for speech interaction, scheduled events, and VTube Studio actions.
• Context plugin requires Milvus and MySQL for advanced conversational memory.
• Allows customization of VUP's initial persona via system_template.

Maintenance & Community

The project is marked as "stopped maintenance" by the author, who recommends a new project, Langup. No community links (Discord, Slack) are provided.

Licensing & Compatibility

The README does not explicitly state a license. The project uses libraries with various licenses, and users should verify compatibility for commercial use.

Limitations & Caveats

The project is explicitly stated as "stopped maintenance." The context plugin has significant setup requirements including Dockerized Milvus and a MySQL environment. Action plugin requires manual confirmation pop-ups from VTube Studio.