Chatbot using LLM and TTS for realistic conversations
Top 36.0% on sourcepulse
CyberWaifu is a realistic chatbot leveraging LLMs and TTS for engaging conversations, primarily targeting QQ users. It aims to provide a more natural and interactive chat experience through features like memory, real-world awareness, and web search integration.
How It Works
The chatbot utilizes LangChain as its core LLM framework, integrating with go-cqhttp for QQ bot deployment. It supports various TTS engines (vits, edge-tts) and LLMs (ChatGPT, Claude). Key features include a "thought chain" for AI decision-making (e.g., adding emojis), a memory database for long-term context via conversation summarization and batch import, and "reality perception" to simulate states like sleeping. Web search is enabled through Google Serper, allowing the AI to autonomously construct search queries.
Quick Start & Requirements
conda create --name CyberWaifu python=3.10.10
), activate it (conda activate CyberWaifu
), and install dependencies (pip install -r requirements.txt
).qqbot/ffmpeg
), Sentence Transformer model (placed in st_model
for Claude support), OpenAI API key or Claude API credentials (user_oauth_token
, bot_id
), and a Google Serper API key.template.ini
(renamed to config.ini
).Highlighted Details
Maintenance & Community
Licensing & Compatibility
Limitations & Caveats
The project is primarily designed for private chat scenarios and does not currently support group chats. The "reality perception" feature's stability is noted as inconsistent. Web search integration is limited to simple factual information due to context length constraints. Support for vits, emotion-vits, bark, and AI image generation are listed as planned features (marked with ⬜).
1 year ago
1 day