This project provides a backend for the ChatGLM-6B large language model, offering a ChatGPT-like UI with streaming output for a more interactive user experience. It targets developers and researchers looking to build conversational AI applications with ChatGLM-6B, enabling features like context-aware dialogue and web search integration.

How It Works

The backend leverages a streaming API approach, inspired by existing projects, to deliver token-by-token responses, mimicking the animation of a live chat. It integrates with the ChatGLM-6B model and includes experimental support for features like web search (via WebGLM) and Markmap for mind map generation. The architecture is designed for extensibility, with a plugin system allowing custom prompt processing and response modification.

Quick Start & Requirements

• Installation: pip install -r requirements.txt
• Prerequisites: Python v3.9.16, Node.js v14.21.3, and a deployed ChatGLM-6B instance. yarn global add markmap-cli for Markmap.
• Running: python api.py (Chat API), python front_end.py (Backend), python gradio_demo.py (Gradio Demo). Frontend requires npm install and yarn dev.
• Links: ChatGLM-6B: https://github.com/THUDM/ChatGLM-6B, Frontend WebUI: https://github.com/LemonQu-GIT/ChatGLM-6B-Engineering/tree/WebUI

Highlighted Details

• ChatGPT-like UI with streaming output.
• Plugin system for custom prompt engineering.
• Integration with web search capabilities.
• Markmap generation for mind maps.

Maintenance & Community

• Contact: QQ: 173887664, QQ Group: 887905095, Email: LemonQu@outlook.com.
• Demo available at https://chat.lemonquapi.tk.

Licensing & Compatibility

• The README does not explicitly state a license for this repository. It references other repositories which may have their own licenses. Compatibility for commercial use or closed-source linking is not specified.

Limitations & Caveats

• Stable Diffusion integration is marked as deprecated.
• The project relies on a separately deployed ChatGLM-6B instance.
• The license is not clearly defined, which may impact commercial use.