Summary

LingGuo AI is an open-source, one-stop platform for generating AI-powered mini-dramas and motion comics. It automates the entire script-to-video pipeline, addressing complexities like character inconsistency and storyboard control. Aimed at creators and businesses, it significantly lowers the barrier to producing engaging short-form video content, from web novel adaptations to promotional materials.

How It Works

The platform uses a Text-to-Video approach, with LLMs breaking down scripts into storyboard prompts. Character consistency is maintained via advanced LoRA and ControlNet scheduling. It integrates specialized pipelines for vertical short dramas, Japanese anime, and Chinese 3D styles. Features include AI emotional voiceovers with lip-sync, automated post-production (transitions, BGM, SFX), and an extensible plugin system for integrating external large model APIs (SVD, Runway, Sora-class).

Quick Start & Requirements

• Primary Install: Clone repo, set up backend (Go) and frontend (Node.js/pnpm).
• Prerequisites: Go 1.20+, Node.js 18+, MySQL 8.0+, Redis 6.0+, FFmpeg 4.0+ (in PATH).
• Setup: Configure .env for DB/API keys. Run backend (go run main.go serve) and frontend (pnpm run dev). Default admin: admin/123456.
• Links: Official Docs, Demo, and Community channels are mentioned but direct URLs are not provided in the README snippet.

Highlighted Details

• Full script-to-video automation with LLM prompt generation.
• Robust character consistency via LoRA/ControlNet.
• Optimized pipelines for short dramas, anime, and 3D styles.
• AI voiceover with emotional TTS and lip-sync.
• Automated post-production (transitions, BGM, SFX).
• Extensible plugin architecture for external AI video models.

Maintenance & Community

A community-driven project welcoming contributions. Roadmap includes V0.5 (character consistency, anime checkpoint), V1.0 (multilingual, storyboard editor), and V2.0 (Sora/Veo integration). Community channels (Discord/WeChat) are mentioned but not linked.

Licensing & Compatibility

MIT License: Free for commercial/personal use with attribution.

Limitations & Caveats

Advanced features like dedicated character consistency solutions, storyboard editor, and Sora/Veo integration are under development (V0.5, V1.0, V2.0). Users must configure external AI model API keys.