WebUI extension for AI video toolkit using AnimateDiff
Top 14.9% on sourcepulse
This extension integrates AnimateDiff, a powerful AI video generation model, into the AUTOMATIC1111 Stable Diffusion WebUI. It targets users of Stable Diffusion WebUI who want to generate animated GIFs and videos directly within their familiar interface, offering a streamlined workflow with advanced features like ControlNet integration and prompt travel.
How It Works
The extension achieves animation by inserting motion modules directly into the UNet model at runtime. This approach avoids the need to reload model weights, allowing for seamless integration and faster iteration. It supports various AnimateDiff models and adapters, including Motion LoRA, Hotshot-XL, and AnimateDiff V3, enabling flexible control over animation style and quality.
Quick Start & Requirements
Highlighted Details
Maintenance & Community
The project is actively maintained, with recent updates (v2.0.0-a, v2.0.1-a) focusing on refactoring and new feature integration. The maintainer is actively developing the extension, aiming to incorporate new research until a superior open-source video model becomes available. They are open to feature requests and contributions.
Licensing & Compatibility
The extension is released under a non-commercial license. Commercial use requires direct contact with the maintainer via email.
Limitations & Caveats
Some advanced features, such as ControlNet per-frame mask and "reference control" features, are designated as "Forge only" due to maintenance complexities with the base WebUI. Users must use specific motion adapter models provided by the maintainer for optimal results.
10 months ago
Inactive