Stable Diffusion WebUI extension for text-to-video generation
Top 31.0% on sourcepulse
This extension integrates text-to-video diffusion models like ModelScope and VideoCrafter into the AUTOMATIC1111 Stable Diffusion WebUI. It enables users to generate videos from text prompts, animate existing images, and loop videos, leveraging existing WebUI dependencies for a streamlined experience.
How It Works
The extension supports multiple text-to-video models, including ModelScope and VideoCrafter, by utilizing their PyTorch implementations. It allows for fine-tuning with LoRAs trained via specific repositories and offers optimizations like Torch2 and xformers for improved VRAM efficiency, enabling longer video generation on consumer hardware.
Quick Start & Requirements
stable-diffusion-webui/models/ModelScope/t2v
).Highlighted Details
Maintenance & Community
Licensing & Compatibility
Limitations & Caveats
VideoCrafter support is noted as Work-In-Progress and requires more maintenance. Prompt weighting is currently only implemented for ModelScope.
1 year ago
Inactive