This project provides the Deforum extension for AUTOMATIC1111's Stable Diffusion web UI, enabling users to create animated videos and GIFs from text prompts and various parameters. It targets users of Stable Diffusion who want to generate dynamic, evolving visual content, offering advanced control over animation sequences.

How It Works

The extension integrates Deforum's animation capabilities directly into the Stable Diffusion web UI. It leverages keyframing for prompt evolution, camera movement, and other parameters over time. A notable feature is the enhanced prompt weighting system, allowing for negative weights and split positive/negative prompts using a --neg argument within JSON configurations, offering finer control over image generation dynamics.

Quick Start & Requirements

• Install: Clone the repository into the extensions directory of your AUTOMATIC1111 web UI installation (git clone https://github.com/deforum-art/sd-webui-deforum extensions/deforum) or install via the web UI's Extensions tab. Restart the web UI after installation.
• Prerequisites: AUTOMATIC1111's Stable Diffusion web UI.
• Resource Usage: 3D mode can consume up to 6.4 GB VRAM, reducible to 3.8 GB with the --lowvram argument.
• Documentation: General Guide, Math Keyframing Guide.

Highlighted Details

• Enhanced prompt weighting with negative values and --neg split.
• Option to view animation frames during generation (may slow process).
• Supports 3D mode with depth model loading.
• Direct display of generated video/GIF within the GUI.

Maintenance & Community

• Active community support via Discord: https://discord.gg/deforum.
• Issues can be reported via the GitHub 'Issues' tab.

Licensing & Compatibility

• Licensed under the GNU Affero General Public License v3.0.
• Some integrated third-party components may have different licenses.

Limitations & Caveats

This port is not fully backward-compatible with older Deforum notebook or local versions due to changes in AUTOMATIC1111's web UI model handling and script modifications. Users may encounter unexpected results or breakages with older settings.