Qwen-Image-Layered  by QwenLM

Image decomposition model for inherent editability

Created 9 months ago
2,129 stars

Top 20.7% on SourcePulse

GitHubView on GitHub
Project Summary

<2-3 sentences summarising what the project addresses and solves, the target audience, and the benefit.> Qwen-Image-Layered tackles image editing limitations by decomposing images into distinct RGBA layers, enabling inherent editability. This approach allows for high-fidelity, independent manipulation of semantic or structural components—such as resizing, repositioning, and recoloring—offering precise control for researchers and power users.

How It Works

The model employs a layered decomposition strategy, physically isolating image elements into separate RGBA layers. This architectural choice allows for high-fidelity elementary operations—such as resizing, repositioning, and recoloring—on individual layers. The approach supports variable and recursive decomposition, offering flexibility and enabling complex editing workflows with enhanced consistency.

Quick Start & Requirements

  • Installation: Requires transformers>=4.51.3 and the latest diffusers from GitHub, plus python-pptx.
  • Prerequisites: CUDA-enabled GPU with torch.bfloat16 support is recommended.
  • Links: HuggingFace, ModelScope, Research Paper, Blog, Demo Video.
  • Deployment: Gradio interfaces for decomposition (src/app.py) and editing (src/tool/edit_rgba_image.py) are provided.

Highlighted Details

  • Enables inherent image editability through RGBA layer decomposition.
  • Supports high-fidelity elementary operations (resize, reposition, recolor) on isolated layers.
  • Offers flexible, variable, and recursive layer decomposition.
  • Integrates with Qwen-Image-Edit and supports PPTX export for editing.

Maintenance & Community

  • Contributors: The project lists numerous authors in its citation, indicating a research-backed effort.
  • Community: No explicit community channels (Discord, Slack) or roadmap are detailed in the README.

Licensing & Compatibility

  • License: Apache 2.0.
  • Compatibility: Permissive license suitable for commercial use and integration into closed-source projects.

Limitations & Caveats

The released weights are fine-tuned specifically for image-to-multi-RGBA decomposition. While text-conditioned inference is supported, its performance for text-to-multi-RGBA generation is limited, and prompts describe overall image content rather than controlling individual layers explicitly.

Health Check
Last Commit

9 months ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
1
Star History
5 stars in the last 30 days

Explore Similar Projects

Feedback? Help us improve.