MarkDiffusion  by THU-BPM

Latent diffusion model watermarking toolkit

Created 4 months ago
296 stars

Top 89.6% on SourcePulse

GitHubView on GitHub
Project Summary

Summary

MarkDiffusion is an open-source Python toolkit addressing the critical need for generative watermarking in latent diffusion models (LDMs). It provides researchers and developers with a unified framework to easily integrate, visualize, and evaluate watermarking algorithms, thereby simplifying the assessment of generated media authenticity and origin.

How It Works

The toolkit employs a modular architecture designed for streamlined integration of state-of-the-art watermarking algorithms. It comprises a unified implementation framework supporting eleven image and video watermarking methods, a visualization suite to demystify watermark patterns, and a comprehensive evaluation module. This approach offers a standardized way to benchmark detectability, robustness against various attacks, and impact on output quality, facilitating a deeper understanding and comparison of watermarking techniques.

Quick Start & Requirements

Installation is straightforward via pip (pip install markdiffusion[optional]) or conda (conda install markdiffusion from conda-forge). Python 3.11 is recommended. A Google Colab demo is available for immediate exploration. Official documentation and PyPI/conda-forge links are provided for detailed guidance: Home, Paper, Models, Colab, Docs, PyPI, Conda-Forge.

Highlighted Details

  • Supports eleven state-of-the-art watermarking algorithms, categorized into Pattern-based (e.g., Tree-Ring, ROBIN) and Key-based (e.g., Gaussian-Shading, VideoMark).
  • Features 31 evaluation tools for detectability, robustness, and output quality, including 6 automated evaluation pipelines.
  • Includes a suite of image and video attack tools (e.g., compression, masking, frame interpolation) to rigorously test watermark resilience.
  • Offers various image and video quality analyzers (e.g., FID, LPIPS, SSIM, SubjectConsistencyAnalyzer) for comprehensive assessment.

Maintenance & Community

Recent updates indicate active development, including the addition of a comprehensive test suite and CI system. The project actively welcomes contributions and PRs from the community.

Licensing & Compatibility

The specific open-source license is not explicitly stated in the provided README, which requires further investigation for commercial use or integration.

Limitations & Caveats

Some advanced features may necessitate installing additional packages not included in the conda distribution. As a newly released project, it is actively evolving and may be subject to ongoing development and changes.

Health Check
Last Commit

2 weeks ago

Responsiveness

Inactive

Pull Requests (30d)
3
Issues (30d)
1
Star History
123 stars in the last 30 days

Explore Similar Projects

Starred by Dan Abramov Dan Abramov(Core Contributor to React; Coauthor of Redux, Create React App), Patrick von Platen Patrick von Platen(Author of Hugging Face Diffusers; Research Engineer at Mistral), and
57 more.

stable-diffusion by CompVis

0.1%
72k
Latent text-to-image diffusion model
Created 3 years ago
Updated 1 year ago
Feedback? Help us improve.