MistoLine  by TheMistoAI

SDXL-ControlNet model for line art conditioning

created 1 year ago
550 stars

Top 59.0% on SourcePulse

GitHubView on GitHub
Project Summary

MistoLine is an SDXL-ControlNet model designed for versatile and robust line art conditioning, enabling high-quality image generation from various line art inputs. It targets users working with Stable Diffusion XL who require consistent and accurate line art control across different preprocessing methods, eliminating the need to switch between multiple ControlNet models.

How It Works

MistoLine employs a novel "Anyline" preprocessing algorithm and is retrained on the stabilityai/stable-diffusion-xl-base-1.0 Unet. This approach allows it to generalize across diverse line art conditions, including hand-drawn sketches and model-generated outlines, outperforming existing ControlNet models in detail restoration, prompt alignment, and stability.

Quick Start & Requirements

  • Installation: Download .safetensors files (e.g., mistoLine_rank256.safetensors) and integrate into ComfyUI or AUTOMATIC1111-WebUI workflows.
  • Prerequisites: Compatible with most SDXL models, excluding PlaygroundV2.5, CosXL, and potentially SDXL-Lightning. Can be used with LCM and other ControlNet models.
  • Resources: Recommended ComfyUI parameters include 30 sampler steps, 7.0 CFG, dpmpp_2m_sde sampler, karras scheduler, 0.93 denoise, 1.0 controlnet strength, and 0.0 start percent.
  • Links: HuggingFace Repo: https://huggingface.co/TheMistoAI/MistoLine, ComfyUI Workflow: https://pan.baidu.com/s/1DbZWmGJ40Uzr3Iz9RNBG_w?pwd=8mzs (提取码:8mzs)

Highlighted Details

  • Achieves superior performance across different line art inputs compared to existing ControlNet models.
  • Demonstrates strong generalization capabilities, adapting to various line art conditions without model switching.
  • Maintains consistency with the original ControlNet architecture.
  • mistoLine_rank256.safetensors is noted as performing better than mistoLine_fp16.safetensors.

Maintenance & Community

Licensing & Compatibility

  • License: Custom license with specific usage restrictions and attribution requirements for commercial use.
  • Commercial Use: Requires clear attribution to TheMisto.ai in documentation, websites, or product displays. Prohibits implying endorsement by TheMisto.ai.

Limitations & Caveats

  • Usage is prohibited for illegal activities, harming minors, spreading misinformation, privacy violations, defamation, discrimination, and certain medical or law enforcement applications. Generated content is uncensored and used at the user's own risk.
Health Check
Last commit

1 year ago

Responsiveness

1 day

Pull Requests (30d)
0
Issues (30d)
0
Star History
14 stars in the last 90 days

Explore Similar Projects

Feedback? Help us improve.