This repository provides native ComfyUI nodes for the Kolors diffusion model, enabling users to leverage its advanced sampling capabilities within the ComfyUI ecosystem. It targets users of ComfyUI seeking to integrate Kolors for image generation, offering specialized nodes for various functionalities like IPAdapter and ControlNet integration.

How It Works

The implementation integrates Kolors' sampling methods directly into ComfyUI's native sampling pipeline. This approach avoids external wrappers, potentially leading to better performance and tighter integration. It supports advanced features by providing dedicated nodes for loading and applying models, including specific nodes for IPAdapter (with FaceID support) and ControlNet, facilitating complex workflows.

Quick Start & Requirements

• Install by placing the repository contents into the ComfyUI custom_nodes directory.
• Requires ComfyUI and ComfyUI_IPAdapter_plus to be updated to their latest versions.
• Specific models (UNET, ChatGLM3, IPAdapter, ControlNet) need to be downloaded and placed in designated folders (models/unet/, models/LLM/, models/ipadapter/, models/clip_vision/, models/insightface/models/antelopev2/).
• Links to model downloads and example workflows are provided in the README.

Highlighted Details

• Native ComfyUI sampler implementation for Kolors.
• Support for IPAdapter, including FaceID integration via ComfyUI_IPAdapter_plus.
• Dedicated nodes for ControlNet loading and patching.
• Includes advanced text encoding nodes (e.g., MZ_ChatGLM3TextEncodeAdvanceV2).
• Recent updates add support for faceid and new ControlNet nodes.

Maintenance & Community

• Active development with recent updates in July/August 2024.
• Mentions a community-contributed Mac fix branch.
• Contact information includes WeChat, Bilibili, and Xiaohongshu.

Licensing & Compatibility

• The repository itself does not explicitly state a license.
• It references other repositories and models, which may have their own licenses. Compatibility with commercial or closed-source projects depends on the licenses of the Kolors model and its dependencies.

Limitations & Caveats

• Explicitly states that Mac users cannot use this version and directs them to a separate fork.
• Some errors require specific dependency updates (e.g., cpm_kernels) or using FP16 model versions.
• Troubleshooting steps are provided for common issues like missing attributes or gradient errors.