ComfyUI_ADV_CLIP_emb  by BlenderNeko

ComfyUI nodes for advanced prompt weighting control

created 2 years ago
398 stars

Top 73.8% on sourcepulse

GitHubView on GitHub
Project Summary

This repository provides advanced ComfyUI nodes for fine-grained control over CLIP text prompt weighting and interpretation, targeting users who need to precisely influence image generation based on textual prompts. It offers multiple methods for normalizing token weights and interpreting prompt weighting schemes, enabling more nuanced and predictable results compared to standard ComfyUI implementations.

How It Works

The core innovation lies in the BNK_CLIPTextEncodeAdvanced node, which introduces token_normalization (none, mean, length, length+mean) and weight_interpretation (comfy, A1111, compel, comfy++, down_weight) parameters. These allow users to modify how prompt weights affect CLIP embeddings, moving beyond simple linear interpolation. The length normalization, for instance, distributes weights across tokens of longer words to maintain consistent magnitude changes. The weight_interpretation options mimic or extend established methods like Automatic1111's scaling and Compel's masked embedding mixing for down-weighting, offering greater control over concept emphasis and de-emphasis.

Quick Start & Requirements

  • Install via ComfyUI custom nodes manager or by cloning the repository into the custom_nodes directory.
  • Requires ComfyUI.
  • No specific hardware or software prerequisites beyond a working ComfyUI installation.
  • Official documentation and examples are available within the repository.

Highlighted Details

  • Offers four distinct methods for interpreting prompt weights, including a novel "comfy++" approach.
  • Implements various token normalization strategies to manage weight distribution for longer prompts or embeddings.
  • Includes specialized nodes for SDXL, such as BNK_CLIPTextEncodeSDXLAdvanced with cross-CLIP model balancing and BNK_AddCLIPSDXLParams for detailed conditioning.
  • Visualizations and explanations are provided to illustrate the differences between weighting methods.

Maintenance & Community

  • Developed by BlenderNeko.
  • Active development and community support are indicated by the repository's activity. Links to community channels are not explicitly provided in the README.

Licensing & Compatibility

  • The repository does not explicitly state a license. Users should verify licensing for commercial use or integration into closed-source projects.

Limitations & Caveats

The Mix Clip Embeddings node is marked as deprecated, with its functionality merged into core ComfyUI nodes. The SDXL-specific BNK_AddCLIPSDXLRefinerParams node is primarily for experimentation.

Health Check
Last commit

1 year ago

Responsiveness

1 day

Pull Requests (30d)
0
Issues (30d)
1
Star History
31 stars in the last 90 days

Explore Similar Projects

Feedback? Help us improve.