This custom ComfyUI node enables loading of NF4 quantized checkpoints, specifically the flux dev and flux schnell variants. It is intended for users of ComfyUI who want to leverage these memory-efficient model formats.

How It Works

The node CheckpointLoaderNF4 directly integrates bitsandbytes functionality into ComfyUI, allowing it to load NF4 quantized models. This approach aims to reduce VRAM usage compared to standard FP16 or FP32 checkpoints, facilitating the use of larger models on less powerful hardware.

Quick Start & Requirements

• Install via ComfyUI Manager (select dev channel) or git clone the repository.
• Requires bitsandbytes installation.
• Ensure ComfyUI is updated.

Highlighted Details

• Supports NF4 quantized checkpoints (flux dev, flux schnell).
• Aims to reduce VRAM requirements.

Maintenance & Community

The project notes that it is "very likely Deprecated in favor of GGUF" and points to city96/ComfyUI-GGUF as a preferred alternative.

Licensing & Compatibility

License information is not specified in the README.

Limitations & Caveats

The project is explicitly marked as likely deprecated, recommending a newer GGUF-based solution. Compatibility is limited to specific NF4 checkpoint variants.