ComfyUI-TeaCache  by welltop-cn

ComfyUI extension for inference speedup

created 7 months ago
934 stars

Top 40.1% on sourcepulse

GitHubView on GitHub
Project Summary

This repository provides ComfyUI nodes for ComfyUI-TeaCache, a training-free caching method designed to accelerate inference for diffusion models by leveraging timestep-specific output differences. It targets users of ComfyUI working with image, video, and audio diffusion models, offering significant speedups with minimal quality degradation.

How It Works

TeaCache estimates and caches fluctuating differences in model outputs across diffusion timesteps. This approach avoids recomputing redundant information, leading to faster inference. The integration into ComfyUI is seamless, requiring only node connections within existing workflows.

Quick Start & Requirements

  • Installation: Preferred via ComfyUI-Manager. Manual installation involves cloning the repository into custom_nodes and running pip install -r requirements.txt.
  • Prerequisites: ComfyUI, Python.
  • Usage: Connect the TeaCache node after model loading nodes. Recommended rel_l1_thresh and max_skip_steps values are provided for various models.
  • Documentation: Examples are available in the examples folder.

Highlighted Details

  • Supports a wide range of models including FLUX, PuLID-FLUX, HunyuanVideo, LTX-Video, CogVideoX, and Wan2.1 variants.
  • Achieves speedups ranging from 1.2x to 2.3x, with some configurations offering lossless speedups.
  • Includes a Compile Model node leveraging torch.compile for further inference acceleration.
  • Offers a "retention mode" for Wan2.1 models to improve generation speed and quality.

Maintenance & Community

  • Active development with recent updates in March 2025.
  • Acknowledgments to the original TeaCache repository.

Licensing & Compatibility

  • The repository does not explicitly state a license in the provided README.

Limitations & Caveats

  • The README does not specify a license, which may impact commercial use or integration into closed-source projects.
  • Initial compilation for the Compile Model node can be time-consuming.
Health Check
Last commit

3 weeks ago

Responsiveness

1 day

Pull Requests (30d)
0
Issues (30d)
14
Star History
197 stars in the last 90 days

Explore Similar Projects

Starred by Stas Bekman Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake).

HALOs by ContextualAI

0.5%
877
Library for aligning LLMs using human-aware loss functions
created 1 year ago
updated 3 weeks ago
Starred by Chip Huyen Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems) and Jeremy Howard Jeremy Howard(Cofounder of fast.ai).

GPTFast by MDK8888

0%
685
HF Transformers accelerator for faster inference
created 1 year ago
updated 11 months ago
Starred by Patrick von Platen Patrick von Platen(Core Contributor to Hugging Face Transformers and Diffusers), Travis Fischer Travis Fischer(Founder of Agentic), and
3 more.

consistency_models by openai

0.1%
6k
PyTorch code for consistency models research paper
created 2 years ago
updated 1 year ago
Feedback? Help us improve.