This plugin integrates Unreal Engine with ComfyUI, enabling automatic texture generation for 3D assets using generative diffusion models. It targets game developers and 3D artists seeking to streamline the texturing workflow, offering rapid prototyping and high-quality texture refinement directly within the Unreal Engine editor.

How It Works

The plugin leverages ComfyUI's node-based workflow and diffusion models to generate textures based on selected actors and user-defined parameters. It supports various modes: "Create" for rapid, low-resolution texture generation using SDXL LCM, "Refine" for high-resolution detail using slower SDXL workflows, and "Edit" for inpainting corrections via texture painting or object-based masking. It can connect to local or remote ComfyUI instances.

Quick Start & Requirements

• ComfyUI: Install and download required models (SDXL base/refiner, ControlNet Canny/Depth, LCM LoRA, UltraSharp upscaler) into the ComfyUI models directory.
• Unreal Engine: Clone the repository, generate Visual Studio project files, compile the project, and open the Unreal Engine editor.
• Configuration: Set ComfyUI URL in Project Settings if running remotely. Access the widget via Tools -> Editor Utility Widgets -> Comfy Textures Widget.
• Prerequisites: Unreal Engine 5.x (4.x with minor changes), 16GB+ VRAM recommended for SDXL, 32GB RAM. Meshes require UVs.
• Demo: https://github.com/AlexanderDzhoganov/ComfyTextures/assets/855464/80596dea-e7d9-4fdc-b379-5f8eee11d94b

Highlighted Details

• Supports single point-of-view texture projection with perspective and orthographic cameras.
• Integrates inpainting and image-to-image workflows for texture refinement.
• Allows customization of underlying ComfyUI workflows.
• Offers "Create" (fast SDXL LCM) and "Refine" (detailed SDXL) modes.

Maintenance & Community

• Project is open for contributions via pull requests or issues.
• Discord server available for support and discussion.
• Credits Stability.ai and ComfyUI teams.

Licensing & Compatibility

• License not explicitly stated in the README. Compatibility for commercial use or closed-source linking is undetermined.

Limitations & Caveats

Multiple point-of-view texture projection and batch rendering are marked as Work In Progress (WIP). The README does not specify the project's license, which may impact commercial adoption.