diffused-texture-addon  by FrederikHasecke

AI-powered texture generation for 3D meshes

Created 1 year ago
252 stars

Top 99.6% on SourcePulse

GitHubView on GitHub
Project Summary

Summary

This Blender add-on integrates Stable Diffusion for direct AI-powered texture generation on 3D meshes. It targets 3D artists and developers seeking to streamline complex texturing workflows by leveraging advanced generative AI models, offering significant creative flexibility and efficiency gains.

How It Works

The add-on functions as a Blender plugin, utilizing HuggingFace's diffusers library and Stable Diffusion models (sd15, sdxl). It supports multiple generation modes, including Text2Image and Image2Image, with parallel or sequential application across mesh views. Novelty lies in its direct mesh-based generation, enhanced by LoRA and IPAdapter integrations for fine-grained style control, and optional ControlNet conditioning (Depth, Canny, Normalmap) based on mesh complexity for detailed results.

Quick Start & Requirements

Installation involves downloading the .zip file, installing it as a Blender add-on, and clicking "Install Dependencies" within the add-on panel, which installs PyTorch and diffusers. A Blender restart is mandatory. Model downloads are optional but recommended (~10.6 GB total); otherwise, models download on-the-fly. A GPU with sufficient VRAM is essential for performance, and CUDA is implicitly required for PyTorch acceleration.

Highlighted Details

  • AI-driven diffuse texture generation directly on 3D models.
  • Supports Text2Image and Image2Image generation modes, with parallel/sequential options.
  • Integrates LoRA and IPAdapter for advanced style conditioning.
  • Leverages ControlNet (Depth, Canny, Normalmap) based on mesh complexity settings.
  • Explicit support for sd15 and sdxl models; flux and qwen are unsupported.

Maintenance & Community

The provided README does not contain information regarding notable contributors, sponsorships, community channels (e.g., Discord, Slack), or a public roadmap.

Licensing & Compatibility

The README does not specify the project's license. Consequently, compatibility for commercial use or closed-source linking cannot be determined from the provided information.

Limitations & Caveats

The add-on explicitly does not support the flux and qwen Stable Diffusion model variants. Users may encounter Blender freezes during long generation tasks, requiring monitoring via the system console. Out-of-GPU-memory errors can occur, necessitating reduced camera counts or closing other GPU-intensive applications. Crashes may require restarting Blender or the system.

Health Check
Last Commit

1 month ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
0
Star History
3 stars in the last 30 days

Explore Similar Projects

Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), Chaoyu Yang Chaoyu Yang(Founder of Bento), and
12 more.

IF by deep-floyd

0.0%
8k
Text-to-image model for photorealistic synthesis and language understanding
Created 3 years ago
Updated 2 years ago
Feedback? Help us improve.