MVPaint  by 3DTopia

Synchronized multi-view diffusion for 3D asset texturing

Created 1 year ago
255 stars

Top 98.7% on SourcePulse

GitHubView on GitHub
Project Summary

MVPaint addresses the critical challenge of generating consistent, high-quality textures for 3D assets, overcoming limitations of existing methods like local discontinuities and UV unwrapping dependencies. It targets 3D artists and researchers, offering a framework to enhance visual appeal and diversity with superior multi-view consistency.

How It Works

The framework employs a synchronized multi-view diffusion approach. It first generates simultaneous multi-view images (Synchronized Multi-view Generation - SMG), then inpaints unobserved areas using Spatial-aware 3D Inpainting (S3I). Finally, a UV Refinement (UVR) module enhances texture quality in UV space via super-resolution and seam-smoothing, ensuring seamlessness and cross-view consistency. This multi-stage process tackles inherent issues in generative texturing.

Quick Start & Requirements

Installation involves setting up distinct environments using env_mvdream.sh and env_syncmvd.sh. The system requires downloading multiple pretrained models from Hugging Face, which may incur significant download time on initial runs. A demo pipeline is executable via run_pipeline.sh, necessitating user configuration of paths like CODE_ROOT, CKPT_PATH, and SAMPLE_DIR. Links to the paper, Arxiv, and project page are provided.

Highlighted Details

  • Generates high-resolution, seamless textures with arbitrary UV unwrapping.
  • Achieves high multi-view consistency and minimal Janus issues.
  • Employs a novel generation-refinement framework.
  • Surpasses state-of-the-art methods in experimental results.

Maintenance & Community

A preliminary version was released in July 2025, indicating recent development activity. Community channels and roadmaps are not detailed in the provided documentation.

Licensing & Compatibility

No software license is specified in the provided documentation. This absence poses a significant adoption blocker, particularly for commercial use or integration into proprietary projects.

Limitations & Caveats

The project is presented as a "preliminary version for testing," suggesting potential instability or incomplete features. Setup requires manual path configuration in shell scripts, and initial runs necessitate substantial model downloads. The lack of explicit licensing information is a critical caveat for any adoption decision.

Health Check
Last Commit

9 months ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
0
Star History
3 stars in the last 30 days

Explore Similar Projects

Starred by Yaowei Zheng Yaowei Zheng(Author of LLaMA-Factory), Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and
13 more.

stable-dreamfusion by ashawkey

0.1%
9k
Text-to-3D model using NeRF and diffusion
Created 3 years ago
Updated 2 years ago
Feedback? Help us improve.