UniPortrait  by junjiehe96

Unified framework for human image personalization

Created 1 year ago
263 stars

Top 96.9% on SourcePulse

GitHubView on GitHub
Project Summary

UniPortrait offers a unified framework for human image personalization, enabling high-fidelity identity preservation across single and multiple subjects. It supports extensive facial editing and free-form text descriptions without requiring predefined layouts, targeting researchers and developers in computer vision and generative AI.

How It Works

UniPortrait integrates ControlNet, IP-Adapter, and StyleAligned within a diffusion model architecture. This approach allows for flexible control over identity and style, leveraging pre-trained models for efficient and high-quality personalization. The framework's unification of single and multi-ID scenarios simplifies complex personalization tasks.

Quick Start & Requirements

  • Install via pip install -r requirements.txt.
  • Requires Git LFS for model downloads.
  • Download models from HuggingFace (specific IP-Adapter models are noted as recommended for manual download).
  • Run the Gradio app with python gradio_app.py.
  • Project page and HuggingFace demo are available.

Highlighted Details

  • Unified framework for single and multi-human image personalization.
  • High-fidelity identity preservation.
  • Extensive facial editability and free-form text description support.
  • Integrates ControlNet, IP-Adapter, and StyleAligned.

Maintenance & Community

The project is actively developed, with recent releases including inference code, demos, and a technical report. Contact is available via email or GitHub issues.

Licensing & Compatibility

The repository's license is not explicitly stated in the README. Compatibility for commercial use or closed-source linking is not specified.

Limitations & Caveats

The project is presented as a recent release with ongoing development, indicating potential for evolving features and stability. Specific model requirements and download instructions suggest a non-trivial setup process.

Health Check
Last Commit

4 months ago

Responsiveness

1 day

Pull Requests (30d)
0
Issues (30d)
0
Star History
7 stars in the last 30 days

Explore Similar Projects

Starred by Patrick von Platen Patrick von Platen(Author of Hugging Face Diffusers; Research Engineer at Mistral), Assaf Elovic Assaf Elovic(Cofounder of Tavily), and
2 more.

facechain by modelscope

0.1%
9k
AI toolchain for generating personalized digital-twin portraits
Created 2 years ago
Updated 3 months ago
Feedback? Help us improve.