fay-ue5  by xszyou

UE5 project for digital human integration

created 2 years ago
592 stars

Top 55.7% on sourcepulse

GitHubView on GitHub
Project Summary

This repository provides a collection of Unreal Engine (UE) projects designed for creating digital humans, compatible with the Fay digital human framework. It targets developers and users aiming for applications like virtual anchors, sales assistants, and interactive AI characters, offering various UE versions and lip-sync solutions.

How It Works

The projects leverage Unreal Engine's capabilities for rendering and animation, integrating with the Fay framework for digital human control. Different versions offer various lip-sync solutions, including Metahuman SDK, das BS offline commercial lip-sync, and phoneme-based animation, driven by audio files, text, or emotion values. This modular approach allows users to select the UE version and lip-sync method best suited for their specific application needs.

Quick Start & Requirements

  • Install/Run: Download project archives from provided Baidu Netdisk links. Some versions offer one-click Windows executables.
  • Prerequisites: Unreal Engine (versions 4.27, 5.0.3, 5.3, 5.4), specific lip-sync solutions (e.g., das bs, Metahuman SDK, Azure Speech), and potentially API keys for services like Azure Speech.
  • Resources: Requires Unreal Engine installation and sufficient disk space for project downloads.

Highlighted Details

  • Offers multiple UE versions (4.27, 5.0.3, 5.3, 5.4) with diverse lip-sync implementations.
  • Includes specific versions with Azure Speech integration for audio, ASR, and driving interfaces.
  • Provides VR runtime packages for some UE 5.0.3 versions.
  • Supports various application scenarios including live streaming and interactive AI.

Maintenance & Community

  • Community discussion is encouraged via a public WeChat account ("fay数字人").
  • Specific versions are updated with new models, improved lip-sync, and enhanced features.

Licensing & Compatibility

  • The repository does not explicitly state a license.
  • The description mentions "offline commercial lip-sync," suggesting potential commercial use for certain components, but the overall project license is unclear.

Limitations & Caveats

The project relies heavily on external download links (Baidu Netdisk) which may have regional access restrictions or be subject to change. The licensing status is not clearly defined, which could impact commercial use. Some versions require specific third-party services or API keys (e.g., Azure Speech).

Health Check
Last commit

7 months ago

Responsiveness

1+ week

Pull Requests (30d)
0
Issues (30d)
0
Star History
32 stars in the last 90 days

Explore Similar Projects

Feedback? Help us improve.