Summary

ACE-Step Studio provides a comprehensive, local AI music generation suite, enabling users to create full songs with vocals, covers, and music videos entirely offline. Targeting users with NVIDIA GPUs, it offers a "Suno at home" experience, eliminating subscription fees, API key requirements, and internet dependency, while ensuring data privacy and portability.

How It Works

This studio is built upon the open-source ACE-Step 1.5 XL, a 4 billion parameter DiT music generation model. Its core design emphasizes a 100% local, private execution pipeline, avoiding cloud dependencies by default. Users can select from multiple DiT model variants (XL Turbo, XL SFT, XL Turbo BF16) and leverage integrated local LLMs for lyric generation. Optional cloud services for enhanced lyrics (OpenRouter) and cover art (Pollinations.ai) are available via user-provided API keys, but the system functions fully offline.

Quick Start & Requirements

The recommended installation method is via the Pinokio launcher, which supports Windows, Linux, and macOS, automatically handling Python, Node.js, and PyTorch builds. Alternatively, manual installation on Windows involves cloning the repository, running install.bat (which sets up portable Python 3.12, Node.js 22, and dependencies), followed by run.bat. Key requirements include an NVIDIA GPU (minimum 12GB VRAM, 20GB+ recommended), 16GB RAM (32GB recommended), and 30GB disk space (60GB for all models). Models download on first run (~7.5GB for the default BF16 model).

Highlighted Details

• Full Song Generation: Creates up to 8-minute songs with vocals, lyrics, and music videos, supporting any language and genre.
• Offline & Private: Operates entirely locally, ensuring data privacy and eliminating internet/API key needs.
• Model Flexibility: Features three ACE-Step 1.5 XL DiT models (XL Turbo, XL SFT, XL Turbo BF16) with configurable samplers and schedulers, plus LoRA support.
• Hybrid Cloud Options: Integrates optional cloud LLMs (OpenRouter) for lyrics/metadata and image generation (Pollinations.ai) for covers, with robust local fallbacks.
• Multimedia Suite: Includes a Video Studio with AI visualizers, karaoke LRC subtitles, and aspect ratio support, alongside audio tools like stem extraction (Demucs) and an editor (AudioMass).
• Portability: Designed as a self-contained application, easily copied to USB drives for uninstallation.

Maintenance & Community

Contributions are actively welcomed for bug reports, feature suggestions, and pull requests. Specific areas highlighted for assistance include improving macOS/Linux support, developing new visualizer presets, adding translations, enhancing LoRA training UI, and expanding documentation. The project is maintained by Nerual Dreming and Neiro-Soft.

Licensing & Compatibility

The project is released under the MIT license. This permissive license allows for broad compatibility with commercial use and integration into closed-source projects without significant restrictions.

Limitations & Caveats

The primary adoption blocker is the strict requirement for an NVIDIA GPU with at least 12GB of VRAM. While Pinokio offers cross-platform installation, the manual setup script is Windows-specific. Users opting for enhanced cloud features will need to manage API keys, though free tiers and local alternatives mitigate this.