modly  by lightningpixel

Local AI for image-to-3D mesh generation

Created 2 months ago
3,739 stars

Top 12.9% on SourcePulse

GitHubView on GitHub
Project Summary

Summary

Modly is a desktop application for Windows and Linux that addresses the need for local, AI-powered 3D model generation from images. It targets engineers, researchers, and power users by enabling the conversion of any photograph into a 3D mesh, with the significant benefit of running entirely on the user's GPU for enhanced privacy and performance.

How It Works

The core approach involves leveraging open-source AI models to perform image-to-3D mesh generation directly on the user's local hardware. This GPU-bound processing avoids reliance on cloud services. Modly features an extension system, allowing users to integrate various external AI models, such as Hunyuan3D, TripoSG, and Trellis2 GGUF, by simply providing their GitHub repository URLs.

Quick Start & Requirements

  • Primary install/run command: Download installers from the Releases page or clone the repository and run launcher.bat (Windows) or ./launcher.sh (Linux).
  • Non-default prerequisites: Node.js for JavaScript dependencies, Python 3 for the backend API, and a compatible GPU are required.
  • Setup: Requires npm install for JS dependencies and pip install -r requirements.txt within the api directory after setting up a Python virtual environment.
  • Links: Releases page (implied).

Highlighted Details

  • Local, open-source, AI-powered image-to-3D mesh generation.
  • Processes entirely on the user's GPU, ensuring data privacy.
  • Supports external AI model extensions, offering flexibility in generation capabilities.
  • Extensions can be installed directly from GitHub repositories.

Maintenance & Community

  • A Discord server is available for community interaction, bug reporting, and feedback.

Licensing & Compatibility

  • License type: MIT License.
  • Notable restrictions: Requires attribution to "Modly by Lightning Pixel" in the application's UI or documentation if the project is forked and built upon.

Limitations & Caveats

macOS support is currently listed as "coming soon," indicating it is not yet available for that platform.

Health Check
Last Commit

5 days ago

Responsiveness

Inactive

Pull Requests (30d)
26
Issues (30d)
11
Star History
1,902 stars in the last 30 days

Explore Similar Projects

Starred by Aravind Srinivas Aravind Srinivas(Cofounder of Perplexity), Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and
13 more.

pytorch3d by facebookresearch

0.1%
10k
PyTorch3D is a PyTorch library for 3D deep learning research
Created 6 years ago
Updated 1 week ago
Feedback? Help us improve.