crynux-node  by crynux-network

Node software to share local GPU for AI tasks, earn tokens

created 2 years ago
261 stars

Top 98.0% on sourcepulse

GitHubView on GitHub
Project Summary

Crynux Node enables users to contribute their idle GPU resources to a decentralized network for AI tasks like inference, training, and fine-tuning, earning tokens in return. It targets individuals with spare GPU capacity looking to monetize it and participate in distributed AI computation.

How It Works

The system operates by distributing AI workloads to participating nodes. Nodes download task requirements, execute them using local GPU resources, and report results back to the network. It supports various AI models and tasks, integrating with popular frameworks. The architecture emphasizes modularity, allowing for the addition of new task types and model integrations.

Quick Start & Requirements

  • Installation: Prebuilt packages are available for Windows, Mac, and Docker. Building from source requires Python 3.10, Git, Golang 1.21, Node.js, Yarn, and a C compiler.
  • Setup: Detailed steps involve cloning the repository, setting up Python virtual environments for the server and worker, installing dependencies (including CUDA-specific requirements for GPU acceleration), compiling project modules, and configuring the config.yml file. Building the WebUI involves yarn install and yarn build.
  • Running: Nodes can be started via a desktop GUI (python src/app/main.py) or in headless mode (python -m crynux_server.main run). Docker deployment is also supported.
  • Resources: Requires significant setup time due to multiple component installations and compilations. GPU acceleration is essential for practical use.
  • Documentation: Links to specific instructions for Windows, Mac, and Docker are provided.

Highlighted Details

  • Supports distributed AI inference, training, and fine-tuning.
  • Token-based incentive system for resource contribution.
  • Modular design for extensibility with new AI tasks.
  • Includes a Web UI for node management.

Maintenance & Community

The project is hosted on GitHub. Links to community channels or roadmaps are not explicitly provided in the README.

Licensing & Compatibility

The README does not specify a license. Compatibility for commercial use or closed-source linking is not mentioned.

Limitations & Caveats

The README contains a security warning regarding the Web UI's handling of private keys over unencrypted HTTP connections, recommending configuration file usage or HTTPS. The setup process is complex and requires careful attention to dependency versions and compilation steps.

Health Check
Last commit

1 week ago

Responsiveness

1 day

Pull Requests (30d)
21
Issues (30d)
0
Star History
7 stars in the last 90 days

Explore Similar Projects

Starred by Jeff Hammerbacher Jeff Hammerbacher(Cofounder of Cloudera), Stas Bekman Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake), and
2 more.

gpustack by gpustack

1.6%
3k
GPU cluster manager for AI model deployment
created 1 year ago
updated 2 days ago
Feedback? Help us improve.