ray  by ray-project

AI compute engine for scaling Python and AI applications

created 8 years ago
38,247 stars

Top 0.8% on sourcepulse

GitHubView on GitHub
Project Summary

Ray is a unified framework for scaling AI and Python applications, designed for developers and researchers needing to move workloads from a laptop to a cluster. It provides a core distributed runtime and a suite of AI libraries (Data, Train, Tune, RLlib, Serve) to simplify and accelerate machine learning compute, enabling seamless scaling of Python code without requiring additional infrastructure.

How It Works

Ray's core is a distributed runtime built on key abstractions: Tasks (stateless functions), Actors (stateful processes), and Objects (immutable distributed values). This allows for flexible parallel and distributed execution of Python code. The AI libraries leverage this core to provide specialized, scalable functionalities for data processing, hyperparameter tuning, distributed training, reinforcement learning, and model serving.

Quick Start & Requirements

  • Install with: pip install ray
  • Requirements: Python 3.7+. GPU and CUDA support are available for specific libraries.
  • Documentation: http://docs.ray.io/en/master/

Highlighted Details

  • Unified framework for scaling Python and AI applications.
  • Comprehensive suite of AI libraries: Data, Train, Tune, RLlib, Serve.
  • General-purpose runtime for any Python workload.
  • Includes Ray Dashboard for monitoring and a Distributed Debugger.

Maintenance & Community

  • Active community with Discourse forum, GitHub Issues, and Slack channel.
  • Regular updates and a growing ecosystem of integrations.
  • Twitter: @raydistributed
  • Slack: https://www.ray.io/join-slack

Licensing & Compatibility

  • Apache License 2.0. Permissive for commercial use and closed-source linking.

Limitations & Caveats

While Ray aims for seamless scaling, complex distributed systems can introduce debugging challenges. Performance tuning for specific workloads may require understanding Ray's internal mechanisms and best practices.

Health Check
Last commit

12 hours ago

Responsiveness

1 day

Pull Requests (30d)
667
Issues (30d)
339
Star History
1,580 stars in the last 90 days

Explore Similar Projects

Starred by Peter Norvig Peter Norvig(Author of Artificial Intelligence: A Modern Approach; Research Director at Google), Aravind Srinivas Aravind Srinivas(Cofounder of Perplexity), and
45 more.

tensorflow by tensorflow

0.1%
191k
Open-source ML framework
created 9 years ago
updated 10 hours ago
Feedback? Help us improve.