ray-project / ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://ray.io
Apache License 2.0
31.9k stars 5.44k forks source link
automl data-science deep-learning deployment distributed hyperparameter-optimization hyperparameter-search java llm-serving machine-learning model-selection optimization parallel python pytorch ray reinforcement-learning rllib serving tensorflow

.. image:: https://github.com/ray-project/ray/raw/master/doc/source/images/ray_header_logo.png

.. image:: https://readthedocs.org/projects/ray/badge/?version=master :target: http://docs.ray.io/en/master/?badge=master

.. image:: https://img.shields.io/badge/Ray-Join%20Slack-blue :target: https://forms.gle/9TSdDYUgxYs8SA9e8

.. image:: https://img.shields.io/badge/Discuss-Ask%20Questions-blue :target: https://discuss.ray.io/

.. image:: https://img.shields.io/twitter/follow/raydistributed.svg?style=social&logo=twitter :target: https://twitter.com/raydistributed

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI libraries for simplifying ML compute:

.. image:: https://github.com/ray-project/ray/raw/master/doc/source/images/what-is-ray-padded.svg

.. https://docs.google.com/drawings/d/1Pl8aCYOsZCo61cmp57c7Sja6HhIygGCvSZLi_AuBuqo/edit

Learn more about Ray AI Libraries_:

Or more about Ray Core_ and its key abstractions:

Monitor and debug Ray applications and clusters using the Ray dashboard <https://docs.ray.io/en/latest/ray-core/ray-dashboard.html>__.

Ray runs on any machine, cluster, cloud provider, and Kubernetes, and features a growing ecosystem of community integrations_.

Install Ray with: pip install ray. For nightly wheels, see the Installation page <https://docs.ray.io/en/latest/installation.html>__.

.. Serve: https://docs.ray.io/en/latest/serve/index.html .. Data: https://docs.ray.io/en/latest/data/dataset.html .. Workflow: https://docs.ray.io/en/latest/workflows/concepts.html .. Train: https://docs.ray.io/en/latest/train/train.html .. Tune: https://docs.ray.io/en/latest/tune/index.html .. RLlib: https://docs.ray.io/en/latest/rllib/index.html .. _ecosystem of community integrations: https://docs.ray.io/en/latest/ray-overview/ray-libraries.html

Why Ray?

Today's ML workloads are increasingly compute-intensive. As convenient as they are, single-node development environments such as your laptop cannot scale to meet these demands.

Ray is a unified way to scale Python and AI applications from a laptop to a cluster.

With Ray, you can seamlessly scale the same code from a laptop to a cluster. Ray is designed to be general-purpose, meaning that it can performantly run any kind of workload. If your application is written in Python, you can scale it with Ray, no other infrastructure required.

More Information

Older documents:

.. Ray AI Libraries: https://docs.ray.io/en/latest/ray-air/getting-started.html .. Ray Core: https://docs.ray.io/en/latest/ray-core/walkthrough.html .. Tasks: https://docs.ray.io/en/latest/ray-core/tasks.html .. Actors: https://docs.ray.io/en/latest/ray-core/actors.html .. Objects: https://docs.ray.io/en/latest/ray-core/objects.html .. Documentation: http://docs.ray.io/en/latest/index.html .. Ray Architecture v1 whitepaper: https://docs.google.com/document/d/1lAy0Owi-vPz2jEqBSaHNQcy2IBSDEHyXNOQZlGuj93c/preview .. Ray Architecture whitepaper: https://docs.google.com/document/d/1tBw9A4j62ruI5omIJbMxly-la5w4q_TjyJgJL_jN2fI/preview .. Exoshuffle: large-scale data shuffle in Ray: https://arxiv.org/abs/2203.05072 .. Ownership: a distributed futures system for fine-grained tasks: https://www.usenix.org/system/files/nsdi21-wang.pdf .. Ray paper: https://arxiv.org/abs/1712.05889 .. Ray HotOS paper: https://arxiv.org/abs/1703.03924 .. RLlib paper: https://arxiv.org/abs/1712.09381 .. Tune paper: https://arxiv.org/abs/1807.05118

Getting Involved

.. list-table:: :widths: 25 50 25 25 :header-rows: 1

.. Discourse Forum: https://discuss.ray.io/ .. GitHub Issues: https://github.com/ray-project/ray/issues .. StackOverflow: https://stackoverflow.com/questions/tagged/ray .. Meetup Group: https://www.meetup.com/Bay-Area-Ray-Meetup/ .. Twitter: https://twitter.com/raydistributed .. Slack: https://forms.gle/9TSdDYUgxYs8SA9e8