Ray: A Distributed Framework for Emerging AI Applications

By Philipp Moritz, Robert Nishihara, Stephanie Wang, Alexey Tumanov, Richard Liaw, Eric Liang, William Paul, Michael I. Jordan, Ion Stoica. 2017

1,702 citations recorded by the source corpus.

The next generation of AI applications will continuously interact with the environment and learn from these interactions. These applications impose new and demanding systems requirements, both in terms of performance and flexibility. In this paper, we consider these requirements and present Ray---a distributed system to address them. Ray implements a dynamic task graph computation model that supports both the task-parallel and the actor programming models. To meet the performance requirements of AI applications, we propose an architecture that logically centralizes the system's control state using a sharded storage system and a novel bottom-up distributed scheduler. In our experiments, we demonstrate sub-millisecond remote task latencies and linear throughput scaling beyond 1.8 million tasks per second. We empirically validate that Ray speeds up challenging benchmarks and serves as both a natural and performant fit for an emerging class of reinforcement learning applications and algorithms.

Subfields: Artificial Intelligence, Hardware and Architecture, Information Systems, ML Systems & Hardware

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Sergey Levine
  2. Quoc V. Le
  3. Yoshua Bengio
  4. Mohit Bansal
  5. Pieter Abbeel
  6. Jianfeng Gao
  7. Ruslan Salakhutdinov
  8. Percy Liang

In Hardware and Architecture

  1. Ion Stoica
  2. Anima Anandkumar
  3. Nando de Freitas
  4. Ziyun Wang
  5. Lars Kotthoff
  6. Tom Gibbs
  7. Gabriel Barth-Maron
  8. Dan Belov

In Information Systems

  1. Ion Stoica
  2. Joseph E. Gonzalez
  3. Michael Isard
  4. Pieter Abbeel
  5. Yinmin Zhong
  6. Li Fei-Fei
  7. Michael I. Jordan
  8. B. Recht

In ML Systems & Hardware

  1. Jia Deng
  2. Alejandro Newell
  3. Frank Hutter
  4. Ion Stoica
  5. Joseph E. Gonzalez
  6. Michael I. Jordan
  7. Song Han
  8. Xin Jin

Citations in the corpus