Tune: A Research Platform for Distributed Model Selection and Training

By Richard Liaw, Eric Liang, Robert Nishihara, Philipp Moritz, Joseph E. Gonzalez, Ion Stoica. 2018

1,129 citations recorded by the source corpus.

Modern machine learning algorithms are increasingly computationally demanding, requiring specialized hardware and distributed computation to achieve high performance in a reasonable time frame. Many hyperparameter search algorithms have been proposed for improving the efficiency of model selection, however their adaptation to the distributed compute environment is often ad-hoc. We propose Tune, a unified framework for model selection and training that provides a narrow-waist interface between training scripts and search algorithms. We show that this interface meets the requirements for a broad range of hyperparameter search algorithms, allows straightforward scaling of search to large clusters, and simplifies algorithm implementation. We demonstrate the implementation of several state-of-the-art hyperparameter search algorithms in Tune. Tune is available at this http URL

Subfields: Artificial Intelligence, Neural Architecture Search & AutoML, ML Systems & Hardware

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Quoc V. Le
  2. Yoshua Bengio
  3. Percy Liang
  4. Mohit Bansal
  5. Noah A. Smith
  6. Yejin Choi
  7. Jianfeng Gao
  8. Kyunghyun Cho

In Neural Architecture Search & AutoML

  1. Liam Li
  2. Gaurav Menghani
  3. Ameet Talwalkar
  4. Frank Hutter
  5. Xia Hu
  6. Qingquan Song
  7. B. Recht
  8. Moritz Hardt

In ML Systems & Hardware

  1. Gaurav Menghani
  2. Sanjay Krishnan
  3. Eugene Wu
  4. Pratik Chaudhari
  5. Noah A. Smith
  6. Ameet Talwalkar
  7. Premkumar Natarajan
  8. Jia Deng

Citations in the corpus