Hyperopt: A Python Library for Optimizing the Hyperparameters of Machine Learning Algorithms

By James Bergstra, Daniel L. K. Yamins, David D. Cox. 2013

808 citations recorded by the source corpus.

Sequential model-based optimization (also known as Bayesian optimization) is one of the most efficient methods (per function evaluation) of function minimization. This efficiency makes it appropriate for optimizing the hyperparameters of machine learning algorithms that are slow to train. The Hyperopt library provides algorithms and parallelization infrastructure for performing hyperparameter optimization (model selection) in Python. This paper presents an introductory tutorial on the usage of the Hyperopt library, including the description of search spaces, minimization (in serial and parallel), and the analysis of the results collected in the course of minimization. The paper closes with some discussion of ongoing and future work.

Subfields: Artificial Intelligence, Computational Theory and Mathematics, Management Science and Operations Research, Neural Architecture Search & AutoML

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Frank Hutter
  2. Marco F. Huber
  3. Marc-André Zöller
  4. Xia Hu
  5. Quoc V. Le
  6. Yoshua Bengio
  7. Mohit Bansal
  8. Katharina Eggensperger

In Computational Theory and Mathematics

  1. Marco F. Huber
  2. Marc-André Zöller
  3. Shuhei Watanabe
  4. Yaochu Jin
  5. Gang Luo
  6. Marius Thomas Lindauer
  7. Frank Hutter
  8. Markus Olhofer

In Management Science and Operations Research

  1. Gang Luo
  2. Marc-André Zöller
  3. Marco F. Huber
  4. Shuhei Watanabe
  5. Katharina Eggensperger
  6. Frank Hutter
  7. Matthias Feurer
  8. Yaochu Jin

In Neural Architecture Search & AutoML

  1. Frank Hutter
  2. Marc-André Zöller
  3. Marco F. Huber
  4. Marius Thomas Lindauer
  5. Katharina Eggensperger
  6. Matthias Feurer
  7. Shuhei Watanabe
  8. James Bergstra

Citations in the corpus