Taking the Human Out of the Loop: A Review of Bayesian Optimization

By Bobak Shahriari, Kevin Swersky, Ziyun Wang, Ryan P. Adams, Nando de Freitas. 2016

5,660 citations recorded by the source corpus.

Big Data applications are typically associated with systems involving large numbers of users, massive complex software systems, and large-scale heterogeneous computing and storage architectures. The construction of such systems involves many distributed design choices. The end products (e.g., recommendation systems, medical analysis tools, real-time game engines, speech recognizers) thus involve many tunable configuration parameters. These parameters are often specified and hard-coded into the software by various developers or teams. If optimized jointly, these parameters can result in significant improvements. Bayesian optimization is a powerful tool for the joint optimization of design choices that is gaining great popularity in recent years. It promises greater automation so as to increase both product quality and human productivity. This review paper introduces Bayesian optimization, highlights some of its methodological aspects, and showcases a wide range of applications.

Subfields: Artificial Intelligence, Computational Theory and Mathematics, Management Science and Operations Research, Probabilistic & Bayesian Methods, Neural Architecture Search & AutoML

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Quoc V. Le
  2. Sergey Levine
  3. Yoshua Bengio
  4. Mohit Bansal
  5. Jianfeng Gao
  6. Ruslan Salakhutdinov
  7. Pieter Abbeel
  8. Percy Liang

In Computational Theory and Mathematics

  1. Frank Hutter
  2. Aaron Klein
  3. Yaochu Jin
  4. Stefan Falkner
  5. Nando de Freitas
  6. Zoubin Ghahramani
  7. Peter I. Frazier
  8. José Miguel Hernández-Lobato

In Management Science and Operations Research

  1. Frank Hutter
  2. Aaron Klein
  3. Stefan Falkner
  4. Sergey Levine
  5. Marc-André Zöller
  6. Marco F. Huber
  7. Peter I. Frazier
  8. Zoubin Ghahramani

In Probabilistic & Bayesian Methods

  1. Yoshua Bengio
  2. Zoubin Ghahramani
  3. Yee Whye Teh
  4. Frank Hutter
  5. David M. Blei
  6. José Miguel Hernández-Lobato
  7. Richard E. Turner
  8. Ruslan Salakhutdinov

In Neural Architecture Search & AutoML

  1. Frank Hutter
  2. Quoc V. Le
  3. Aaron Klein
  4. Xuanyi Dong
  5. Marc-André Zöller
  6. Marius Thomas Lindauer
  7. Marco F. Huber
  8. Martin Wistuba

Citations in the corpus