Benchmark and Survey of Automated Machine Learning Frameworks

By Marc-André Zöller, Marco F. Huber. 2019

449 citations recorded by the source corpus.

Machine learning (ML) has become a vital part in many aspects of our daily life. However, building well performing machine learning applications requires highly specialized data scientists and domain experts. Automated machine learning (AutoML) aims to reduce the demand for data scientists by enabling domain experts to automatically build machine learning applications without extensive knowledge of statistics and machine learning. This paper is a combination of a survey on current AutoML methods and a benchmark of popular AutoML frameworks on real data sets. Driven by the selected frameworks for evaluation, we summarize and review important AutoML techniques and methods concerning every step in building an ML pipeline. The selected AutoML frameworks are evaluated on 137 different data sets.

Subfields: Artificial Intelligence, Evaluation & Benchmarks, Neural Architecture Search & AutoML

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Frank Hutter
  2. Marco F. Huber
  3. Marc-André Zöller
  4. Bernd Bischl
  5. Matthias Feurer
  6. Jan N. van Rijn
  7. Joaquin Vanschoren
  8. Mu Li

In Evaluation & Benchmarks

  1. Frank Hutter
  2. Matthias Feurer
  3. Bernd Bischl
  4. Jan N. van Rijn
  5. Giuseppe Casalicchio
  6. Joaquin Vanschoren
  7. Li Yang
  8. Abdallah Shami

In Neural Architecture Search & AutoML

  1. Matthias Feurer
  2. Jan N. van Rijn
  3. Bernd Bischl
  4. Zhenguo Li
  5. Joaquin Vanschoren
  6. Li Yang
  7. Abdallah Shami
  8. Yujun Li

Citations in the corpus