Auto-Keras: An Efficient Neural Architecture Search System

By Haifeng Jin, Qingquan Song, Xia Hu. 2018

924 citations recorded by the source corpus.

Neural architecture search (NAS) has been proposed to automatically tune deep neural networks, but existing search algorithms, e.g., NASNet, PNAS, usually suffer from expensive computational cost. Network morphism, which keeps the functionality of a neural network while changing its neural architecture, could be helpful for NAS by enabling more efficient training during the search. In this paper, we propose a novel framework enabling Bayesian optimization to guide the network morphism for efficient neural architecture search. The framework develops a neural network kernel and a tree-structured acquisition function optimization algorithm to efficiently explores the search space. Extensive experiments on real-world benchmark datasets have been done to demonstrate the superior performance of the developed framework over the state-of-the-art methods. Moreover, we build an open-source AutoML system based on our method, namely Auto-Keras. The code and documentation are available at https://autokeras.com. The system runs in parallel on CPU and GPU, with an adaptive search strategy for different GPU memory limits.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Efficiency & Compression, Neural Architecture Search & AutoML

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Frank Hutter
  2. Yoshua Bengio
  3. Quoc V. Le
  4. Sergey Levine
  5. Mohit Bansal
  6. Jianfeng Gao
  7. Percy Liang
  8. Dacheng Tao

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Xiaogang Wang
  4. Trevor Darrell
  5. Alan L. Yuille
  6. Jitendra Malik
  7. Bernt Schiele
  8. Ming-Hsuan Yang

In Efficiency & Compression

  1. Marius Thomas Lindauer
  2. Frank Hutter
  3. Jiancheng Yang
  4. Bingbing Ni
  5. Martin Jaggi
  6. Corey Nolet
  7. Joshua Patterson
  8. R. Shi

In Neural Architecture Search & AutoML

  1. Xia Hu
  2. Marius Thomas Lindauer
  3. Qingquan Song
  4. Frank Hutter
  5. Yi-Wei Chen
  6. Corey Nolet
  7. Joshua Patterson
  8. Sebastian Raschka

Citations in the corpus