Single Path One-Shot Neural Architecture Search with Uniform Sampling

By Zichao Guo, Xiangyu Zhang, Haoyuan Mu, Wen Heng, Zechun Liu, Yichen Wei. 2019

1,036 citations recorded by the source corpus.

We revisit the one-shot Neural Architecture Search (NAS) paradigm and analyze its advantages over existing NAS approaches. Existing one-shot method, however, is hard to train and not yet effective on large scale datasets like ImageNet. This work propose a Single Path One-Shot model to address the challenge in the training. Our central idea is to construct a simplified supernet, where all architectures are single paths so that weight co-adaption problem is alleviated. Training is performed by uniform path sampling. All architectures (and their weights) are trained fully and equally. Comprehensive experiments verify that our approach is flexible and effective. It is easy to train and fast to search. It effortlessly supports complex search spaces (e.g., building blocks, channel, mixed-precision quantization) and different search constraints (e.g., FLOPs, latency). It is thus convenient to use for various needs. It achieves start-of-the-art performance on the large dataset ImageNet.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Neural Architecture Search & AutoML

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Quoc V. Le
  2. Dacheng Tao
  3. Jianfeng Gao
  4. Mohit Bansal
  5. Yoshua Bengio
  6. Trevor Darrell
  7. Jiashi Feng
  8. Alan L. Yuille

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Xiaogang Wang
  4. Ming-Hsuan Yang
  5. Alan L. Yuille
  6. Trevor Darrell
  7. Chunhua Shen
  8. Yi Yang

In Neural Architecture Search & AutoML

  1. Quoc V. Le
  2. Quanming Yao
  3. Xiaojun Chang
  4. Xiaodan Liang
  5. Song Han
  6. Bo Zhang
  7. Frank Hutter
  8. Xiangxiang Chu

Citations in the corpus