SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size

By Forrest N. Iandola, Matthew W. Moskewicz, Khalid Ashraf, Song Han, William (Bill) J. Dally, Kurt Keutzer. 2016

8,474 citations recorded by the source corpus.

Recent research on deep neural networks has focused primarily on improving accuracy. For a given accuracy level, it is typically possible to identify multiple DNN architectures that achieve that accuracy level. With equivalent accuracy, smaller DNN architectures offer at least three advantages: (1) Smaller DNNs require less communication across servers during distributed training. (2) Smaller DNNs require less bandwidth to export a new model from the cloud to an autonomous car. (3) Smaller DNNs are more feasible to deploy on FPGAs and other hardware with limited memory. To provide all of these advantages, we propose a small DNN architecture called SqueezeNet. SqueezeNet achieves AlexNet-level accuracy on ImageNet with 50x fewer parameters. Additionally, with model compression techniques we are able to compress SqueezeNet to less than 0.5MB (510x smaller than AlexNet). The SqueezeNet architecture is available for download here: this https URL

Subfields: Artificial Intelligence, Efficiency & Compression

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Quoc V. Le
  2. Yoshua Bengio
  3. Mohit Bansal
  4. Jianfeng Gao
  5. Dacheng Tao
  6. Percy Liang
  7. Trevor Darrell
  8. Sergey Levine

In Efficiency & Compression

  1. Song Han
  2. Kurt Keutzer
  3. Jonathan Frankle
  4. Ji Lin
  5. Yunhe Wang
  6. Quoc V. Le
  7. Dan Alistarh
  8. Chuang Gan

Citations in the corpus