Channel Pruning for Accelerating Very Deep Neural Networks

By Yihui He, Xiangyu Zhang. 2017

2,781 citations recorded by the source corpus.

In this paper, we introduce a new channel pruning method to accelerate very deep convolutional neural networks. Given a trained CNN model, we propose an iterative two-step algorithm to effectively prune each layer, by a LASSO regression based channel selection and least square reconstruction. We further generalize this algorithm to multi-layer and multi-branch cases. Our method reduces the accumulated error and enhance the compatibility with various architectures. Our pruned VGG-16 achieves the state-of-the-art results by 5× speed-up along with only 0.3% increase of error. More importantly, our method is able to accelerate modern networks like ResNet, Xception and suffers only 1.4%, 1.0% accuracy loss under 2× speedup respectively, which is significant.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Efficiency & Compression

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Dacheng Tao
  2. Mohit Bansal
  3. Quoc V. Le
  4. Jianfeng Gao
  5. Yoshua Bengio
  6. Trevor Darrell
  7. Luke S. Zettlemoyer
  8. Percy Liang

In Computer Vision and Pattern Recognition

  1. Dacheng Tao
  2. Luc Van Gool
  3. Yi Yang
  4. Ming-Hsuan Yang
  5. Trevor Darrell
  6. Xiaogang Wang
  7. Jitendra Malik
  8. Alan L. Yuille

In Efficiency & Compression

  1. Song Han
  2. Yang He
  3. Thomas S. Huang
  4. Jiahui Yu
  5. Jonathan Frankle
  6. Yi Yang
  7. Tijmen Blankevoort
  8. Michael Carbin

Citations in the corpus