Squeeze-and-Excitation Networks

By Jie Hu, Li Shen, Samuel Albanie, Gang Sun, Enhua Wu. 2017

35,229 citations recorded by the source corpus.

Convolutional neural networks are built upon the convolution operation, which extracts informative features by fusing spatial and channel-wise information together within local receptive fields. In order to boost the representational power of a network, several recent approaches have shown the benefit of enhancing spatial encoding. In this work, we focus on the channel relationship and propose a novel architectural unit, which we term the "Squeeze-and-Excitation" (SE) block, that adaptively recalibrates channel-wise feature responses by explicitly modelling interdependencies between channels. We demonstrate that by stacking these blocks together, we can construct SENet architectures that generalise extremely well across challenging datasets. Crucially, we find that SE blocks produce significant performance improvements for existing state-of-the-art deep architectures at minimal additional computational cost. SENets formed the foundation of our ILSVRC 2017 classification submission which won first place and significantly reduced the top-5 error to 2.251%, achieving a ~25% relative improvement over the winning entry of 2016. Code and models are available at https://github.com/hujie-frank/SENet.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Model Architectures

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Quoc V. Le
  2. Jianfeng Gao
  3. Yoshua Bengio
  4. Mohit Bansal
  5. Dacheng Tao
  6. Trevor Darrell
  7. Sergey Levine
  8. Percy Liang

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Ming-Hsuan Yang
  4. Xiaogang Wang
  5. Trevor Darrell
  6. Jitendra Malik
  7. Yi Yang
  8. Alan L. Yuille

In Model Architectures

  1. Quoc V. Le
  2. Alan L. Yuille
  3. Jianfeng Gao
  4. Jiashi Feng
  5. Yoshua Bengio
  6. Dacheng Tao
  7. Shuicheng Yan
  8. Luc Van Gool

Citations in the corpus