Wide Residual Networks

By Sergey Zagoruyko, Nikos Komodakis. 2016

8,993 citations recorded by the source corpus.

Deep residual networks were shown to be able to scale up to thousands of layers and still have improving performance. However, each fraction of a percent of improved accuracy costs nearly doubling the number of layers, and so training very deep residual networks has a problem of diminishing feature reuse, which makes these networks very slow to train. To tackle these problems, in this paper we conduct a detailed experimental study on the architecture of ResNet blocks, based on which we propose a novel architecture where we decrease depth and increase width of residual networks. We call the resulting network structures wide residual networks (WRNs) and show that these are far superior over their commonly used thin and very deep counterparts. For example, we demonstrate that even a simple 16-layer-deep wide residual network outperforms in accuracy and efficiency all previous deep residual networks, including thousand-layer-deep networks, achieving new state-of-the-art results on CIFAR, SVHN, COCO, and significant improvements on ImageNet. Our code and models are available at this https URL

Subfields: Artificial Intelligence, Civil and Structural Engineering, Computer Vision and Pattern Recognition, Model Architectures

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Quoc V. Le
  2. Yoshua Bengio
  3. Mohit Bansal
  4. Jianfeng Gao
  5. Percy Liang
  6. Sergey Levine
  7. Dacheng Tao
  8. Ruslan Salakhutdinov

In Civil and Structural Engineering

  1. Quoc V. Le
  2. Ekin Dogus Cubuk
  3. Barret Zoph
  4. Samuel L. Smith
  5. Frank Hutter
  6. Shuicheng Yan
  7. Nojun Kwak
  8. Dan Hendrycks

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Ming-Hsuan Yang
  4. Trevor Darrell
  5. Xiaogang Wang
  6. Jitendra Malik
  7. Yi Yang
  8. Alan L. Yuille

In Model Architectures

  1. Quoc V. Le
  2. Yoshua Bengio
  3. Alan L. Yuille
  4. Jiashi Feng
  5. Shuicheng Yan
  6. Barret Zoph
  7. Jianfeng Gao
  8. Dacheng Tao

Citations in the corpus