Accelerating the Super-Resolution Convolutional Neural Network

By Chao Dong, Chen Change Loy, Xiaoou Tang. 2016

3,453 citations recorded by the source corpus.

As a successful deep model applied in image super-resolution (SR), the Super-Resolution Convolutional Neural Network (SRCNN) [1, 2] has demonstrated superior performance to the previous hand-crafted models either in speed and restoration quality. However, the high computational cost still hinders it from practical usage that demands real-time performance (24 fps). In this paper, we aim at accelerating the current SRCNN, and propose a compact hourglass-shape CNN structure for faster and better SR. We re-design the SRCNN structure mainly in three aspects. First, we introduce a deconvolution layer at the end of the network, then the mapping is learned directly from the original low-resolution image (without interpolation) to the high-resolution one. Second, we reformulate the mapping layer by shrinking the input feature dimension before mapping and expanding back afterwards. Third, we adopt smaller filter sizes but more mapping layers. The proposed model achieves a speed up of more than 40 times with even superior restoration quality. Further, we present the parameter settings that can achieve real-time performance on a generic CPU while still maintaining good performance. A corresponding transfer strategy is also proposed for fast training and testing across different upscaling factors.

Subfields: Computer Vision and Pattern Recognition, Media Technology, Efficiency & Compression

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Ming-Hsuan Yang
  3. Dacheng Tao
  4. Chen Change Loy
  5. Lei Zhang
  6. Radu Timofte
  7. Xiaogang Wang
  8. Trevor Darrell

In Media Technology

  1. Radu Timofte
  2. Chao Dong
  3. Luc Van Gool
  4. Kai Zhang
  5. Lei Zhang
  6. Saeed Anwar
  7. Wangmeng Zuo
  8. Nick Barnes

In Efficiency & Compression

  1. Radu Timofte
  2. Lei Zhang
  3. Luc Van Gool
  4. Chao Dong
  5. Kai Zhang
  6. Yulun Zhang
  7. Wangmeng Zuo
  8. Thomas S. Huang

Citations in the corpus