Visualizing and Understanding Convolutional Networks

By Matthew D. Zeiler, Rob Fergus. 2013

17,221 citations recorded by the source corpus.

Large Convolutional Network models have recently demonstrated impressive classification performance on the ImageNet benchmark Krizhevsky et al. [18]. However there is no clear understanding of why they perform so well, or how they might be improved. In this paper we explore both issues. We introduce a novel visualization technique that gives insight into the function of intermediate feature layers and the operation of the classifier. Used in a diagnostic role, these visualizations allow us to find model architectures that outperform Krizhevsky et al on the ImageNet classification benchmark. We also perform an ablation study to discover the performance contribution from different model layers. We show our ImageNet model generalizes well to other datasets: when the softmax classifier is retrained, it convincingly beats the current state-of-the-art results on Caltech-101 and Caltech-256 datasets.

Subfields: Artificial Intelligence, Biophysics, Computer Vision and Pattern Recognition, Safety, Robustness & Interpretability

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yoshua Bengio
  2. Mohit Bansal
  3. Quoc V. Le
  4. Jianfeng Gao
  5. Sergey Levine
  6. Trevor Darrell
  7. Dacheng Tao
  8. Percy Liang

In Biophysics

  1. Wojciech Samek
  2. K. Müller
  3. Andrea Vedaldi
  4. Grgoire Montavon
  5. Lior Wolf
  6. Antonio Torralba
  7. Bolei Zhou
  8. Been Kim

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Ming-Hsuan Yang
  4. Trevor Darrell
  5. Xiaogang Wang
  6. Jitendra Malik
  7. Andrew Zisserman
  8. Yi Yang

In Safety, Robustness & Interpretability

  1. Wojciech Samek
  2. K. Müller
  3. Been Kim
  4. Nicholas Carlini
  5. Matthias Hein
  6. Nicolas Papernot
  7. Longo Luca
  8. Giulia Vilone

Citations in the corpus