Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps

By Karen Simonyan, Andrea Vedaldi, Andrew Zisserman. 2013

8,399 citations recorded by the source corpus.

This paper addresses the visualisation of image classification models, learnt using deep Convolutional Networks (ConvNets). We consider two visualisation techniques, based on computing the gradient of the class score with respect to the input image. The first one generates an image, which maximises the class score [Erhan et al., 2009], thus visualising the notion of the class, captured by a ConvNet. The second technique computes a class saliency map, specific to a given image and class. We show that such maps can be employed for weakly supervised object segmentation using classification ConvNets. Finally, we establish the connection between the gradient-based ConvNet visualisation methods and deconvolutional networks [Zeiler et al., 2013].

Subfields: Biophysics, Computer Vision and Pattern Recognition

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Biophysics

  1. Wojciech Samek
  2. K. Müller
  3. Grgoire Montavon
  4. Andrea Vedaldi
  5. Antonio Torralba
  6. Lior Wolf
  7. Bolei Zhou
  8. Been Kim

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Ming-Hsuan Yang
  4. Trevor Darrell
  5. Xiaogang Wang
  6. Jitendra Malik
  7. Andrew Zisserman
  8. Bernt Schiele

Citations in the corpus