Eigen-CAM: Class Activation Map using Principal Components

By Mohammed Bany Muhammad, Mohammed Yeasin. IEEE International Joint Conference on Neural Network, 2020

554 citations recorded by the source corpus.

Deep neural networks are ubiquitous due to the ease of developing models and their influence on other domains. At the heart of this progress is convolutional neural networks (CNNs) that are capable of learning representations or features given a set of data. Making sense of such complex models (i.e., millions of parameters and hundreds of layers) remains challenging for developers as well as the end-users. This is partially due to the lack of tools or interfaces capable of providing interpretability and transparency. A growing body of literature, for example, class activation map (CAM), focuses on making sense of what a model learns from the data or why it behaves poorly in a given task. This paper builds on previous ideas to cope with the increasing demand for interpretable, robust, and transparent models. Our approach provides a simpler and intuitive (or familiar) way of generating CAM. The proposed Eigen-CAM computes and visualizes the principle components of the learned features/representations from the convolutional layers. Empirical studies were performed to compare the Eigen-CAM with the state- of-the-art methods (such as Grad-CAM, Grad-CAM++, CNN- fixations) by evaluating on benchmark datasets such as weakly- supervised localization and localizing objects in the presence of adversarial noise. Eigen-CAM was found to be robust against classification errors made by fully connected layers in CNNs, does not rely on the backpropagation of gradients, class relevance score, maximum activation locations, or any other form of weighting features. In addition, it works with all CNN models without the need to modify layers or retrain models. Empirical results show up to 12% improvement over the best method among the methods compared on weakly supervised object localization.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition

View Paper: https://www.semanticscholar.org/paper/a6467813a0b615cb0551b88b695debcf7255553b

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yu Qiao
  2. Xiaosong Jia
  3. Peng Wu
  4. Zhaohui Zheng
  5. Xiang-Yang Li
  6. Li Chen
  7. Junchi Yan
  8. Qibin Hou

In Computer Vision and Pattern Recognition

  1. Qibin Hou
  2. Jian Yang
  3. Yu Qiao
  4. Junchi Yan
  5. Luc Van Gool
  6. Xiang-Yang Li
  7. Hongyang Li
  8. Zhaohui Zheng

Citations in the corpus