Class-Incremental Learning: Survey and Performance Evaluation on Image Classification

By Marc Masana, Xialei Liu, Bartłomiej Twardowski, Mikel Menta, Andrew D. Bagdanov, Joost van de Weijer. 2020

891 citations recorded by the source corpus.

For future learning systems, incremental learning is desirable because it allows for: efficient resource usage by eliminating the need to retrain from scratch at the arrival of new data; reduced memory usage by preventing or limiting the amount of data required to be stored – also important when privacy limitations are imposed; and learning that more closely resembles human learning. The main challenge for incremental learning is catastrophic forgetting, which refers to the precipitous drop in performance on previously learned tasks after learning a new one. Incremental learning of deep neural networks has seen explosive growth in recent years. Initial work focused on task-incremental learning, where a task-ID is provided at inference time. Recently, we have seen a shift towards class-incremental learning where the learner must discriminate at inference time between all classes seen in previous tasks without recourse to a task-ID. In this paper, we provide a complete survey of existing class-incremental learning methods for image classification, and in particular, we perform an extensive experimental evaluation on thirteen class-incremental methods. We consider several new experimental scenarios, including a comparison of class-incremental methods on multiple large-scale image classification datasets, an investigation into small and large domain shifts, and a comparison of various network architectures.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Radiology, Nuclear Medicine and Imaging, Meta & Continual Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Joost van de Weijer
  2. Han-Jia Ye
  3. De-chuan Zhan
  4. Tinne Tuytelaars
  5. Da-Wei Zhou
  6. Bing Liu
  7. Christopher Kanan
  8. Bartłomiej Twardowski

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Bernt Schiele
  4. Trevor Darrell
  5. Yi Yang
  6. Ming-Hsuan Yang
  7. Xiaogang Wang
  8. Jitendra Malik

In Radiology, Nuclear Medicine and Imaging

  1. Joost van de Weijer
  2. Adrian Daniel Popescu
  3. Eden Belouadah
  4. Da-Wei Zhou
  5. De-chuan Zhan
  6. Han-Jia Ye
  7. Gyuhak Kim
  8. Marc Masana

In Meta & Continual Learning

  1. Joost van de Weijer
  2. Bartłomiej Twardowski
  3. Zixuan Ke
  4. Tinne Tuytelaars
  5. Bing Liu
  6. Jiangpeng He
  7. Feng Zhu
  8. Gyuhak Kim

Citations in the corpus