Learning a Unified Classifier Incrementally via Rebalancing

By Saihui Hou, Xinyu Pan, Chen Change Loy, Zilei Wang, Dahua Lin. 2019

1,402 citations recorded by the source corpus.

Conventionally, deep neural networks are trained offline, relying on a large dataset prepared in advance. This paradigm is often challenged in real-world applications, e.g. online services that involve continuous streams of incoming data. Recently, incremental learning receives increasing attention, and is considered as a promising solution to the practical challenges mentioned above. However, it has been observed that incremental learning is subject to a fundamental difficulty -- catastrophic forgetting, namely adapting a model to new data often results in severe performance degradation on previous tasks or classes. Our study reveals that the imbalance between previous and new data is a crucial cause to this problem. In this work, we develop a new framework for incrementally learning a unified classifier, e.g. a classifier that treats both old and new classes uniformly. Specifically, we incorporate three components, cosine normalization, less-forget constraint, and inter-class separation, to mitigate the adverse effects of the imbalance. Experiments show that the proposed method can effectively rebalance the training process, thus obtaining superior performance compared to the existing methods. On CIFAR-100 and ImageNet, our method can reduce the classification errors by more than 6% and 13% respectively, under the incremental setting of 10 phases.

Subfields: Artificial Intelligence, Radiology, Nuclear Medicine and Imaging, Meta & Continual Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Han-Jia Ye
  2. De-chuan Zhan
  3. Bernt Schiele
  4. Dacheng Tao
  5. Jun Zhu
  6. Joost van de Weijer
  7. Da-Wei Zhou
  8. Bing Liu

In Radiology, Nuclear Medicine and Imaging

  1. De-chuan Zhan
  2. Han-Jia Ye
  3. Da-Wei Zhou
  4. Bernt Schiele
  5. Christopher Kanan
  6. Tyler L. Hayes
  7. Joost van de Weijer
  8. Matthieu Cord

In Meta & Continual Learning

  1. Han-Jia Ye
  2. De-chuan Zhan
  3. Da-Wei Zhou
  4. Joost van de Weijer
  5. Liyuan Wang
  6. Jun Zhu
  7. Bing Liu
  8. Xingxing Zhang

Citations in the corpus