iCaRL: Incremental Classifier and Representation Learning

By Sylvestre-Alvise Rebuffi, Alexander Kolesnikov, G. Sperl, Christoph H. Lampert. 2016

4,930 citations recorded by the source corpus.

A major open problem on the road to artificial intelligence is the development of incrementally learning systems that learn about more and more concepts over time from a stream of data. In this work, we introduce a new training strategy, iCaRL, that allows learning in such a class-incremental way: only the training data for a small number of classes has to be present at the same time and new classes can be added progressively. iCaRL learns strong classifiers and a data representation simultaneously. This distinguishes it from earlier works that were fundamentally limited to fixed data representations and therefore incompatible with deep learning architectures. We show by experiments on CIFAR-100 and ImageNet ILSVRC 2012 data that iCaRL can learn many classes incrementally over a long period of time where other strategies quickly fail.

Subfields: Artificial Intelligence, Representation & Self-Supervised Learning, Meta & Continual Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Dacheng Tao
  2. Sergey Levine
  3. Mohit Bansal
  4. Yoshua Bengio
  5. Bernt Schiele
  6. Trevor Darrell
  7. Jianfeng Gao
  8. Bing Liu

In Representation & Self-Supervised Learning

  1. Han-Jia Ye
  2. Dacheng Tao
  3. Trevor Darrell
  4. De-chuan Zhan
  5. Andrea Vedaldi
  6. Tinne Tuytelaars
  7. Bernt Schiele
  8. Joost van de Weijer

In Meta & Continual Learning

  1. Han-Jia Ye
  2. Bing Liu
  3. De-chuan Zhan
  4. Joost van de Weijer
  5. Gyuhak Kim
  6. Bin Liu
  7. Zixuan Ke
  8. Liyuan Wang

Citations in the corpus