Adversarial Shapley Value Experience Replay for Task-Free Continual Learning
By Zheda Mai, Dongsub Shim, Jihwan Jeong, Scott Sanner, Hyunwoo J. Kim, Jongseong Jang. 2020
6 citations recorded by the source corpus.
Continual learning is a branch of deep learning that seeks to strike a balance between learning stability and plasticity. In this paper, we specifically focus on the task-free setting where data are streamed online without task metadata and clear task boundaries. A simple and highly effective algorithm class for this setting is known as Experience Replay (ER) that selectively stores data samples from previous experience and leverages them to interleave memory-based and online batch learning updates. Recent advances in ER have proposed novel methods for scoring which samples to store in memory and which memory samples to interleave with online data during learning updates. In this paper, we contribute a novel Adversarial Shapley value ER (ASER) method that scores memory data samples according to their ability to preserve latent decision boundaries for previously observed classes (to maintain learning stability and avoid forgetting) while interfering with latent decision boundaries of current classes being learned (to encourage plasticity and optimal learning of new class boundaries). Overall, we observe that ASER provides competitive or improved performance on a variety of datasets compared to state-of-the-art ER-based continual learning methods.
Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Infectious Diseases
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
In Computer Vision and Pattern Recognition
In Infectious Diseases
Citations in the corpus
- Online Continual Learning in Image Classification: An Empirical Survey (2021, background): “What differentiate various memory-based methods are the memory retrieval strategy (line 3) [16, 84], model update (line 4) [30, 12] and memory update strategy (line 5) [60, 62, 17].”