Forget-free Continual Learning with Winning Subnetworks

By Haeyong Kang, Rusty John Lloyd Rodriguez Mina, Sultan Rizky Hikmawan Madjid, Jaehong Yoon, Mark Hasegawa-Johnson, Sung Ju Hwang, Chang-Dong Yoo. 2022

173 citations recorded by the source corpus.

Subfields: Meta & Continual Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Meta & Continual Learning

1. Xingxing Zhang
2. Liyuan Wang
3. Hang Su
4. Jun Zhu
5. Simone Scardapane
6. Valerio Marsocci
7. Liyuan Wang
8. Hongwei Yan

Citations in the corpus

• A Comprehensive Survey of Continual Learning: Theory, Method and Application (2023, background): “Within a fixed network architecture, Piggyback [285], HAT [375], SupSup [451], MEAT [466], WSN [198] and H(2) [189] explicitly optimize a binary mask to select dedicated neurons or parameters for each task, with the masked regions of the old tasks (almost) frozen to prevent catastrophic forgetting.”