DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning

By Zifeng Wang, Zizhao Zhang, Sayna Ebrahimi, Ruoxi Sun, Chen-Yu Lee, Xiaoqi Ren, Guolong Su, Vincent Perot, Jennifer G. Dy, Tomas Pfister. 2022

880 citations recorded by the source corpus.

Continual learning aims to enable a single model to learn a sequence of tasks without catastrophic forgetting. Top-performing methods usually require a rehearsal buffer to store past pristine examples for experience replay, which, however, limits their practical value due to privacy and memory constraints. In this work, we present a simple yet effective framework, DualPrompt, which learns a tiny set of parameters, called prompts, to properly instruct a pre-trained model to learn tasks arriving sequentially without buffering past examples. DualPrompt presents a novel approach to attach complementary prompts to the pre-trained backbone, and then formulates the objective as learning task-invariant and task-specific"instructions". With extensive experimental validation, DualPrompt consistently sets state-of-the-art performance under the challenging class-incremental setting. In particular, DualPrompt outperforms recent advanced continual learning methods with relatively large buffer sizes. We also introduce a more challenging benchmark, Split ImageNet-R, to help generalize rehearsal-free continual learning research. Source code is available at https://github.com/google-research/l2p.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Prompting & Reasoning, Meta & Continual Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Han-Jia Ye
  2. De-chuan Zhan
  3. Jun Zhu
  4. Da-Wei Zhou
  5. Ziwei Liu
  6. Hang Su
  7. Liyuan Wang
  8. Xingxing Zhang

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Bernt Schiele
  4. Han-Jia Ye
  5. Trevor Darrell
  6. De-chuan Zhan
  7. Alan L. Yuille
  8. Ziwei Liu

In Prompting & Reasoning

  1. De-chuan Zhan
  2. Da-Wei Zhou
  3. Han-Jia Ye
  4. Wu-Jun Li
  5. Yan-Shuo Liang
  6. Ziwei Liu
  7. Qiwen Wang
  8. Zhiwu Huang

In Meta & Continual Learning

  1. Han-Jia Ye
  2. De-chuan Zhan
  3. Da-Wei Zhou
  4. Xingxing Zhang
  5. Liyuan Wang
  6. Jun Zhu
  7. Hang Su
  8. Qiwen Wang

Citations in the corpus