Machine Unlearning

By Lucas Bourtoule, Varun Chandrasekaran, Christopher A. Choquette-Choo, Hengrui Jia, Adelin Travers, Baiwu Zhang, David Lie, Nicolas Papernot. 2019

1,538 citations recorded by the source corpus.

Once users have shared their data online, it is generally difficult for them to revoke access and ask for the data to be deleted. Machine learning (ML) exacerbates this problem because any model trained with said data may have memorized it, putting users at risk of a successful privacy attack exposing their information. Yet, having models unlearn is notoriously difficult.We introduce SISA training, a framework that expedites the unlearning process by strategically limiting the influence of a data point in the training procedure. While our framework is applicable to any learning algorithm, it is designed to achieve the largest improvements for stateful algorithms like stochastic gradient descent for deep neural networks. SISA training reduces the computational overhead associated with unlearning, even in the worst-case setting where unlearning requests are made uniformly across the training set. In some cases, the service provider may have a prior on the distribution of unlearning requests that will be issued by users. We may take this prior into account to partition and order data accordingly, and further decrease overhead from unlearning.Our evaluation spans several datasets from different domains, with corresponding motivations for unlearning. Under no distributional assumptions, for simple learning tasks, we observe that SISA training improves time to unlearn points from the Purchase dataset by 4.63×, and 2.45× for the SVHN dataset, over retraining from scratch. SISA training also provides a speed-up of 1.36× in retraining for complex learning tasks such as ImageNet classification; aided by transfer learning, this results in a small degradation in accuracy. Our work contributes to practical data governance in machine unlearning.

Subfields: Artificial Intelligence, Management Science and Operations Research, Privacy & Security

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Percy Liang
  2. Luke S. Zettlemoyer
  3. Mohit Bansal
  4. Sergey Levine
  5. Jianfeng Gao
  6. Yoshua Bengio
  7. Quoc V. Le
  8. Ruslan Salakhutdinov

In Management Science and Operations Research

  1. Enrique Herrera-Viedma
  2. Francisco Herrera
  3. Zeshui Xu
  4. Francisco Chiclana
  5. Luis Martínez-López
  6. Seth Neel
  7. Aaron Roth
  8. Luke S. Zettlemoyer

In Privacy & Security

  1. Philip S. Yu
  2. Nicolas Papernot
  3. Lichao Sun
  4. Ananda Theertha Suresh
  5. Jayadev Acharya
  6. Tianhao Wang
  7. Shruti Tople
  8. Seth Neel

Citations in the corpus