Membership Inference Attacks Against Machine Learning Models

By Reza Shokri, Marco Stronati, Congzheng Song, Vitaly Shmatikov. 2016

5,446 citations recorded by the source corpus.

We quantitatively investigate how machine learning models leak information about the individual data records on which they were trained. We focus on the basic membership inference attack: given a data record and black-box access to a model, determine if the record was in the model's training dataset. To perform membership inference against a target model, we make adversarial use of machine learning and train our own inference model to recognize differences in the target model's predictions on the inputs that it trained on versus the inputs that it did not train on. We empirically evaluate our inference techniques on classification models trained by commercial "machine learning as a service" providers such as Google and Amazon. Using realistic datasets and classification tasks, including a hospital discharge dataset whose membership is sensitive from the privacy perspective, we show that these models can be vulnerable to membership inference attacks. We then investigate the factors that influence this leakage and evaluate mitigation strategies.

Subfields: Artificial Intelligence, Safety, Robustness & Interpretability

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Percy Liang
  2. Mohit Bansal
  3. Yoshua Bengio
  4. Jianfeng Gao
  5. Quoc V. Le
  6. Luke S. Zettlemoyer
  7. Sergey Levine
  8. Ruslan Salakhutdinov

In Safety, Robustness & Interpretability

  1. Nicholas Carlini
  2. Nicolas Papernot
  3. Florian Tramèr
  4. Dawn Song
  5. Reza Shokri
  6. Prateek Mittal
  7. Matthias Hein
  8. Bo Li

Citations in the corpus