Automated Experiments on Ad Privacy Settings

By Amit Datta, Michael Carl Tschantz, Anupam Datta. 2014

784 citations recorded by the source corpus.

Abstract To partly address people’s concerns over web tracking, Google has created the Ad Settings webpage to provide information about and some choice over the profiles Google creates on users. We present AdFisher, an automated tool that explores how user behaviors, Google’s ads, and Ad Settings interact. AdFisher can run browser-based experiments and analyze data using machine learning and significance tests. Our tool uses a rigorous experimental design and statistical analysis to ensure the statistical soundness of our results. We use AdFisher to find that the Ad Settings was opaque about some features of a user’s profile, that it does provide some choice on ads, and that these choices can lead to seemingly discriminatory ads. In particular, we found that visiting webpages associated with substance abuse changed the ads shown but not the settings page. We also found that setting the gender to female resulted in getting fewer instances of an ad related to high paying jobs than setting it to male. We cannot determine who caused these findings due to our limited visibility into the ad ecosystem, which includes Google, advertisers, websites, and users. Nevertheless, these results can form the starting point for deeper investigations by either the companies themselves or by regulatory bodies.

Subfields: Clinical Psychology, Marketing, Sociology and Political Science, Privacy & Security, AI Ethics, Fairness & Society

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Clinical Psychology

  1. Catherine E. Tucker
  2. Eirini Ntoutsi
  3. Wenbin Zhang
  4. Bo Cowgill
  5. L. Elisa Celis
  6. Nisheeth K. Vishnoi
  7. Anupam Datta
  8. Saif M. Mohammad

In Marketing

  1. Catherine E. Tucker
  2. Eirini Ntoutsi
  3. L. Elisa Celis
  4. Nisheeth K. Vishnoi
  5. Bo Cowgill
  6. Wenbin Zhang
  7. Alan Mislove
  8. Anja Lambrecht

In Sociology and Political Science

  1. Aleksandra Korolova
  2. Alexandra Olteanu
  3. Carlos Castillo
  4. Fernando Diaz
  5. Catherine E. Tucker
  6. Nisheeth K. Vishnoi
  7. L. Elisa Celis
  8. Anupam Datta

In Privacy & Security

  1. Aleksandra Korolova
  2. Cynthia Dwork
  3. Anupam Datta
  4. Catherine E. Tucker
  5. Boi Faltings
  6. Eirini Ntoutsi
  7. Jonathan Ullman
  8. Kamalika Chaudhuri

In AI Ethics, Fairness & Society

  1. Nisheeth K. Vishnoi
  2. Lingxiao Huang
  3. Eirini Ntoutsi
  4. Wenbin Zhang
  5. Dana Pessach
  6. Erez Shmueli
  7. L. Elisa Celis
  8. Catherine E. Tucker

Citations in the corpus