'It's Reducing a Human Being to a Percentage': Perceptions of Justice in Algorithmic Decisions

By Reuben Binns, M. V. Kleek, Michael Veale, Ulrik Lyngs, Jun Zhao, Nigel R. Shadbolt. 2018

779 citations recorded by the source corpus.

Data-driven decision-making consequential to individuals raises important questions of accountability and justice. Indeed, European law provides individuals limited rights to 'meaningful information about the logic' behind significant, autonomous decisions such as loan approvals, insurance quotes, and CV filtering. We undertake three experimental studies examining people's perceptions of justice in algorithmic decision-making under different scenarios and explanation styles. Dimensions of justice previously observed in response to human decision-making appear similarly engaged in response to algorithmic decisions. Qualitative analysis identified several concerns and heuristics involved in justice perceptions including arbitrariness, generalisation, and (in)dignity. Quantitative analysis indicates that explanation styles primarily matter to justice perceptions only when subjects are exposed to multiple different styles---under repeated exposure of one style, scenario effects obscure any explanation effects. Our results suggests there may be no 'best' approach to explaining algorithmic decisions, and that reflection on their automated nature both implicates and mitigates justice dimensions.

Subfields: Artificial Intelligence, Cognitive Neuroscience, Safety Research, AI Ethics, Fairness & Society

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Q. Liao
  2. Chenhao Tan
  3. Vivian Lai
  4. Jennifer Wortman Vaughan
  5. Mohit Bansal
  6. Percy Liang
  7. Noah A. Smith
  8. Daniel S. Weld

In Cognitive Neuroscience

  1. Jessica Morley
  2. Anat Elhalal
  3. Libby Kinsey
  4. Sebastian Raisch
  5. Sebastian Krakowski
  6. Yiling Chen
  7. S. Whittaker
  8. Karen Huang

In Safety Research

  1. Chenhao Tan
  2. Vivian Lai
  3. Q. Liao
  4. Xinru Wang
  5. Ming Yin
  6. Jessica Morley
  7. Timo Speith
  8. Anat Elhalal

In AI Ethics, Fairness & Society

  1. Chenhao Tan
  2. Vivian Lai
  3. Sahil Verma
  4. John P. Dickerson
  5. Keegan E. Hines
  6. Ming Yin
  7. Xinru Wang
  8. Berk Ustun

Citations in the corpus