Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatment

By Muhammad Bilal Zafar, Isabel Valera, Manuel Gomez-Rodriguez, Krishna P. Gummadi. 2016

1,325 citations recorded by the source corpus.

Automated data-driven decision making systems are increasingly being used to assist, or even replace humans in many settings. These systems function by learning from historical decisions, often taken by humans. In order to maximize the utility of these systems (or, classifiers), their training involves minimizing the errors (or, misclassifications) over the given historical data. However, it is quite possible that the optimally trained classifier makes decisions for people belonging to different social groups with different misclassification rates (e.g., misclassification rates for females are higher than for males), thereby placing these groups at an unfair disadvantage. To account for and avoid such unfairness, in this paper, we introduce a new notion of unfairness, disparate mistreatment, which is defined in terms of misclassification rates. We then propose intuitive measures of disparate mistreatment for decision boundary-based classifiers, which can be easily incorporated into their formulation as convex-concave constraints. Experiments on synthetic as well as real world datasets show that our methodology is effective at avoiding disparate mistreatment, often at a small cost in terms of accuracy.

Subfields: Safety Research, Sociology and Political Science, Statistics and Probability, AI Ethics, Fairness & Society

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Safety Research

  1. Silvia Chiappa
  2. Luca Oneto
  3. Dana Pessach
  4. Erez Shmueli
  5. Adrian Weller
  6. Krishna P. Gummadi
  7. Aaron Roth
  8. Emilio Ferrara

In Sociology and Political Science

  1. Silvia Chiappa
  2. Krishna P. Gummadi
  3. Dana Pessach
  4. Erez Shmueli
  5. Aaron Roth
  6. Sharad Goel
  7. Sam Corbett-Davies
  8. Luca Oneto

In Statistics and Probability

  1. E.J. Candes
  2. Bernhard Schölkopf
  3. Adrian Weller
  4. Junzhe Zhang
  5. Stefan Bauer
  6. Rina Foygel Barber
  7. Emilio Ferrara
  8. Silvia Chiappa

In AI Ethics, Fairness & Society

  1. Silvia Chiappa
  2. Dana Pessach
  3. Erez Shmueli
  4. Luca Oneto
  5. Adrian Weller
  6. Berk Ustun
  7. Krishna P. Gummadi
  8. Lingxiao Huang

Citations in the corpus