FairFace: Face Attribute Dataset for Balanced Race, Gender, and Age for Bias Measurement and Mitigation

By Kimmo Kärkkäinen, Jungseock Joo. 2021

785 citations recorded by the source corpus.

Existing public face image datasets are strongly biased toward Caucasian faces, and other races (e.g., Latino) are significantly underrepresented. The models trained from such datasets suffer from inconsistent classification accuracy, which limits the applicability of face analytic systems to non-White race groups. To mitigate the race bias problem in these datasets, we constructed a novel face image dataset containing 108,501 images which is balanced on race. We define 7 race groups: White, Black, Indian, East Asian, Southeast Asian, Middle Eastern, and Latino. Images were collected from the YFCC-100M Flickr dataset and labeled with race, gender, and age groups. Evaluations were performed on existing face attribute datasets as well as novel image datasets to measure the generalization performance. We find that the model trained from our dataset is substantially more accurate on novel datasets and the accuracy is consistent across race and gender groups. We also compare several commercial computer vision APIs and report their balanced accuracy across gender, race, and age groups. Our code, data, and models are available at https://github.com/joojs/fairface.

Subfields: Computer Vision and Pattern Recognition, AI Ethics, Fairness & Society, Signal Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Xiaogang Wang
  4. Trevor Darrell
  5. Jitendra Malik
  6. Ming-Hsuan Yang
  7. Andrew Zisserman
  8. Cordelia Schmid

In AI Ethics, Fairness & Society

  1. Ali Farhadi
  2. James Y. Zou
  3. John V. Guttag
  4. Douwe Kiela
  5. Harini Suresh
  6. Matthieu Cord
  7. Ryan Shaun Joazeiro de Baker
  8. Aaron Hawn

In Signal Processing

  1. Chen Change Loy
  2. Alexander Kolesnikov
  3. Arsha Nagrani
  4. Eli Shechtman
  5. Wayne Wu
  6. Pang Wei Koh
  7. Xiaohua Zhai
  8. A. Dimakis

Citations in the corpus