Data Statements for NLP: Toward Mitigating System Bias and Enabling Better Science

By Emily M. Bender, Batya Friedman. 2018

42 citations recorded by the source corpus.

Subfields: Natural Language Processing, Evaluation & Benchmarks

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Natural Language Processing

In Evaluation & Benchmarks

Citations in the corpus

Model Cards for Model Reporting (2018, methodology): “Model cards (for model reporting) are complements to “Datasheets for Datasets” [21] and similar recently proposed documentation paradigms [3, 28] that report details of”
MERLOT: Multimodal Neural Script Knowledge Models (2021, methodology): “In this section, we present a DataSheet [37, 12] for YT-Temporal-180M, synthesizing many of the other analyses we performed in this paper.”
The Dataset Nutrition Label: A Framework To Drive Higher Data Quality Standards (2018, background): “We are also aware of a forthcoming study from the field of natural language processing (NLP), “Data Statements for NLP: Toward Mitigating System Bias and Enabling Better Science” [26] .”
Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need? (2018, neutral): “, [13, 27]) are urgently needed.”
Increasing Trust in AI Services through Supplier's Declarations of Conformity (2018, background): “[11] Anonymous, “Data statements for nlp: Toward mitigating system bias and enabling better science,” https://openreview.”
Garbage in, garbage out?: do machine learning application papers in social computing report where human-labeled training data comes from? (2019, neutral): “As [3] notes, 33-81% of linguistics/NLP papers in various venues do not even mention the name of the language being studied (usually English).”
NUBIA: NeUral Based Interchangeability Assessor for Text Generation (2020, background): “Data statements (Bender and Friedman, 2018) or data sheets for datasets (Gebru et al., 2018) on individual components and the NUBIA metric can help design more transparent/trustworthy system.”
FactSheets: Increasing Trust in AI Services through Supplier's Declarations of Conformity. (2018, background): “[9] E.”
Sex and gender analysis improves science and engineering (2019, background): “Beyond automotive safety systems, the importance of anthropometric characteristics, such as the carrying angle of the elbow or the shape and size of the human knee, can be used to guide sex-specific design for artificial joints, limb prostheses and occupational protective gear 50,51 .”
FactSheets: Increasing trust in AI services through supplier's declarations of conformity (2019, background): “Bender and Friedman propose a data statement schema as a way to capture and convey the information and properties of a dataset used in natural language processing (NLP) research and development [9].”