An American national corpus: a proposal
By Charles J. Fillmore, Nancy Ide, Dan Jurafsky, Catherine Macleod. 1998
This paper proposes the development of an American National Corpus comparable to the British National Corpus. Corpus-analytic work has demonstrated that the use of the British National Corpus is inappropriate to study of American English, due to the numerous differences in the use of the language. We also propose that the corpus include a component of texts in other major North American languages, notably Spanish and French, and ideally a parallel component containing texts in these languages aligned to the English. The development of an ANC will demand a significant commitment from the funding agencies and the research community; such an effort would, however, significantly contribute to language and linguistic research as well as the U.S. National Digital Libraries Initiative and other large-scale projects.
Subfields: Evaluation & Benchmarks
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Evaluation & Benchmarks
- Samuel R. Bowman
- Omer Levy
- Jason Phang
- Mohit Bansal
- Jonathan Berant
- Nikita Nangia
- Yejin Choi
- Douwe Kiela
Citations in the corpus
- SCROLLS: Standardized CompaRison Over Long Language Sequences (2022, methodology): “QuALITY (Pang et al., 2021): A multiple-choice question answering dataset over stories and articles sourced from Project Gutenberg, 10 the Open American National Corpus (Fillmore et al., 1998; Ide and Suderman, 2004), and more.”
- QuALITY: Question Answering with Long Input Texts, Yes! (2021, background): “The three sources that we include in QuALITY are Project Gutenberg fiction stories (mostly science fiction), 5 Slate mag-azine articles from the Open American National Corpus (Fillmore et al., 1998; Ide and Suderman, 2004), and other nonfiction articles taken from The Long+Short, 6 Freesouls, 7 and the”
- The American National Corpus: A Standardized Resource for American English (2000, background): “To meet the need for a corpus of American English, a proposal was put forward at the 1998 LREC conference to create a large, heterogeneous, uniformly annotated corpus of contemporary American English comparable to the BNC ( Fillmore, et al., 1998 ).”