Ethnologue: Languages of the World

By Sarah L. Nesbeitt. 1999

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Linguistics

Citations in the corpus

The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only (2023, background): “We find the distribution of languages in CommonCrawl to only be partially aligned with the worldwide distribution of language speakers (Eberhard et al., 2023): Russian is over-represented (2nd in CC but only 8th worldwide), Mandarin Chinese is under-represented (6-7th in CC but 2nd worldwide), and…”
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations (2020, background): “However, in many settings labeled data is much harder to come by than unlabeled data: current speech recognition systems require thousands of hours of transcribed speech to reach acceptable performance which is not available for the vast majority of the nearly 7,000 languages spoken worldwide [31].”
Unsupervised Speech Recognition (2021, background): “However, all of these techniques require transcribed speech data which is not available for the vast majority of the nearly 7,000 languages of the world (Lewis et al., 2016).”
Documenting Geographically and Contextually Diverse Data Sources: The BigScience Catalogue of Language Data and Resources (2022, background): “On the other hand, Chinese is included in fewer entries than languages that are less widely spoken (e.g. French, Spanish and Vietnamese; see (Eberhard and Fennig, 2021)).”
Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpus (2020, background): “Thousands of languages are spoken in our world (Eberhard et al., 2019), but technologies like machine translation (MT) and automatic speech recognition (ASR) are only available in about 100 of them.”
Multilingual Neural Machine Translation with Language Clustering (2019, methodology): “Instead, we choose the commonly used language family taxonomy (Paul et al., 2009) as the prior knowledge for clustering, to provide a comparison with the language embedding based clustering.”
A massively parallel corpus: the Bible in 100 languages (2014, background): “Figure 3 presents a geographical distribution of the languages (data from Dryer and Haspelmath 2013) that cover almost all the continents, and Appendix A contains detailed linguistic information about every language as well as the approximate date of translation (data from Lewis et al. 2014).”
Scaling Speech Technology to 1, 000+ Languages (2023, background): “Despite this progress, speech technology is still absent for the vast majority of the over 7,000 languages spoken around the world [Lewis et al., 2016].”
URIEL and lang2vec: Representing languages as typological, geographical, and phylogenetic vectors (2017, methodology): “…Structures of World Languages (Collins and Kayne, 2011) (whose features are already binary), and indirectly by text-mining the short prose descriptions on typological features in Ethnologue (Lewis et al., 2015).2 The phonology features are adapted in the same manner from WALS and Ethnologue.”
Spoken Language Recognition: From Fundamentals to Practice (2013, background): “Advances in feature extraction, acoustic modeling, phone n-gram modeling, phone recognizers, phone lattice generation, vector space modeling, intersession compensation, and score calibration and fusion have contributed to the state-of-the-art performance [13], [73], [121].”
Determiner agreement and noun conjunction (2004, background): “(48) (a) nämä kissat these-PL cats-PL ‘these cats ’ [12] Finnish is a member of the Uralic language family, and Hindi/Urdu is a member of the IndoAryan group of Indo-European (Grimes 1999).”
Challenges and Strategies in Cross-Cultural NLP (2022, background): “How to circum-scribe and deﬁne a particular language is a difﬁcult problem (Eberhard et al., 2021).”
Diversity and Difference: Identity Issues of Chinese Heritage Language Learners from Dialect Backgrounds. (2010, background): “7 Still, the figure is enormous and easily makes Mandarin the most spoken language in the world (Gordon, 2005).”
A global index of biocultural diversity (2005, background): “In previous work, one of the authors constructed a global database of the number of mother-tongue speakers based on the 1992 edition of Ethnologue (Harmon 1995, based on Grimes 1992), to which has been added data (for the Americas and Europe only, thus far) from the 1988 and 2000 editions (Grimes 19”