Assessing the Consequences of Text Preprocessing Decisions

By Matthew J. Denny, Arthur Spirling. 2016

15 citations recorded by the source corpus.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

1. Alexandra Olteanu
2. Carlos Castillo
3. Fernando Diaz
4. Emre Kıcıman
5. Muhammad Imran
6. Hamed Zamani
7. Ugur Kursuncu
8. Xinyi Zhou

Citations in the corpus

• Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries (2019, background): “18 Similarly, common text normalization steps such as lowercasing, spell corrections, removing word inflections by mapping it to the base form (i.e., lemmatization), or pruning words down to their stems (i.e., stemming), can also introduce errors and skew results (Denny and Spirling, 2016).”