Generalizing from Survey Experiments Conducted on Mechanical Turk: A Replication Approach

By A. Coppock. 2018

478 citations recorded by the source corpus.

Subfields: Safety Research, Sociology and Political Science

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Safety Research

In Sociology and Political Science

Citations in the corpus

Manipulating and Measuring Model Interpretability (2018, background): “tudies show that data from high reputation Mechanical Turk workers are comparable to data from commercial panels and university pools when assessing factors such as attentiveness, honesty, and effort [11, 13, 16, 53, 59]. (a) Clear, two-feature condition (CLEAR-2). (b) Black-box, two-feature conditi”
Validity and Mechanical Turk: An assessment of exclusion methods and interactive experiments (2017, methodology): “However, their conclusions apply to only a narrow set of studies and more comprehensive studies consistently support the generalizability of political science experiments (e.g., Mullinix et al., 2015; Coppock, 2016).”
Advantages of Matched Over Unmatched Opt-in Samples for Studying Criminal Justice Attitudes: A Research Note (2020, background): “Finally, we focused on observational relational inferences, but research shows that opt-in samples perform better in experiments (Coppock, 2019; Mullinix et al., 2015), because of low levels of effect heterogeneity (Coppock et al.”
The Implied Truth Effect: Attaching Warnings to a Subset of Fake News Headlines Increases Perceived Accuracy of Headlines Without Warnings (2020, unknown): “Mechanical Turk (Horton et al. 2011), although not nationally representative, has been shown to be a reliable resource for research on political ideology (Krupnikov and Levine 2014, Mullinix et al. 2015, Coppock 2018).”
Emphasizing publishers does not effectively reduce susceptibility to misinformation on social media (2020, background): “Although MTurk workers are not nationally representative, they are a reliable resource for research on political ideology (Coppock, 2018; Krupnikov & Levine, 2014; Mullinix, Leeper, Druckman, & Freese, 2015).”
Designing Information Provision Experiments (2020, background): “Coppock (2018) conducts 15 replication experiments and finds a very high degree of replicability of survey experiments in the field of political science with MTurk as compared to nationally representative samples.”
Prior Exposure Increases Perceived Accuracy of Fake News (2018, unknown): “All participants were recruited from Amazon’s Mechanical Turk (Horton, Rand, & Zeckhauser, 2011), which has been shown to be a reliable resource for research on political ideology (Coppock, 2016; Krupnikov & Levine, 2014; Mullinix, Leeper, Druckman, & Freese, 2015).”
The shape of and solutions to the MTurk quality crisis (2020, unknown): “Moreover, a variety of replication studies conducted between 2012 and 2015 provide clear evidence of high data quality during this time frame (Mullinix et al ., 2015; Coppock, 2018).”
The Long-lasting Effects of Newspaper Op-Eds on Public Opinion (2018, result): “While we are sensitive to such concerns, we also note that recent replication efforts (Coppock, 2018; Mullinix et al., 2015) have shown that experimental estimates obtained on Mechanical Turk correspond very closely with those obtained on nationally representative samples.”