Cross-Sample Comparisons and External Validity

By Yanna Krupnikov, A. Levine. Journal of Experimental Political Science, 2014

242 citations recorded by the source corpus.

Subfields: Gender Studies, Political Science and International Relations, Strategy and Management

View Paper: https://www.semanticscholar.org/paper/8a21dd28680859710ee1d285173192ece8ef0d44

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Gender Studies

In Political Science and International Relations

In Strategy and Management

Citations in the corpus

Uses and Abuses of Ideology in Political Psychology (2020, background): “The platform produces representative results on some tests and not others (Berinsky, Huber, & Lenz, 2012; Krupnikov & Levine, 2014).”
“Who are these people?” Evaluating the demographic characteristics and political preferences of MTurk survey respondents (2015, background): “27 A recent strain of research exploring the characteristics of MTurk workers argues that what differentiates MTurkers is their status as permanent participants (Chandler et al., 2014; Krupnikov and Levine, 2014; Paolacci and Chandler, 2014).”
Many Labs 2: Investigating Variation in Replicability Across Samples and Settings (2018, background): “…the inconsistency is substantial, but there is little direct evidence regarding the extent to which persons and situations—samples and settings— influence the size of psychological effects in general (but see Coppock, in press; Krupnikov & Levine, 2014; Mullinix, Leeper, Druckman, & Freese, 2015).”
Conducting interactive experiments online (2017, unknown): “7 In comparison to the student or community samples normally used in the laboratory, Mturk samples are also more diverse (Krupnikov and Levine 2014; Paolacci and Chandler 2014; Weinberg et al. 2014; Berinsky et al. 2012).”
No Harm in Checking: Using Factual Manipulation Checks to Assess Attentiveness in Experiments (2018, background): “Second, individuals who regularly complete surveys online (e.g., MTurk “workers”) may become exceptionally “savvy” at spotting IMCs (see Hauser and Schwarz 2016; Krupnikov and Levine 2014) and/or share such information with other users (Chandler, Mueller, and Paolacci 2014).”
Prior Exposure Increases Perceived Accuracy of Fake News (2018, unknown): “All participants were recruited from Amazon’s Mechanical Turk (Horton, Rand, & Zeckhauser, 2011), which has been shown to be a reliable resource for research on political ideology (Coppock, 2016; Krupnikov & Levine, 2014; Mullinix, Leeper, Druckman, & Freese, 2015).”
The Implied Truth Effect: Attaching Warnings to a Subset of Fake News Headlines Increases Perceived Accuracy of Headlines Without Warnings (2020, background): “Mechanical Turk (Horton et al. 2011), although not nationally representative, has been shown to be a reliable resource for research on political ideology (Krupnikov and Levine 2014, Mullinix et al. 2015, Coppock 2018).”
Emphasizing publishers does not effectively reduce susceptibility to misinformation on social media (2020, background): “Although MTurk workers are not nationally representative, they are a reliable resource for research on political ideology (Coppock, 2018; Krupnikov & Levine, 2014; Mullinix, Leeper, Druckman, & Freese, 2015).”
The Politically Motivated Reasoning Paradigm, Part 1: What Politically Motivated Reasoning Is and How to Measure It (2016, unknown): “Not surprisingly, at least one study has shown M Turk workers do not respond comparably to general population or student samples in politically motivated reasoning studies (Krupnikov & Levine, 2014).”
The Generalizability of Survey Experiments* (2015, background): “…Hosek, Cindy Kam, Lasse Laustsen, Diana Mutz, Helene Helboe Pedersen, Richard Shafranek, Flori So, Rune Slothuus, Rune Stubager, Magdalena Wojcieszak, workshop participants at Southern Denmark University, and participants at The American Panel Survey Workshop at Washington University, St. Louis.”
Validity and Mechanical Turk: An assessment of exclusion methods and interactive experiments (2017, background): “…more persuasively, results have recently emerged from large-scale replication projects specifically designed to reproduce 1 It is worth noting that Krupnikov and Levine (2014) reported data suggesting that experiments relying on relatively transparent deception may not replicate well in MTurk…”