Data collection in a flat world: the strengths and weaknesses of mechanical turk samples

By Joseph K. Goodman, Cynthia Cryder, Amar Cheema. 2013

2,314 citations recorded by the source corpus.

Subfields: Experimental and Cognitive Psychology, Safety Research, Sociology and Political Science

View Paper: https://www.semanticscholar.org/paper/b9578a438c3d453e52e93e3d8873c7cc7350a615

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Experimental and Cognitive Psychology

In Safety Research

In Sociology and Political Science

Citations in the corpus

An Analysis of Data Quality: Professional Panels, Student Subject Pools, and Amazon's Mechanical Turk (2017, methodology): “This particular IMC is considered to be relatively difﬁcult because several of the (incorrect) response options are related to the experiment and the speciﬁc ad stimuli (Goodman, Cryder, and Cheema 2013).”
Systems Perspective of Amazon Mechanical Turk for Organizational Research: Review and Recommendations (2017, background): “3 Paolacci et al., 2010; Behrend et al., 2011; Berinsky et al., 2012; Goodman et al., 2012; Johnson and Borden, 2012; Simons and Chabris, 2012; Casler et al., 2013; Steelman et al., 2014; Feitosa et al., 2015; Roulin, 2015.”
Conducting interactive experiments online (2017, neutral): “in the laboratory and online Pao-lacci et al. 2010; Horton et al. 2011; Goodman et al. 2013).”
MTurk Character Misrepresentation: Assessment and Solutions (2017, background): “Note, however, that such questions should be used with caution, as Turkers are likely to catch on, especially if the question can be factually verified (Goodman, Cryder, and Cheema 2013).”
Fair and Balanced? Quantifying Media Bias through Crowdsourced Content Analysis (2016, background): “This finding is consistent with the growing literature demonstrating that crowd workers reliably replicate the behavior of undergraduate students across a wide variety behavioral experiments (Buhrmester et al., 2011; Paolacci et al., 2010; Berinsky et al., 2012; Mason and Suri, 2012; Goodman et al.,”
Crowdsourcing research: Data collection with Amazon’s Mechanical Turk (2018, background): “For example, workers on MTurk have higher needs for cognition (Berinsky et al., 2012), are more introverted (Goodman, Cryder, & Cheema, 2013), and may have slightly lower self-esteem than the general population (Arditte, Çek, Shaw, & Timpano, 2016).”
Learned Helplessness among Newly Hired Salespeople and the Influence of Leadership (2014, methodology): “Our Mechanical Turk description stated that faculty members in the business schools of two U.S. public universities were conducting research on behalf of an insurance company.”