The promise of Mechanical Turk: how online labor markets can help theorists run behavioral experiments.

By David G. Rand. Journal of Theoretical Biology, 2012

671 citations recorded by the source corpus.

Subfields: Experimental and Cognitive Psychology, Safety Research, Sociology and Political Science

View Paper: https://www.semanticscholar.org/paper/7abd4b133770a6a342d939851bb9b0d331a95f3d

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Experimental and Cognitive Psychology

In Safety Research

In Sociology and Political Science

Citations in the corpus

Validity and Mechanical Turk: An assessment of exclusion methods and interactive experiments (2017, background): “For example, many experimental economics paradigms can be somewhat difficult to understand in the cursory read they get from many participants, yet internal validity in these experiments critically depends on participants’ full comprehension of the task they are engaging in (see Rand, 2012).”
Assisting consumers in detecting fake reviews: The role of identity information disclosure and consensus (2016, background): “AMT has received increasing attention as an alternative way to recruit participants for academic studies and recent findings provide support for the appropriateness of AMT for experimental studies (Paolacci, Chandler and Ipeirotis, 2010; Rand 2012).”
Using Mechanical Turk to Study Clinical Populations (2013, positive): “As a result, the MTurk community is governed by strong norms of honesty and accuracy (Rand, 2012; Suri, Goldstein, & Mason, 2011).”
Statistical physics of human cooperation (2017, methodology): “In recent years, conducting economic game experiments on the Internet has become increasingly popular, particularly through AmazonMechanical Turk [86].”
Amazon's Mechanical Turk: A Comment (2017, background): “These problems have been noted as well in the studies of Berinsky, Huber, and Lenz (2012) and Rand (2012).”
Systems Perspective of Amazon Mechanical Turk for Organizational Research: Review and Recommendations (2017, background): “Further, dishonesty and inaccuracies have been found in workers reporting seemingly innocuous information such as gender, year of birth, location, education level, or income level (Rand, 2012; Shapiro et al., 2013; Daly and Nataraajan, 2015).”
Do people care about social context? Framing effects in dictator games (2012, neutral): “YOU MUST PASTE THE COMPLETION CODE BELOW FOR YOUR HIT TO BE ACCEPTED.” collected, dictators and recipients were randomly paired and earnings were calculated, and each subject was paid accordingly through the Amazon Mechanical Turk website (for more information on this procedure, see Rand 2012).”
Comparing the Similarity of Responses Received from Studies in Amazon’s Mechanical Turk to Studies Conducted Online and with Direct Recruitment (2015, background): “Other limitations to AMT studies include lack of possibility to exert control over participants’ environments compared to lab studies [27] and potentially lower English proficiency [31].”
Nonnaïveté among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers (2013, positive): “Despite numerous replications of classic findings using MTurk (Buhrmester et al., 2011; Paolacci et al., 2010; Rand, 2012; Shapiro et al., 2013), worker “ quality ” seems a matter of persistent concern among researchers who use MTurk to collect data.”
What's mine is mine and what's yours is mine: The Dark Triad and gambling with your neighbor's money (2013, background): “’’ MTurk is widely used by psychologists as a powerful source of data that surpasses student samples in most respects (Buhrmester, Kwang, & Gosling, 2011; Paolacci, Chandler, & Ipeirotis, 2010; Rand, 2012).”
Human cooperation. (2013, background): “are from [52–54] and [Rand, D.G., et al. (2013) It’s the thought that counts: the role”