Analyzing the Amazon Mechanical Turk marketplace

By Panagiotis G. Ipeirotis. XRDS, 2010

944 citations recorded by the source corpus.

Subfields: Artificial Intelligence, Computer Science Applications

View Paper: https://www.semanticscholar.org/paper/1f6e5dfb8fcade0b2a3be69dee112dcb645fadea

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

In Computer Science Applications

Citations in the corpus

Amazon's Mechanical Turk: A Comment (2017, background): “Many researchers have discussed the problems inherent in this selection process (see Chandler, Mueller, and Paolacci 2014; Harms and DeSimone 2015; Paolacci, Chandler, and Ipeirotis 2010).”
Characterizing the Global Crowd Workforce: A Cross-Country Comparison of Crowdworker Demographics (2018, background): “The fact that workers from lower income countries tend to have higher education levels is consistent with the findings of studies on MTurk (e.g., Ipeirotis, 2010b), which found that Indian workers on MTurk tend to have more education than workers from the United States.”
Comparing Person- and Process-centric Strategies for Obtaining Quality Data on Amazon Mechanical Turk (2015, background): “Here again, the emergence of micro-labor markets has provided a feasible alternative for acquiring large quantities of manual annotations at relatively low cost and within a short period of time—along with several researchers investigating ways to improve the quality of the annotations from inexpert”
Who is Mturk? Personal characteristics and sample consistency of these online workers (2018, background): “The median hourly wage for HITs performed on MTurk is $1.38 (Paolacci, Chandler, & Ipeirotis, 2010).”
Crowdsourcing large scale wrapper inference (2014, background): “As reported by Ipeirotis in his study on the Amazon Mechanical Turk (AMT) marketplace [20], 90 % of the AMT tasks give a reward of 10c, and the estimated hourly wage is approximately $5: the typical 10c task requires about 75 s to be fulfilled.”
Online labour index: Measuring the online gig economy for policy and research (2018, methodology): “The MTurk Tracker project (Difallah et al., 2015; Ipeirotis, 2010) tracks new and completed tasks on Amazon Mechanical Turk, an online labour platform.”
Scoundrels or Stars? Theory and Evidence on the Quality of Workers in Online Labor Markets (2017, result): “…profitable and interesting tasks in the market, and some research suggests they are unlikely to differ from populations examined in prior research (Paolacci, Chandler and Ipeirotis 2010; Buhrmester, Kwang and Gosling 2011; Horton, Rand and Zeckhauser 2011; Goodman, Cryder and Cheema 2012).”
A Survey of Crowdsourcing Systems (2011, background): “By analyzing the waiting time for the posted tasks on MTurk, Ipeirotis [37] found that workers are limited by the”
Conducting behavioral research on Amazon’s Mechanical Turk (2011, positive): “Perhaps the best summary statement of why workers do tasks on Mechanical Turk is the 59% of Indian workers and 69% of U.S. workers who agreed that “Mechanical Turk is a fruitful way to spend free time and get some cash” (Ipeirotis, 2010b).”
Crowdsourcing research: Data collection with Amazon’s Mechanical Turk (2018, methodology): “com; data collected during 2016 reflect similarities to the Pew Center study (Hitlin, 2016), indicating that about 85% of workers are under 50 with a fairly equal distribution of men and women (Ipeirotis, 2010).”
The Language Demographics of Amazon Mechanical Turk (2014, background): “A demographic study by Ipeirotis (2010b) focused on age, gender, martial status, income levels, motivation for working on MTurk, and whether workers used it as a primary or supplemental form of income.”
When Terror Hits Home: Identity Fused Americans Who Saw Boston Bombing Victims as “Family” Provided Aid (2015, neutral): “Also, for reviews of Mechanical Turk’s use in social science research, see Berinsky, Huber, and Lenz (2012) (also, Buhrmester, Kwang, & Gosling, 2011; Horton, Rand, & Zeckhauser, 2011; Mason & Suri, 2012; Paolacci, Chandler, & Ipeirotis, 2010).”
GeoCrowd: enabling query answering with spatial crowdsourcing (2012, background): “Furthermore, [22] analyzes the marketplace for Amazon’s Mechanical Turk.”
Intellectual humility and prosocial values: Direct and mediated effects (2017, positive): “…has shown that Mturk samples surpass student samples with regard to diversity and that Mturk samples provide data comparable in quality to student samples (Buhrmester, Kwang, & Gosling, 2011) and display comparable behavior to laboratory participants (Paolacci, Chandler, & Ipeirotis, 2010).”
Religious actions speak louder than words: exposure to credibility-enhancing displays predicts theism (2017, background): “Two hundred and sixteen Americans (63% females; mean age = 37.3 years; SD = 13.7; age range from 18 to 75 years; 82% Caucasian) participated online via Amazon’s Mechanical Turk (for evaluations of Mechanical Turk’s suitability for social science research, see Buhrmester, Kwang, & Gosling, 2011; Hort”