Don't Throw the Baby Out With the Bathwater: Comparing Data Quality of Crowdsourcing, Online Panels, and Student Samples

By Nicolas Roulin. Industrial and Organizational Psychology, 2015

117 citations recorded by the source corpus.

Subfields: Computer Science Applications, Organizational Behavior and Human Resource Management, Safety Research

View Paper: https://www.semanticscholar.org/paper/2251b559816412db91fac02ce8f1fa353f3f29ba

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Science Applications

In Organizational Behavior and Human Resource Management

In Safety Research

Citations in the corpus

Systems Perspective of Amazon Mechanical Turk for Organizational Research: Review and Recommendations (2017, background): “…al., 2011; Berinsky et al., 2012; Goodman et al., 2012; Johnson and Borden, 2012; Casler et al., 2013; Steelman et al., 2014; Feitosa et al., 2015; Roulin, 2015), community samples (Berinsky et al., 2012; Goodman et al., 2012; Feitosa et al., 2015), Internet panels (Paolacci et al., 2010;…”
Data quality in online human-subjects research: Comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA (2023, background): “Likewise, Roulin [13] noted several benefits to collecting data through MTurk instead of other commercial data collection platforms such as Qualtrics, including: high-quality data, the ability to collect data inexpensively, and a participant sample that better represents the general population.”
An Analysis of Data Quality: Professional Panels, Student Subject Pools, and Amazon's Mechanical Turk (2017, result): “Yet other studies have shown that MTurk respondents pass attention checks at the same level as other pools of research participants (Roulin 2015) and that MTurk respondents are often more attentive (Kung et al. 2016).”
Prejudice Toward Asian Americans in the Covid-19 Pandemic: The Effects of Social Media Use in the United States (2020, methodology): “Online participant panels, such as Qualtrics have been shown to be comparable in composition to other population in prior research (Roulin, 2015; Troia and Graham, 2017).”