Prolific.ac—A subject pool for online experiments
By Stefan Palan, Christian Schitter. 2017
3,096 citations recorded by the source corpus.
Abstract The number of online experiments conducted with subjects recruited via online platforms has grown considerably in the recent past. While one commercial crowdworking platform – Amazon’s Mechanical Turk – basically has established and since dominated this field, new alternatives offer services explicitly targeted at researchers. In this article, we present www.prolific.ac and lay out its suitability for recruiting subjects for social and economic science experiments. After briefly discussing key advantages and challenges of online experiments relative to lab experiments, we trace the platform’s historical development, present its features, and contrast them with requirements for different types of social and economic experiments.
Subfields: Computer Science Applications, Sociology and Political Science, Cognitive Science & Psychology, Social Sciences & Humanities
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Computer Science Applications
- Maurice Jakesch
- Afra Spoelder
- Nina Grgic-Hlaca
- Noah D. Goodman
- Philipp Schmidt
- Christoph Engel
- Stephany Noordijk
- Mor Naaman
In Sociology and Political Science
- Nina Grgic-Hlaca
- Maurice Jakesch
- Afra Spoelder
- Noah D. Goodman
- Philipp Schmidt
- Christoph Engel
- Stephany Noordijk
- Mor Naaman
In Cognitive Science & Psychology
- Maurice Jakesch
- Afra Spoelder
- Noah D. Goodman
- Philipp Schmidt
- Stephany Noordijk
- Mor Naaman
- Jeffrey T. Hancock
- Felix Biessmann
In Social Sciences & Humanities
- Maurice Jakesch
- Afra Spoelder
- Nina Grgic-Hlaca
- Noah D. Goodman
- Philipp Schmidt
- Christoph Engel
- Stephany Noordijk
- Mor Naaman
Citations in the corpus
- STaR: Bootstrapping Reasoning With Reasoning (2022, methodology): “We then presented a random subset of 10 questions and rationales to each of 20 crowdworkers on Prolific [31] with the rationales in a randomized order, asking them to rank the rationales based on which they felt best justified the answer.”
- Asians and Asian Americans’ experiences of racial discrimination during the COVID-19 pandemic: Impacts on health outcomes and the buffering role of social support. (2020, background): “The study was made available to eligible individuals via Prolific Academic, which provides an online platform to connect researchers with interested study participants (Palan & Schitter, 2018).”
- Transparency and trust in artificial intelligence systems (2020, methodology): “Participants were recruited via the online platform Prolific.ac (Palan & Schitter, 2018).”
- Human heuristics for AI-generated language are flawed (2022, methodology): “Participants from Prolific had a median age of 37 y, 67% had a college degree, and 27% were at least somewhat familiar with computer programming.”
- Human Decision Making with Machine Assistance (2019, background): “Unlike MTurk, Prolific was explicitly designed for online subject recruitment for the scientific community [53].”
- Self-Compassion When Coping With Venture Obstacles: Loving-Kindness Meditation and Entrepreneurial Fear of Failure (2019, methodology): “To provide a more robust test of Hypothesis 1, which is the basis for our mediation analysis, we collected additional data via the Prolific. co online panel (Palan & Schitter, 2018).”
- Playing repeated games with large language models (2023, neutral): “The games are submitted to LLMs as prompts in which the respective game, including the choice options, is described.”