Gorilla in our midst: An online behavioral experiment builder
By A. Anwyl-Irvine, Jessica Massonnié, A. Flitton, N. Kirkham, Jo K. Evershed. Behavior Research Methods, 2018
1,567 citations recorded by the source corpus.
Behavioral researchers are increasingly conducting their studies online, to gain access to large and diverse samples that would be difficult to get in a laboratory environment. However, there are technical access barriers to building experiments online, and web browsers can present problems for consistent timing—an important issue with reaction-time-sensitive measures. For example, to ensure accuracy and test–retest reliability in presentation and response recording, experimenters need a working knowledge of programming languages such as JavaScript. We review some of the previous and current tools for online behavioral research, as well as how well they address the issues of usability and timing. We then present the Gorilla Experiment Builder (gorilla.sc), a fully tooled experiment authoring and deployment platform, designed to resolve many timing issues and make reliable online experimentation open and accessible to a wider range of technical abilities. To demonstrate the platform’s aptitude for accessible, reliable, and scalable research, we administered a task with a range of participant groups (primary school children and adults), settings (without supervision, at home, and under supervision, in both schools and public engagement events), equipment (participant’s own computer, computer supplied by the researcher), and connection types (personal internet connection, mobile phone 3G/4G). We used a simplified flanker task taken from the attentional network task (Rueda, Posner, & Rothbart, 2004). We replicated the “conflict network” effect in all these populations, demonstrating the platform’s capability to run reaction-time-sensitive experiments. Unresolved limitations of running experiments online are then discussed, along with potential solutions and some future features of the platform.
Subfields: Applied Psychology, Cognitive Neuroscience, Developmental and Educational Psychology
View Paper: https://www.semanticscholar.org/paper/2d07ef6b6e6aebf3d7e99a77b82bf902d84ec929
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Cognitive Neuroscience
Citations in the corpus
- The timing mega-study: comparing a range of experiment generators, both lab-based and online (2020, result): “These studies did not compare any of the more recent online services such as Gorilla (Anwyl-Irvine et al., 2019), jsPsych (De Leeuw, 2015; De Leeuw &Motz, 2016), PsychoPy/PsychoJS (Peirce et al.”
- Evaluating Large Language Models in Generating Synthetic HCI Research Data: a Case Study (2023, methodology): “We used Prolifc to recruit the participants and Gorilla experiment builder [1] as a data collection platform.”