Response Speed and Response Consistency as Mutually Validating Indicators of Data Quality in Online Samples

211 citations recorded by the source corpus.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Data quality in online human-subjects research: Comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA (2023, methodology): “While our 1-second-per-item cutoff is supported by past research [33], it is not necessarily the case that a participant who passed this data quality check truly attended to each question.”
An MTurk Crisis? Shifts in Data Quality and the Impact on Study Results (2019, methodology): “In addition to the validity indicators included, recent research indicates that response time in seconds per item (SPI) and profile correlations are important validity indicators (Wood et al., 2017); SPI in particular is easily implemented and places no burden on participants.”
MTurk Research: Review and Recommendations (2020, methodology): “When evaluating response times, a best practice is to exclude participants who complete the task in less than one or two seconds per item (Wood et al., 2017).”