Separating the Shirkers from the Workers? Making Sure Respondents Pay Attention on Self‐Administered Surveys

By Adam J. Berinsky, M. Margolis, Michael W. Sances. 2014

844 citations recorded by the source corpus.

Subfields: Applied Psychology, Sociology and Political Science

View Paper: https://www.semanticscholar.org/paper/35b56329a67d320d30589065605b8318cc93cb78

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Applied Psychology

In Sociology and Political Science

Citations in the corpus

Are Attention Check Questions a Threat to Scale Validity? (2018, methodology): “Because they are a low-cost and efficient method to protect scale validity, attention checks are now widely employed and considered to be a desirable feature in survey designs across disciplines (Berinsky et al., 2014; Bowling et al.,”
Data quality of platforms and panels for online behavioral research (2021, neutral): “Comprehension refers to the degree to which participants seem to understand a task ’ s instructions (Berinsky et al., 2014; Rand et al., 2012).”
An MTurk Crisis? Shifts in Data Quality and the Impact on Study Results (2019, background): “…(e.g., those lower in conscientiousness, individuals with lower cognitive ability, particular age groups, specific demographic groups; see Berinsky, Margolis, & Sances, 2014; Vannette, 2016) thereby biasing samples; this has led Qualtrics to recommend against their use (Vannette, 2017).”
Conducting Clinical Research Using Crowdsourced Convenience Samples. (2016, background): “Further, performance on different attention checks in the same survey shows only a modest correlation, and associations between attentiveness items are equally strong regardless of their proximity, suggesting that attention to one question cannot be assumed to guarantee attention to measures adminis”
The shape of and solutions to the MTurk quality crisis (2020, neutral): “Although researchers often use instructional manipulation checks (Oppenheimer et al ., 2009; Berinsky et al ., 2013), we avoid this style of attention check because the format is easily recognizable, making it less diagnostic of attention among professional survey respondents (Thomas and Clifford,…”
It’s a Trap! Instructional Manipulation Checks Prompt Systematic Thinking on “Tricky” Tasks (2015, background): “Inattentiveness may not be merely a trait, measureable with only one IMC, but instead may uniquely ebb and flow for each participant throughout the tasks (Berinsky et al., 2014).”
Designing Information Provision Experiments (2020, background): “For an excellent review on attention checks, see Berinsky et al. (2014).”
How Do Expectations about the Macroeconomy Affect Personal Expectations and Behavior? (2020, neutral): “• Researchers have argued that participants on MTurk may be particularly prone to experimenter demand effects (Berinsky et al., 2014).”
Love in the Time of COVID: Perceived Partner Responsiveness Buffers People From Lower Relationship Quality Associated With COVID-Related Stressors (2020, methodology): “As commonly employed in the literature (e.g., Berinsky et al., 2014; Curran, 2016), this study included attention check questions, wherein we asked participants to select a particular answer choice for that question (e.g., ‘‘Please select ‘‘Agree a little.’’”
The Effects of Counterstereotypic Gender Strategies on Candidate Evaluations (2017, background): “Berinsky, Margolis, and Sances (2014) find this platform particularly useful for recruiting participants from difficult to reach experimental populations.”
The psychology of coordination and common knowledge. (2014, result): “This 35% ex post exclusion rate is within the range of rates observed in previous research using multiple comprehension checks with Mechanical Turk samples, which can vary between 25% and 50% (Berinsky et al., 2013; Downs, Holbrook, Sheng, & Cranor, 2010; Goodman et al., 2013; Horton et al., 2011; R”
Beyond confidence: Development of a measure assessing the 5C psychological antecedents of vaccination (2018, methodology): “In order to check the data quality in the MTurk sample we conducted two attention checks [86].”
Rumors and Health Care Reform: Experiments in Political Misinformation (2015, methodology): “The sample characteristics of this ‘attentive’ sample are presented in Appendix B. 55 Berinsky, Margolis, and Sances 2014.”