Detecting and Deterring Insufficient Effort Responding to Surveys

By Jason L. Huang, P. Curran, Jessica Keeney, Elizabeth M. Poposki, Richard P. DeShon. 2012

1,221 citations recorded by the source corpus.

Subfields: Applied Psychology, Safety Research, Sociology and Political Science

View Paper: https://www.semanticscholar.org/paper/adf2b218b70f9b08d7bb225d1d3e665ad5e4a93e

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Applied Psychology

In Safety Research

In Sociology and Political Science

Citations in the corpus

Careless responding in questionnaire measures: Detection, impact, and remedies (2020, background): “…negative impression management), careless responding describes responding patterns in which participants are unmotivated to respond accurately and do not pay attention to the item contents and the survey instructions (Huang et al., 2012; McGrath, Mitchell, Kim, & Hough, 2010; Meade & Craig, 2012).”
Are Attention Check Questions a Threat to Scale Validity? (2018, background): “responding without much effort would result in loss of credits” (Huang et al., 2012) were shown to increase quality in responses.”
Dirty Data: The Effects of Screening Respondents Who Provide Low-Quality Data in Survey Research (2017, methodology): “Absent such norms, researchers may opt to flag respondents based on a logical cutoff point (e.g., faster than 2 s/item; Huang et al., 2012) or proportions of LQD estimated in the literature (Dunn et al., in press; Johnson, 2005; Meade & Craig, 2012).”
Detecting Insufficient Effort Responding with an Infrequency Scale: Evaluating Validity and Participant Reactions (2014, methodology): “As described in more detail below, the infrequency approach utilizes counterfactual or improbable items that have clear correct responses and it equates incorrect responses with IER (Huang et al. 2012).”
Best practice recommendations for data screening (2015, background): “Both Huang et al. (2012) and Johnson (2005) screened respondents with psychometric antonym coefficients greater than −.03.”
How Careless Responding and Acquiescence Response Bias Can Influence Construct Dimensionality (2015, background): “Other, similar labels include inattentive responding (Maniaci & Rogge, 2014), nonattending responding (Barnette, 1999), and insufficient effort responding (Huang et al., 2012).”
A Tale of Two Sample Sources: Do Results from Online Panel Data and Conventional Data Converge? (2018, background): “…responding (e.g., pick 4 for all questions) may inflate internal reliability if scales items are grouped together and no reverse items are used (Huang et al., 2012) ormay inflate observed correlations when the IER response set biases means in the same direction across multiple variables…”
Separating the Shirkers from the Workers? Making Sure Respondents Pay Attention on Self‐Administered Surveys (2014, background): “Screeners Identify Inattentive Respondents and Reduce Noise A key reason to use Screeners in surveys and experiments is to uncover satisficing behavior (Krosnick 1991) and identify respondents who offer careless and haphazard survey responses (Huang et al. 2012; Meade and Craig 2012).”
Applying Social Psychology to Prevent Careless Responding during Online Surveys (2018, background): “While a single cause of CR has not been established, there are a number of possible causes that have been put forward (e.g. Huang et al., 2012) including less direct interaction between the administrator and participant (Johnson, 2005) and lower participant interest (see Meade & Craig, 2012 for a…”
Conducting Clinical Research Using Crowdsourced Convenience Samples. (2016, background): “…better served by more relevant and less obtrusive approaches to quality control, such as instructional manipulation checks (for experiments) and measures of split-half reliability on synonymous or antonymous scale items (e.g., Behrend et al. 2011; for a detailed discussion, see Huang et al. 2012).”
Transformational Leadership and Employee Creativity: The Mediating Role of Promotion Focus and Creative Process Engagement (2014, background): “Since inattentiveness is a problem in web-based data collection (Johnson 2005), it is recommended to take measures to detect careless responses (Huang et al. 2012).”
When Victims Help Their Abusive Supervisors: The Role of LMX, Self-Blame, and Guilt (2020, methodology): “Second, we repeated our analysis but this time excluded all observations where respondents took on average less than two seconds to answer an item (Huang et al., 2012) (n=162).”
Use of AI-based tools for healthcare purposes: a survey study from consumers’ perspectives (2020, neutral): “As mentioned in previous studies, one general concern in data collection is a potential lack of attention and random responses [59].”