Applying Social Psychology to Prevent Careless Responding during Online Surveys

By M. K. Ward, Adam W. Meade. 2018

113 citations recorded by the source corpus.

A major threat to data quality in online surveys is careless responding (CR; Meade & Craig, 2012) or insufficient effort responding (e.g. Bowling, Huang, Bragg, Khazon, Liu, & Blackmore, 2016). In three studies, we use social psychological theories to develop and test three prevention strategies (Ward & Pond III, 2015) related to increasing respondent motivation to respond carefully. Study 1 presented control, scripted, or video-recorded instructions designed to increase the social influence of survey administrators on survey participants. Participants in the control group were significantly more likely to admit to CR than the script and video groups. Compared with the control, scripted instructions decreased interest, and had no effect on objective indicators of CR. Study 2 found that instructions designed to induce cognitive dissonance increased logical consistency of responses and survey interest. Instructions to create a sense of hypocrisy increased accuracy on instructedresponse items. Study 3 showed that leveraging social exchange theory in survey instructions generally had no effect on CR. Similar results were found for both continuous and dichotomous scoring of indicators of CR across the three studies. Results demonstrate that facets of CR can be influenced via survey design. Future studies are needed to develop a more thorough understanding of best practices in survey design with respect to preventing CR.

Subfields: Applied Psychology, Sociology and Political Science

View Paper: https://www.semanticscholar.org/paper/e0cdbd0349b9ade7ff72719163ea9e2ae9affcb4

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Applied Psychology

In Sociology and Political Science

Citations in the corpus

Will the Questions Ever End? Person-Level Increases in Careless Responding During Questionnaire Completion (2020, methodology): “We used page time as a second measure of careless responding (see Bowling et al., 2016; Huang et al., 2012; Ward & Meade, 2018).”
Careless responding in questionnaire measures: Detection, impact, and remedies (2020, background): “Embedding this response behavior in a theoretical framework (e.g., Ward & Meade, 2018) may help to identify further constructs that are substantially related to careless responding, which, in turn, would make it possible to design more effective prevention strategies.”