Consensus in the delphi method: What makes a decision change?

By M. Barrios, Georgina Guilera, L. Nuño, J. Gómez-Benito. 2020

331 citations recorded by the source corpus.

Abstract We examined whether giving feedback to participants in a Delphi study about the level of agreement across the expert panel had an effect on opinion change between rounds. We also considered the potential influence of participants’ sociodemographic and professional characteristics. Five three-round Delphi studies were conducted independently, in which a total of 628 mental health experts responded to all three rounds. In each study, participants had to decide, based on their experience, whether a series of categories were relevant. The percentage of group agreement (i.e., percentage of participants who considered each category as relevant) in round 2 was shown as feedback in round 3, and responses in rounds 2 and 3 were considered to analyze opinion change. Results showed that when the feedback given in round 3 indicated that ≥75% of experts considered a category to be relevant, there was a further shift in opinion towards the group opinion (i.e., the category then yielded even greater consensus), whereas if the feedback indicated

Subfields: Sociology and Political Science

View Paper: https://www.semanticscholar.org/paper/631ad9e230cc5ae5f553bbaa1346d6b275b2ff24