The alpha and the omega of scale reliability and validity: why and how to abandon Cronbach’s alpha and the route towards more comprehensive assessment of scale quality
By Gjalt-Jorn Ygram Peters. 2014
408 citations recorded by the source corpus.
Health Psychologists using questionnaires rely heavily on Cronbach’s alpha as indicator of scale reliability and internal consistency. Cronbach’s alpha is often viewed as some kind of quality label: high values certify scale quality, low values prompt removal of one or several items. Unfortunately, this approach suffers two fundamental problems. First, Cronbach’s alpha is both unrelated to a scale's internal consistency and a fatally flawed estimate of its reliability. Second, the approach itself assumes that scale items are repeated measurements, an assumption that is often violated and rarely desirable. The problems with Cronbach’s alpha are easily solved by computing readily available alternatives, such as the Greatest Lower Bound or Omega. Solving the second problem, however, is less straightforward. This requires forgoing the appealing comfort of a quantitative, seemingly objective indicator of scale quality altogether, instead acknowledging the dynamics of reliability and validity and the distinction between scales and indices. In this contribution, I will explore these issues, and provide recommendations for scale inspection that takes these dynamics and this distinction into account.
Subfields: Sociology and Political Science, Statistics and Probability
View Paper: https://www.semanticscholar.org/paper/beb9f4db360b59e8d2399bd96eac1fae75e477b2
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Sociology and Political Science
In Statistics and Probability
Citations in the corpus
- Psychological Science Needs a Standard Practice of Reporting the Reliability of Cognitive-Behavioral Measurements (2019, background): “We also note that although omega has been advocated as a robust estimate to replace alpha (Dunn, Baguley, & Brunsden, 2014; Peters, 2014; Sijtsma, 2009; Viladrich, Angulo-Brunet, & Doval, 2017), the same assumption that each bin is identical across subjects applies.”
- Making Reliability Reliable (2016, background): “For example, Peters (2014) claimed that we should abandon alpha because it is ‘‘a fatally flawed estimate of its reliability’’ (p. 56).”