Inter-Rater Reliability: Dependency on Trait Prevalence and Marginal Homogeneity

By K. Gwet. 2002

225 citations recorded by the source corpus.

View Paper: https://www.semanticscholar.org/paper/f8d767c98d01332e54818711cbdd40fcf083df91

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

1. Fabrice Mériaudeau
2. David Quarfoot
3. Richard A. Levine
4. Seema Garg
5. T. Karnowski
6. Kenneth W. Tobin
7. Yaqin Li
8. Edward Chaum

Citations in the corpus

• Automatic Diabetic Macular Edema Detection in Fundus Images Using Publicly Available Datasets (2011, methodology): “The Kappa value is a metric widely used in the literature, however Gwet (2002) underlines some of the pitfalls, and proposes the AC1-statistics to overcome them.”
• How Robust Are Multirater Interrater Reliability Indices to Changes in Frequency Distribution? (2016, background): “Indeed, under a fixed level of agreement between two raters, it is possible to get almost any IR value between the observed percentage of agreement and zero simply by adjusting the frequency with which certain ratings appear (Guggenmoos-Holzmann1993;Gwet 2002).”