An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers.

By J. Landis, Gary G. Koch. 1977

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Citations in the corpus

A case-based interpretable deep learning model for classification of mass lesions in digital mammography (2021, background): “86) [30], further broken down into circumscribed at 0.”
Meta-analysis of Cohen’s kappa (2011, methodology): “The benchmarks for interpreting Cohen’s j proposed by Landis and Koch (1977a) are of high profile in the literature, with 0.8 to 1.0 indicating almost perfect agreement, 0.6 to 0.8 as substantial, 0.4 to 0.6 as moderate, 0.2 to 0.4 as fair, zero to 0.2 as slight and zero or lower as poor.”
The measurement of observer agreement for categorical data. (1977, unknown): “One alternative approach for handling such very large contingency tables in which most of the observed cell frequencies are zero is discussed in Landis and Koch [1977].”
Conditional inequalities between Cohen's kappa and weighted kappas (2013, methodology): “Seven pathologists (pathologists A–G in [17]) classified each of 118 slides in terms of carcinoma in situ of the uterine cervix, based on the most involved lesion, using the ordered categories (1) negative, (2) atypical squamous hyperplasia, (3) carcinoma in situ, (4) squamous carcinoma with early s”
The Oxford classification of IgA nephropathy: pathology definitions, correlations, and reproducibility. (2009, methodology): “26,27 Given the number of variables studied and the exploratory nature of the work, numerous statistical tests were carried out, but appropriate precautions were taken to minimize type 1 error, that is, falsely rejecting the null hypothesis and assuming statistically signiﬁcant differences between…”
Improving Content Knowledge and Comprehension for English Language Learners: Findings From a Randomized Control Trial (2017, background): “Cohen’s kappa ( ) is a more conservative measure of interrater agreement in that it takes into account chance agreement (Landis & Koch, 1977; Suen & Ary, 1989).”