A Measure of Agreement for Interval or Nominal Multivariate Observations

By H. Janson, U. Olsson. 2001

133 citations recorded by the source corpus.

Subfields: Management Science and Operations Research, Statistics and Probability

View Paper: https://www.semanticscholar.org/paper/545d13635ae8c67c9a9d7e0e7e888e4ab9f6b78b

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Management Science and Operations Research

In Statistics and Probability

Citations in the corpus

How Robust Are Multirater Interrater Reliability Indices to Changes in Frequency Distribution? (2016, methodology): “While IR/IA was originally calculated using nominal data scales with two raters and no missing scores, it has since expanded to include all types of data (nominal, ordinal, interval, and ratio levels of measurement), two or more raters, and even missing data (see, e.g., Janson and Olsson 2001).”
Variance Estimation of Nominal-Scale Inter-Rater Reliability with Random Selection of Raters (2008, methodology): “Important extensions of the kappa statistic to ordinal and interval data were proposed by Berry and Mielke (1988) and Janson and Olsson (2001, 2004).”
Interrater Agreement Reconsidered: An Alternative to the rwg Indices (2005, background): “Berry and Mielke (1988) and Janson and Olsson (2001, 2004) also have proposed extensions of kappa for ratings of continuous constructs across multiple stimuli.”
A Measure of Agreement for Interval or Nominal Multivariate Observations by Different Sets of Judges (2004, unknown): “Expected and Observed Agreement With Different Sets of Judges When the targets have been rated by different sets of judges, the amount of disagreement that may be expected by chance differs from the case when one set of judges has performed all ratings (e.g., Hubert, 1977).”
Meta-analysis of Cohen’s kappa (2011, background): “…been extended to estimate inter-rater reliability for many complicated rating scenarios (e.g., Berry and Mielke 1998; Cohen 1968, 1972; Davies and Fleiss 1982; Fleiss 1971; Gross 1986; Janson and Olsson 2001, 2004; Kraemer 1980; Kraemer et al. 2004; Landis and Koch 1977b; Vanbelle and Albert 2009).”