Method agreement analysis: a review of correct methodology.
By P. F. Watson, A. Petrie. Theriogenology, 2010
867 citations recorded by the source corpus.
The correct approach to analyzing method agreement is discussed. Whether we are considering agreement between two measurements on the same samples (repeatability) or two individuals using identical methodology on identical samples (reproducibility) or comparing two methods, appropriate procedures are described, and worked examples are shown. The correct approaches for both categorical and numerical variables are explained. More complex analyses involving a comparison of more than two pairs of data are mentioned and guidance for these analyses given. Simple formulae for calculating the approximate sample size needed for agreement analysis are also given. Examples of good practice from the reproduction literature are cited, and common errors of methodology are indicated.
Subfields: Statistics and Probability, Surgery
View Paper: https://www.semanticscholar.org/paper/24db18eaf97408c0f0e8d73898438f7738a2f30e
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Statistics and Probability
Citations in the corpus
- Thermal Infrared Imaging from Drones Offers a Major Advance for Spider Monkey Surveys (2019, methodology): “To test the agreement between counts from drone and ground surveys, we performed a concordance analysis [35].”
- Beyond accuracy: quantifying trial-by-trial behaviour of CNNs and humans by measuring error consistency (2020, background): “We do not include a comparison of κ to the (Pearson) correlation coefficient since it has been shown that correlation is not a suitable measure of agreement [32, 33].”