Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach.

By Elizabeth R. DeLong, David M. DeLong, D. Clarke‐Pearson. 1988

Subfields: Statistics and Probability, Evaluation & Benchmarks

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Statistics and Probability

In Evaluation & Benchmarks

Citations in the corpus

A case-based interpretable deep learning model for classification of mass lesions in digital mammography (2021, methodology): “95% confidence intervals were derived using Delong’s method [13, 49].”
All Models are Wrong, but Many are Useful: Learning a Variable’s Importance by Studying an Entire Class of Prediction Models Simultaneously (2018, background): “…under fairly minor conditions, these estimators are unbiased, asymptotically normal, and have finite-sample probabilistic bounds (Hoeffding, 1948, 1963; Serfling, 1980; see also DeLong et al., 1988 for an early use of U-statistics in machine learning, as well as caveats in Demler et al., 2012).”
Combined screening with ultrasound and mammography vs mammography alone in women at elevated risk of breast cancer. (2008, unknown): “Age at enrollment, yb Median (range) 55 (25-91) 55 (25-91)”
Statistical shape modeling of the left ventricle: myocardial infarct classification challenge (2017, methodology): “Statistical tests between methods were performed by using one-sided paired non-parametric test for AUC values [55], implemented in the pROC package [56].”
The HCR‐20 in personality disordered female offenders: a comparison with a matched sample of males (2005, methodology): “To compare the obtained AUC values for men and women, we used ACCUROC Version 2.5 (Vida, 1997) that applies the non-parametric method as described by DeLong, DeLong, and Clarke-Pearson (1988).”
Quantitative Assessment of Structural Image Quality (2017, methodology): “At each step, in order to determine whether an additional model parameter provided significantly improved classification, we calculated the Delong statistic, which tests for a significant increase in AUC between models (DeLong et al., 1988).”
Parental history of myopia, sports and outdoor activities, and future myopia. (2007, methodology): “y), which equates to the Mann-Whitney version of the two-sample rank-sum statistic of Wilcoxon.(28,29) The area under the curve is”
Audience selection for on-line brand advertising: privacy-friendly social network targeting (2009, methodology): “These results show 6 All statistical signiﬁcance results for AUCs are computed using the procedure described by [10], which is the procedure implemented by the commercial statistical packages SAS and Stata.”
Local Causal and Markov Blanket Induction for Causal Discovery and Feature Selection for Classification Part I: Algorithms and Empirical Evaluation (2010, methodology): “When statistical comparison was performed inside a wrapper, we used a non-parametric method by DeLong et al. (1988). The only exception is Random Forest-based Variable Selection (RFVS), where we used a method recommended by its authors (Diaz-Uriarte and Alvarez de Andres, 2006).”
Prediction of In-hospital Mortality in Emergency Department Patients With Sepsis: A Local Big Data-Driven, Machine Learning Approach. (2016, unknown): “41 A p-value of 0.05 was considered statistically significant.”