Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews.

By Johannes B Reitsma, A. Glas, A. Rutjes, Rob J. P. M. Scholten, Patrick M. M. Bossuyt, Aeilko H. Zwinderman. Journal of Clinical Epidemiology, 2005

3,200 citations recorded by the source corpus.

BACKGROUND AND OBJECTIVES Studies of diagnostic accuracy most often report pairs of sensitivity and specificity. We demonstrate the advantage of using bivariate meta-regression models to analyze such data. METHODS We discuss the methodology of both the summary Receiver Operating Characteristic (sROC) and the bivariate approach by reanalyzing the data of a published meta-analysis. RESULTS The sROC approach is the standard method for meta-analyzing diagnostic studies reporting pairs of sensitivity and specificity. This method uses the diagnostic odds ratio as the main outcome measure, which removes the effect of a possible threshold but at the same time loses relevant clinical information about test performance. The bivariate approach preserves the two-dimensional nature of the original data. Pairs of sensitivity and specificity are jointly analyzed, incorporating any correlation that might exist between these two measures using a random effects approach. Explanatory variables can be added to the bivariate model and lead to separate effects on sensitivity and specificity, rather than a net effect on the odds ratio scale as in the sROC approach. The statistical properties of the bivariate model are sound and flexible. CONCLUSION The bivariate model can be seen as an improvement and extension of the traditional sROC approach.

Subfields: Statistics and Probability

View Paper: https://www.semanticscholar.org/paper/eafe9fae94acd8db1b31fa307ed891f05b89ce15

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Statistics and Probability

Citations in the corpus

Predicting adult obesity from childhood obesity: a systematic review and meta‐analysis (2016, methodology): “This was achieved using a logistic regression model approach, which has been shown to be equivalent to the bivariate model (16,17) and the hierarchical summary receiver operating curve model (18).”
Interpretation of random effects meta-analyses (2011, methodology): “Although our examples focused on the synthesis of randomised trials, prediction intervals can also be used in other meta-analysis settings such as studies of diagnostic test accuracy”
A unification of models for meta-analysis of diagnostic accuracy studies. (2007, methodology): “Several statistical methods for meta-analysis of data from diagnostic test accuracy studies have been proposed (Moses et al., 1993; Rutter and Gatsonis, 2001; Dukic and Gatsonis, 2003; Siadaty and Shu, 2004; Reitsma et al., 2005).”
Screening for Depression in the General Population with the Center for Epidemiologic Studies Depression (CES-D): A Systematic Review with Meta-Analysis (2016, positive): “Also, for the subsample of studies that provided diagnostic accuracy results for the cut-off point 16 (n = 22), we estimated a bivariate meta-regression [27], which allowed us to obtain pooled estimates of a range of summary performance measures of the test’s ability to detect the presence of a dise”
Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies: The PRISMA-DTA Statement (2018, background): “Meta-analyses of diagnostic test accuracy studies typically require multivariate models (eg, bivariate and hierarchical summary receiveroperating characteristic),whichallow for the tradeoff between sensitivity and specificity due to the positivity threshold, forpotential correlationbetweenestimateso”
Screening for Depression in Medical Settings with the Patient Health Questionnaire (PHQ): A Diagnostic Meta-Analysis (2007, methodology): “Summary Receiver Operator Characteristic curves (sROC)(29) were then constructed using the bivariate model to produce a 95% confidence ellipse within ROC space.(26) Unlike a traditional ROC plot that explores the effect of varying thresholds on sensitivity and specificity in a single study, each dat”
Use of uterine artery Doppler ultrasonography to predict pre-eclampsia and intrauterine growth restriction: a systematic review and bivariable meta-analysis (2008, methodology): “This method has been extensively described elsewhere and has been recently recommended for meta-analyses of diagnostic tests.(20,21) To estimate sensitivity and specificity with their 95% confidence intervals (CIs), we used the model with the smallest Akaike’s information criterion (a measure of the”