Comparing ROC curves derived from regression models Journal Article
| Authors: | Seshan, V. E.; Gonen, M.; Begg, C. B. |
| Article Title: | Comparing ROC curves derived from regression models |
| Abstract: | In constructing predictive models, investigators frequently assess the incremental value of a predictive marker by comparing the ROC curve generated from the predictive model including the new marker with the ROC curve from the model excluding the new marker. Many commentators have noticed empirically that a test of the two ROC areas often produces a non-significant result when a corresponding Wald test from the underlying regression model is significant. A recent article showed using simulations that the widely used ROC area test produces exceptionally conservative test size and extremely low power. In this article, we demonstrate that both the test statistic and its estimated variance are seriously biased when predictions from nested regression models are used as data inputs for the test, and we examine in detail the reasons for these problems. Although it is possible to create a test reference distribution by resampling that removes these biases, Wald or likelihood ratio tests remain the preferred approach for testing the incremental contribution of a new marker. © 2012 John Wiley & Sons, Ltd. |
| Keywords: | area under the curve; validation process; comparative study; gold standard; biological marker; biological markers; receiver operating characteristic curve; biomarker; models, statistical; area under curve; regression analysis; logistic regression analysis; mathematical computing; predictive value; roc curve; receiver operating characteristic; logistic regression; likelihood functions; maximum likelihood method; discrimination; predictive accuracy; predictive model; area under the roc curve; null hypothesis |
| Journal Title: | Statistics in Medicine |
| Volume: | 32 |
| Issue: | 9 |
| ISSN: | 0277-6715 |
| Publisher: | John Wiley & Sons |
| Date Published: | 2013-04-30 |
| Start Page: | 1483 |
| End Page: | 1493 |
| Language: | English |
| PROVIDER: | scopus |
| PMCID: | PMC3617074 |
| PUBMED: | 23034816 |
| DOI: | 10.1002/sim.5648 |
| DOI/URL: | |
| Notes: | --- - Cited By (since 1996):1 - "Export Date: 1 May 2013" - "CODEN: SMEDD" - ":doi 10.1002/sim.5648" - "Source: Scopus" |
Altmetric
Citation Impact
BMJ Impact Analytics
Related MSK Work