Testing the incremental predictive accuracy of new markers Journal Article
| Authors: | Begg, C. B.; Gonen, M.; Seshan, V. E. |
| Article Title: | Testing the incremental predictive accuracy of new markers |
| Abstract: | Background It has become commonplace to use receiver operating curve (ROC) methodology to evaluate the incremental predictive accuracy of new markers in the presence of existing predictors. However, concerns have been raised about the validity of this practice. We have evaluated this issue in detail. Results Simulations have been used that show clearly that use of risk predictors from nested models as data in subsequent tests comparing areas under the ROC curves of the models leads to grossly invalid inferences. Careful examination of the issue reveals two major problems: (1) the data elements are strongly correlated from case to case and (2) the model that includes the additional marker has a tendency to interpret predictive contributions as positive information regardless of whether observed effect of the marker is negative or positive. Both of these phenomena lead to profound bias in the test. Conclusions We recommend strongly against the use of ROC methods derived from risk predictors from nested regression models to test the incremental information of a new marker. Clinical Trials 2013; 10 : 690-692. http://ctj.sagepub.com. © The Author(s), 2013. |
| Keywords: | area under the curve; conference paper; accuracy; simulation; correlation analysis; validity; predictive value; receiver operating characteristic; marker; information; examination; systematic error |
| Journal Title: | Clinical Trials |
| Volume: | 10 |
| Issue: | 5 |
| ISSN: | 1740-7745 |
| Publisher: | Sage Publications |
| Date Published: | 2013-10-01 |
| Start Page: | 690 |
| End Page: | 692 |
| Language: | English |
| DOI: | 10.1177/1740774513496490 |
| PROVIDER: | scopus |
| PMCID: | PMC3800241 |
| PUBMED: | 23881367 |
| DOI/URL: | |
| Notes: | --- - "Export Date: 2 December 2013" - "Source: Scopus" |
Altmetric
Citation Impact
BMJ Impact Analytics
Related MSK Work