Treating metastatic disease: Which survival model is best suited for the clinic? Journal Article


Authors: Forsberg, J. A.; Sjoberg, D.; Chen, Q. R.; Vickers, A.; Healey, J. H.
Article Title: Treating metastatic disease: Which survival model is best suited for the clinic?
Abstract: To avoid complications associated with under- or overtreatment of patients with skeletal metastases, doctors need accurate survival estimates. Unfortunately, prognostic models for patients with skeletal metastases of the extremities are lacking, and physician-based estimates are generally inaccurate. We developed three types of prognostic models and compared them using calibration plots, receiver operating characteristic (ROC) curves, and decision curve analysis to determine which one is best suited for clinical use. A training set consisted of 189 patients who underwent surgery for skeletal metastases. We created models designed to predict 3- and 12-month survival using three methods: an Artificial Neural Network (ANN), a Bayesian Belief Network (BBN), and logistic regression. We then performed crossvalidation and compared the models in three ways: calibration plots plotting predicted against actual risk; area under the ROC curve (AUC) to discriminate the probability that a patient who died has a higher predicted probability of death compared to a patient who did not die; and decision curve analysis to quantify the clinical consequences of over- or undertreatment. All models appeared to be well calibrated, with the exception of the BBN, which underestimated 3-month survival at lower probability estimates. The ANN models had the highest discrimination, with an AUC of 0.89 and 0.93, respectively, for the 3- and 12-month models. Decision analysis revealed all models could be used clinically, but the ANN models consistently resulted in the highest net benefit, outperforming the BBN and logistic regression models. Our observations suggest use of the ANN model to aid decisions about surgery would lead to better patient outcomes than other alternative approaches to decision making. Level II, prognostic study. See Instructions for Authors for a complete description of levels of evidence.
Keywords: treatment outcome; aged; bone neoplasms; middle aged; bone tumor; retrospective studies; mortality; patient selection; comparative study; metastasis; bayes theorem; logistic models; risk factors; retrospective study; risk factor; time; time factors; risk assessment; probability; predictive value of tests; statistical model; predictive value; roc curve; receiver operating characteristic; orthopedic procedures; orthopedic surgery; decision support techniques; artificial neural network; neural networks (computer); decision support system
Journal Title: Clinical Orthopaedics and Related Research
Volume: 471
Issue: 3
ISSN: 0009-921X
Publisher: Springer  
Date Published: 2013-03-01
Start Page: 843
End Page: 850
Language: English
DOI: 10.1007/s11999-012-2577-z
PUBMED: 22983682
PROVIDER: scopus
PMCID: PMC3563791
DOI/URL:
Notes: --- - "Export Date: 21 May 2013" - "Source: Scopus"
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
  1. Andrew J Vickers
    880 Vickers
  2. Daniel D. Sjoberg
    234 Sjoberg
  3. John H Healey
    547 Healey