Hypothesis: Net benefit as an objective function during development of machine learning algorithms for medical applications Journal Article
| Authors: | Vickers, A.; Hollingsworth, A.; Bozzo, A.; Chatterjee, A.; Chatterjee, S. |
| Article Title: | Hypothesis: Net benefit as an objective function during development of machine learning algorithms for medical applications |
| Abstract: | Net benefit is the most widely used metric for evaluating the clinical utility of medical prediction models. The approach applies decision analytic theory to weight true and false positives depending on the relative consequences of different decision outcomes. It is plausible that there are at least some machine learning scenarios where optimization of the objective function during model development will not optimize net benefit during model evaluation. We therefore hypothesize that optimizing net benefit during model development will in some cases ultimately lead to higher clinical utility than optimizing for mean square error or some other unweighted loss function. There is some preliminary evidence that this does indeed occur. We accordingly recommend further methodologic research to determine the use cases where net benefit should be the objective function during model development. © 2025 Elsevier B.V. |
| Keywords: | decision analysis; false positive result; clinical utility; hypothesis; prediction models; machine learning; objective functions; predictive model; article; machine learning algorithms; machine-learning; true positive; mean squared error; model development; prediction modelling; adversarial machine learning; prognostic performance evaluation; contrastive learning; analytic theory; performances evaluation; machine learning algorithm |
| Journal Title: | International Journal of Medical Informatics |
| Volume: | 197 |
| ISSN: | 1386-5056 |
| Publisher: | Elsevier B.V. |
| Date Published: | 2025-05-01 |
| Start Page: | 105844 |
| Language: | English |
| DOI: | 10.1016/j.ijmedinf.2025.105844 |
| PROVIDER: | scopus |
| PMCID: | PMC11926807 |
| PUBMED: | 40020442 |
| DOI/URL: | |
| Notes: | Article -- MSK Cancer Center Support Grant (P30 CA008748) acknowledged in PubMed and PDF -- MSK corresponding author is Andrew Vickers -- Source: Scopus |
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
Related MSK Work