A clinical benchmark of public self-supervised pathology foundation models Journal Article
| Authors: | Campanella, G.; Chen, S.; Singh, M.; Verma, R.; Muehlstedt, S.; Zeng, J.; Stock, A.; Croken, M.; Veremis, B.; Elmas, A.; Shujski, I.; Neittaanmäki, N.; Huang, K. L.; Kwan, R.; Houldsworth, J.; Schoenfeld, A. J.; Vanderbilt, C. |
| Article Title: | A clinical benchmark of public self-supervised pathology foundation models |
| Abstract: | The use of self-supervised learning to train pathology foundation models has increased substantially in the past few years. Notably, several models trained on large quantities of clinical data have been made publicly available in recent months. This will significantly enhance scientific research in computational pathology and help bridge the gap between research and clinical deployment. With the increase in availability of public foundation models of different sizes, trained using different algorithms on different datasets, it becomes important to establish a benchmark to compare the performance of such models on a variety of clinically relevant tasks spanning multiple organs and diseases. In this work, we present a collection of pathology datasets comprising clinical slides associated with clinically relevant endpoints including cancer diagnoses and a variety of biomarkers generated during standard hospital operation from three medical centers. We leverage these datasets to systematically assess the performance of public pathology foundation models and provide insights into best practices for training foundation models and selecting appropriate pretrained models. To enable the community to evaluate their models on our clinical datasets, we make available an automated benchmarking pipeline for external use. © The Author(s) 2025. |
| Keywords: | pathology; training; biomarker; detection method; disease incidence; cancer |
| Journal Title: | Nature Communications |
| Volume: | 16 |
| ISSN: | 2041-1723 |
| Publisher: | Nature Publishing Group |
| Date Published: | 2025-04-17 |
| Start Page: | 3640 |
| Language: | English |
| DOI: | 10.1038/s41467-025-58796-1 |
| PROVIDER: | scopus |
| PMCID: | PMC12003829 |
| PUBMED: | 40240324 |
| DOI/URL: | |
| Notes: | The MSK Cancer Center Support Grant (P30 CA008748) is acknowledge in the PDF -- Corresponding authors is MSK author: Chad Vanderbilt -- Source: Scopus |
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
-
135Vanderbilt -
131Schoenfeld
Related MSK Work