Benchmarking transferability of self-supervised pretraining for multi-organ segmentation on different modalities Conference Paper
| Authors: | Jiang, J.; Veeraraghavan, H. |
| Title: | Benchmarking transferability of self-supervised pretraining for multi-organ segmentation on different modalities |
| Conference Title: | 2025 IEEE 22nd International Symposium on Biomedical Imaging |
| Abstract: | Self-supervised learning (SSL) is an approach to pretrain deep networks with unlabeled datasets by using pretext tasks that use images as 'ground truth'. Pretext tasks have been shown to impact accuracy of task categories, e.g. segmentation vs. classification. However, versatility of SSL features to downstream tasks involving different modalities has not been studied. We benchmarked impact of SSL tasks such as contrastive predictive coding, token self-distillation, and generative masked image modeling (MIM) with 3D vision transformer performed using 10K 3D-CTs (or 1.89M images) from various disease sites. SSL pretraining was used to assess (a) multi-organ segmentation under data-limited fine tuning, (b) feature reuse and (c) organ localization with multi-head attention. Analysis showed that pretext tasks combining MIM and token self-distillation balanced local and global attention distance, produced higher segmentation accuracy in few-shot and data-limited settings for MRI and CT. Feature reuse was impacted by similarity of pretraining and fine-tuning modality. © 2025 IEEE. |
| Keywords: | benchmarking; segmentation; support vector machines; fine tuning; image segmentation; ground truth; image coding; deep learning; multi-organ segmentations; self-supervised learning; masked image modeling; self-distillation; image modeling; pre-training; down-stream; photointerpretation; feature reuse |
| Journal Title | Proceedings of the International Symposium on Biomedical Imaging |
| Conference Dates: | 2025 Apr 14-17 |
| Conference Location: | Houston, TX |
| ISBN: | 1945-7928 |
| Publisher: | IEEE |
| Date Published: | 2025-01-01 |
| Start Page: | 1571088550 |
| Language: | English |
| DOI: | 10.1109/isbi60581.2025.10980778 |
| PROVIDER: | scopus |
| DOI/URL: | |
| Notes: | Conference paper (ISBN: 979-8-3315-2053-3) -- Source: Scopus |
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
-
159Veeraraghavan -
78Jiang
Related MSK Work