Deep cross-modality (MR-CT) educed distillation learning for cone beam CT lung tumor segmentation Journal Article
| Authors: | Jiang, J.; Riyahi Alam, S.; Chen, I.; Zhang, P.; Rimner, A.; Deasy, J. O.; Veeraraghavan, H. |
| Article Title: | Deep cross-modality (MR-CT) educed distillation learning for cone beam CT lung tumor segmentation |
| Abstract: | Purpose: Despite the widespread availability of in-treatment room cone beam computed tomography (CBCT) imaging, due to the lack of reliable segmentation methods, CBCT is only used for gross set up corrections in lung radiotherapies. Accurate and reliable auto-segmentation tools could potentiate volumetric response assessment and geometry-guided adaptive radiation therapies. Therefore, we developed a new deep learning CBCT lung tumor segmentation method. Methods: The key idea of our approach called cross-modality educed distillation (CMEDL) is to use magnetic resonance imaging (MRI) to guide a CBCT segmentation network training to extract more informative features during training. We accomplish this by training an end-to-end network comprised of unpaired domain adaptation (UDA) and cross-domain segmentation distillation networks (SDNs) using unpaired CBCT and MRI datasets. UDA approach uses CBCT and MRI that are not aligned and may arise from different sets of patients. The UDA network synthesizes pseudo MRI from CBCT images. The SDN consists of teacher MRI and student CBCT segmentation networks. Feature distillation regularizes the student network to extract CBCT features that match the statistical distribution of MRI features extracted by the teacher network and obtain better differentiation of tumor from background. The UDA network was implemented with a cycleGAN improved with contextual losses separately on Unet and dense fully convolutional segmentation networks (DenseFCN). Performance comparisons were done against CBCT only using 2D and 3D networks. We also compared against an alternative framework that used UDA with MR segmentation network, whereby segmentation was done on the synthesized pseudo MRI representation. All networks were trained with 216 weekly CBCTs and 82 T2-weighted turbo spin echo MRI acquired from different patient cohorts. Validation was done on 20 weekly CBCTs from patients not used in training. Independent testing was done on 38 weekly CBCTs from patients not used in training or validation. Segmentation accuracy was measured using surface Dice similarity coefficient (SDSC) and Hausdroff distance at 95th percentile (HD95) metrics. Results: The CMEDL approach significantly improved (p < 0.001) the accuracy of both Unet (SDSC of 0.83 ± 0.08; HD95 of 7.69 ± 7.86 mm) and DenseFCN (SDSC of 0.75 ± 0.13; HD95 of 11.42 ± 9.87 mm) over CBCT only 2DUnet (SDSC of 0.69 ± 0.11; HD95 of 21.70 ± 16.34 mm), 3D Unet (SDSC of 0.72 ± 0.20; HD95 15.01 ± 12.98 mm), and DenseFCN (SDSC of 0.66 ± 0.15; HD95 of 22.15 ± 17.19 mm) networks. The alternate framework using UDA with the MRI network was also more accurate than the CBCT only methods but less accurate the CMEDL approach. Conclusions: Our results demonstrate feasibility of the introduced CMEDL approach to produce reasonably accurate lung cancer segmentation from CBCT images. Further validation on larger datasets is necessary for clinical translation. © 2021 American Association of Physicists in Medicine |
| Keywords: | clinical article; controlled study; cancer radiotherapy; nuclear magnetic resonance imaging; magnetic resonance imaging; cancer diagnosis; diagnostic accuracy; lung neoplasms; radiotherapy; differential diagnosis; cohort analysis; diagnostic imaging; lung tumor; computerized tomography; tumors; image processing, computer-assisted; image processing; biological organs; image registration; cone beam computed tomography; breathing pattern; non small cell lung cancer; cone-beam computed tomography; image segmentation; statistical distribution; clinical translation; lung tumors; distillation; adaptive radiation therapies; humans; human; article; deep learning; segmentation accuracy; performance comparison; convolutional neural networks; similarity coefficients; autoencoder; adversarial deep learning; cbct segmentation; distillation learning; mr informed segmentation; distilleries; alternative framework; cross modality educed distillation |
| Journal Title: | Medical Physics |
| Volume: | 48 |
| Issue: | 7 |
| ISSN: | 0094-2405 |
| Publisher: | American Association of Physicists in Medicine |
| Date Published: | 2021-07-01 |
| Start Page: | 3702 |
| End Page: | 3713 |
| Language: | English |
| DOI: | 10.1002/mp.14902 |
| PUBMED: | 33905558 |
| PROVIDER: | scopus |
| PMCID: | PMC9662709 |
| DOI/URL: | |
| Notes: | Article -- MSK author Pengpeng Zhang uses the nickname 'Perry' on the original publication -- Export Date: 1 September 2021 -- Source: Scopus |
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
-
526Rimner -
176Zhang -
524Deasy -
159Veeraraghavan -
49Riyahi Alam -
78Jiang -
16Chen
Related MSK Work