Deep learning-based multi-organ CT segmentation with adversarial data augmentation Conference Paper


Authors: Pan, S.; Lo, S. Y.; Huang, M.; Ma, C.; Wynne, J.; Wang, T.; Liu, T.; Yang, X.
Editors: Colliot, O.; Isgum, I.
Title: Deep learning-based multi-organ CT segmentation with adversarial data augmentation
Conference Title: Medical Imaging 2023: Image Processing
Abstract: In this work, we propose an adversarial attack-based data augmentation method to improve the deep-learning-based segmentation algorithm for the delineation of Organs-At-Risk (OAR) in abdominal Computed Tomography (CT) to facilitate radiation therapy. We introduce Adversarial Feature Attack for Medical Image (AFA-MI) augmentation, which forces the segmentation network to learn out-of-distribution statistics and improve generalization and robustness to noises. AFA-MI augmentation consists of three steps: 1) generate adversarial noises by Fast Gradient Sign Method (FGSM) on the intermediate features of the segmentation network’s encoder; 2) inject the generated adversarial noises into the network, intentionally compromising performance; 3) optimize the network with both clean and adversarial features. The effectiveness of the AFA-MI augmentation was validated on nnUnet. Experiments are conducted segmenting the heart, left and right kidney, liver, left and right lung, spinal cord, and stomach in an institutional dataset collected from 60 patients. We firstly evaluate the AFA-MI augmentation using nnUnet and Token-based Transformer Vnet (TT-Vnet) on the test data from a public abdominal dataset and an institutional dataset. In addition, we validate how AFA-MI affects the networks’ robustness to the noisy data by evaluating the networks with added Gaussian noises of varying magnitudes to the institutional dataset. Network performance is quantitatively evaluated using Dice Similarity Coefficient (DSC) for volume-based accuracy. Also, Hausdorff Distance (HD) is applied for surface-based accuracy. On the public dataset, nnUnet with AFA-MI achieves DSC = 0.85 and HD = 6.16 millimeters (mm); and TT-Vnet achieves DSC = 0.86 and HD = 5.62 mm. On the robustness experiment with the institutional data, AFA-MI is observed to improve the segmentation DSC score ranging from 0.055 to 0.010 across all organs relative to clean inputs. AFA-MI augmentation further improves all contour accuracies up to 0.527 as measured by the DSC score when tested on images with Gaussian noises. AFA-MI augmentation is therefore demonstrated to improve segmentation performance and robustness in CT multi-organ segmentation. © 2023 SPIE.
Keywords: image enhancement; computerized tomography; medical imaging; image segmentation; organs at risks; statistical tests; gaussian noise (electronic); segmentation algorithms; deep learning; hausdorff distance; data augmentation; similarity coefficients; learn+; abdominal computed tomographies; augmentation methods; gaussians; learning-based segmentation
Journal Title Progress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume: 12464
Conference Dates: 2023 Feb 19-23
Conference Location: San Francisco, CA
ISBN: 1605-7422
Publisher: SPIE  
Date Published: 2023-04-03
Start Page: 124642D
Language: English
DOI: 10.1117/12.2653970
PROVIDER: scopus
DOI/URL:
Notes: Conference Paper -- Export Date: 1 June 2023 -- Source: Scopus
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
  1. Tonghe Wang
    41 Wang