3D isotropic super-resolution prostate MRI using generative adversarial networks and unpaired multiplane slices Journal Article


Authors: Liu, Y.; Liu, Y.; Vanguri, R.; Litwiller, D.; Liu, M.; Hsu, H. Y.; Ha, R.; Shaish, H.; Jambawalikar, S.
Article Title: 3D isotropic super-resolution prostate MRI using generative adversarial networks and unpaired multiplane slices
Abstract: We developed a deep learning-based super-resolution model for prostate MRI. 2D T2-weighted turbo spin echo (T2w-TSE) images are the core anatomical sequences in a multiparametric MRI (mpMRI) protocol. These images have coarse through-plane resolution, are non-isotropic, and have long acquisition times (approximately 10-15 min). The model we developed aims to preserve high-frequency details that are normally lost after 3D reconstruction. We propose a novel framework for generating isotropic volumes using generative adversarial networks (GAN) from anisotropic 2D T2w-TSE and single-shot fast spin echo (ssFSE) images. The CycleGAN model used in this study allows the unpaired dataset mapping to reconstruct super-resolution (SR) volumes. Fivefold cross-validation was performed. The improvements from patch-to-volume reconstruction (PVR) to SR are 80.17%, 63.77%, and 186% for perceptual index (PI), RMSE, and SSIM, respectively; the improvements from slice-to-volume reconstruction (SVR) to SR are 72.41%, 17.44%, and 7.5% for PI, RMSE, and SSIM, respectively. Five ssFSE cases were used to test for generalizability; the perceptual quality of SR images surpasses the in-plane ssFSE images by 37.5%, with 3.26% improvement in SSIM and a higher RMSE by 7.92%. SR images were quantitatively assessed with radiologist Likert scores. Our isotropic SR volumes are able to reproduce high-frequency detail, maintaining comparable image quality to in-plane TSE images in all planes without sacrificing perceptual accuracy. The SR reconstruction networks were also successfully applied to the ssFSE images, demonstrating that high-quality isotropic volume achieved from ultra-fast acquisition is feasible.
Keywords: quality; image; cancer; 2d; prostate mri; generative adversarial network; super-resolution
Journal Title: Journal of Digital Imaging
Volume: 34
Issue: 5
ISSN: 0897-1889
Publisher: Springer  
Date Published: 2021-10-01
Start Page: 1199
End Page: 1208
Language: English
ACCESSION: WOS:000695788000001
DOI: 10.1007/s10278-021-00510-w
PROVIDER: wos
PMCID: PMC8555005
PUBMED: 34519954
Notes: Article -- Source: Wos
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
  1. Rami Sesha Vanguri
    15 Vanguri