High-resolution 3T to 7T ADC map synthesis with a hybrid CNN-transformer model Journal Article


Authors: Eidex, Z.; Wang, J.; Safari, M.; Elder, E.; Wynne, J.; Wang, T.; Shu, H. K.; Mao, H.; Yang, X.
Article Title: High-resolution 3T to 7T ADC map synthesis with a hybrid CNN-transformer model
Abstract: Background: 7 Tesla (7T) apparent diffusion coefficient (ADC) maps derived from diffusion-weighted imaging (DWI) demonstrate improved image quality and spatial resolution over 3 Tesla (3T) ADC maps. However, 7T magnetic resonance imaging (MRI) currently suffers from limited clinical unavailability, higher cost, and increased susceptibility to artifacts. Purpose: To address these issues, we propose a hybrid CNN-transformer model to synthesize high-resolution 7T ADC maps from multimodal 3T MRI. Methods: The Vision CNN-Transformer (VCT), composed of both Vision Transformer (ViT) blocks and convolutional layers, is proposed to produce high-resolution synthetic 7T ADC maps from 3T ADC maps and 3T T1-weighted (T1w) MRI. ViT blocks enabled global image context while convolutional layers efficiently captured fine detail. The VCT model was validated on the publicly available Human Connectome Project Young Adult dataset, comprising 3T T1w, 3T DWI, and 7T DWI brain scans. The Diffusion Imaging in Python library was used to compute ADC maps from the DWI scans. A total of 171 patient cases were randomly divided into 130 training cases, 20 validation cases, and 21 test cases. The synthetic ADC maps were evaluated by comparing their similarity to the ground truth volumes with the following metrics: peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), and mean squared error (MSE). In addition,. Results: The results are as follows: PSNR: 27.0 ± 0.9 dB, SSIM: 0.945 ± 0.010, and MSE: 2.0E-3 ± 0.4E-3. Both qualitative and quantitative results demonstrate that VCT performs favorably against other state-of-the-art methods. We have introduced various efficiency improvements, including the implementation of flash attention and training on 176×208 resolution images. These enhancements have resulted in the reduction of parameters and training time per epoch by 50% in comparison to ResViT. Specifically, the training time per epoch has been shortened from 7.67 min to 3.86 min. Conclusion: We propose a novel method to predict high-resolution 7T ADC maps from low-resolution 3T ADC maps and T1w MRI. Our predicted images demonstrate better spatial resolution and contrast compared to 3T MRI and prediction results made by ResViT and pix2pix. These high-quality synthetic 7T MR images could be beneficial for disease diagnosis and intervention, producing higher resolution and conformal contours, and as an intermediate step in generating synthetic CT for radiation therapy, especially when 7T MRI scanners are unavailable. © 2024 American Association of Physicists in Medicine.
Keywords: adult; controlled study; young adult; major clinical study; validation process; nuclear magnetic resonance imaging; magnetic resonance imaging; signal noise ratio; diagnostic imaging; image enhancement; brain; quantitative analysis; image processing, computer-assisted; image processing; diffusion weighted imaging; diffusion magnetic resonance imaging; high resolution; qualitative analysis; artificial neural network; multimodal imaging; signal to noise ratio; procedures; apparent diffusion coefficient; dwi; brain scintiscanning; spatial resolution; humans; human; article; mean square error; deep learning; convolution; convolutional neural network; mean squared error; convolutional neural networks; transfer of learning; image artifact; cross validation; neural networks, computer; data accuracy; t1 weighted imaging; residual neural network; surface diffusion; 7t mri; intramodal mri synthesis; 7 tesla magnetic resonance imaging; 7 teslas; apparent diffusion coefficient maps; intramodal magnetic resonance imaging synthesis; t1-weighted magnetic resonance imaging; transformer modeling
Journal Title: Medical Physics
Volume: 51
Issue: 6
ISSN: 0094-2405
Publisher: American Association of Physicists in Medicine  
Date Published: 2024-06-01
Start Page: 4380
End Page: 4388
Language: English
DOI: 10.1002/mp.17079
PUBMED: 38630982
PROVIDER: scopus
PMCID: PMC11650373
DOI/URL:
Notes: Article -- MSK Cancer Center Support Grant (P30 CA008748) acknowledged in PubMed and PDF -- Source: Scopus
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
  1. Tonghe Wang
    51 Wang