Deep learning-based denoising in high-speed portable reflectance confocal microscopy Journal Article


Authors: Zhao, J.; Jain, M.; Harris, U. G.; Kose, K.; Curiel-Lewandrowski, C.; Kang, D.
Article Title: Deep learning-based denoising in high-speed portable reflectance confocal microscopy
Abstract: Background and Objective: Portable confocal microscopy (PCM) is a low-cost reflectance confocal microscopy technique that can visualize cellular details of human skin in vivo. When PCM images are acquired with a short exposure time to reduce motion blur and enable real-time 3D imaging, the signal-to-noise ratio (SNR) is decreased significantly, which poses challenges in reliably analyzing cellular features. In this paper, we evaluated deep learning (DL)-based approach for reducing noise in PCM images acquired with a short exposure time. Study Design/Materials and Methods: Content-aware image restoration (CARE) network was trained with pairs of low-SNR input and high-SNR ground truth PCM images obtained from 309 distinctive regions of interest (ROIs). Low-SNR input images were acquired from human skin in vivo at the imaging speed of 180 frames/second. The high-SNR ground truth images were generated by registering 30 low-SNR input images obtained from the same ROI and summing them. The CARE network was trained using the Google Colaboratory Pro platform. The denoising performance of the trained CARE network was quantitatively and qualitatively evaluated by using image pairs from 45 unseen ROIs. Results: CARE denoising improved the image quality significantly, increasing similarity with the ground truth image by 1.9 times, reducing noise by 2.35 times, and increasing SNR by 7.4 dB. Banding noise, prominent in input images, was significantly reduced in CARE denoised images. CARE denoising provided quantitatively and qualitatively better noise reduction than non-DL filtering methods. Qualitative image assessment by three confocal readers showed that CARE denoised images exhibited negligible noise more often than input images and non-DL filtered images. Conclusions: Results showed the potential of using a DL-based method for denoising PCM images obtained at a high imaging speed. The DL-based denoising method needs to be further trained and tested for PCM images obtained from disease-suspicious skin lesions. © 2021 Wiley Periodicals LLC
Keywords: image denoising; reflectance confocal microscopy (rcm); content-aware image restoration (care); deep learning (dl); portable confocal microscopy (pcm)
Journal Title: Lasers in Surgery and Medicine
Volume: 53
Issue: 6
ISSN: 0196-8092
Publisher: John Wiley & Sons  
Date Published: 2021-08-01
Start Page: 880
End Page: 891
Language: English
DOI: 10.1002/lsm.23410
PUBMED: 33891330
PROVIDER: scopus
PMCID: PMC8273118
DOI/URL:
Notes: Note -- Export Date: 2 August 2021 -- Source: Scopus
Altmetric
Citation Impact
BMJ Impact Analytics
MSK Authors
  1. Kivanc Kose
    81 Kose
  2. Manu   Jain
    76 Jain
  3. Ucalene Geneisha Harris
    29 Harris