Rapid image deconvolution and multiview fusion for optical microscopy Journal Article
| Authors: | Guo, M.; Li, Y.; Su, Y.; Lambert, T.; Nogare, D. D.; Moyle, M. W.; Duncan, L. H.; Ikegami, R.; Santella, A.; Rey-Suarez, I.; Green, D.; Beiriger, A.; Chen, J.; Vishwasrao, H.; Ganesan, S.; Prince, V.; Waters, J. C.; Annunziata, C. M.; Hafner, M.; Mohler, W. A.; Chitnis, A. B.; Upadhyaya, A.; Usdin, T. B.; Bao, Z.; Colón-Ramos, D.; La Riviere, P.; Liu, H.; Wu, Y.; Shroff, H. |
| Article Title: | Rapid image deconvolution and multiview fusion for optical microscopy |
| Abstract: | The contrast and resolution of images obtained with optical microscopes can be improved by deconvolution and computational fusion of multiple views of the same sample, but these methods are computationally expensive for large datasets. Here we describe theoretical and practical advances in algorithm and software design that result in image processing times that are tenfold to several thousand fold faster than with previous methods. First, we show that an ‘unmatched back projector’ accelerates deconvolution relative to the classic Richardson–Lucy algorithm by at least tenfold. Second, three-dimensional image-based registration with a graphics processing unit enhances processing speed 10- to 100-fold over CPU processing. Third, deep learning can provide further acceleration, particularly for deconvolution with spatially varying point spread functions. We illustrate our methods from the subcellular to millimeter spatial scale on diverse samples, including single cells, embryos and cleared tissue. Finally, we show performance enhancement on recently developed microscopes that have improved spatial resolution, including dual-view cleared-tissue light-sheet microscopes and reflective lattice light-sheet microscopes. © 2020, The Author(s), under exclusive licence to Springer Nature America, Inc. |
| Keywords: | microscopes; image enhancement; computer graphics; tissue; software design; optical transfer function; optical data processing; spatial resolution; image fusion; three dimensional images; deep learning; performance enhancements; program processors; graphics processing unit; large dataset; processing speed; image de convolutions; large datasets; multiple views; optical microscopes |
| Journal Title: | Nature Biotechnology |
| Volume: | 38 |
| Issue: | 11 |
| ISSN: | 1087-0156 |
| Publisher: | Nature Publishing Group |
| Date Published: | 2020-11-01 |
| Start Page: | 1337 |
| End Page: | 1346 |
| Language: | English |
| DOI: | 10.1038/s41587-020-0560-x |
| PUBMED: | 32601431 |
| PROVIDER: | scopus |
| PMCID: | PMC7642198 |
| DOI/URL: | |
| Notes: | Article -- Export Date: 1 December 2020 -- Source: Scopus |
Altmetric
Citation Impact
BMJ Impact Analytics
Related MSK Work