Deep learning enables reference-free isotropic super-resolution for volumetric fluorescence microscopy

Nat Commun. 2022 Jun 8;13(1):3297. doi: 10.1038/s41467-022-30949-6.

Abstract

Volumetric imaging by fluorescence microscopy is often limited by anisotropic spatial resolution, in which the axial resolution is inferior to the lateral resolution. To address this problem, we present a deep-learning-enabled unsupervised super-resolution technique that enhances anisotropic images in volumetric fluorescence microscopy. In contrast to the existing deep learning approaches that require matched high-resolution target images, our method greatly reduces the effort to be put into practice as the training of a network requires only a single 3D image stack, without a priori knowledge of the image formation process, registration of training data, or separate acquisition of target data. This is achieved based on the optimal transport-driven cycle-consistent generative adversarial network that learns from an unpaired matching between high-resolution 2D images in the lateral image plane and low-resolution 2D images in other planes. Using fluorescence confocal microscopy and light-sheet microscopy, we demonstrate that the trained network not only enhances axial resolution but also restores suppressed visual details between the imaging planes and removes imaging artifacts.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Anisotropy
  • Deep Learning*
  • Imaging, Three-Dimensional / methods
  • Microscopy, Fluorescence / methods