A deep learning segmentation strategy that minimizes the amount of manually annotated images

F1000Res. 2021 Mar 30:10:256. doi: 10.12688/f1000research.52026.2. eCollection 2021.

Abstract

Deep learning has revolutionized the automatic processing of images. While deep convolutional neural networks have demonstrated astonishing segmentation results for many biological objects acquired with microscopy, this technology's good performance relies on large training datasets. In this paper, we present a strategy to minimize the amount of time spent in manually annotating images for segmentation. It involves using an efficient and open source annotation tool, the artificial increase of the training dataset with data augmentation, the creation of an artificial dataset with a conditional generative adversarial network and the combination of semantic and instance segmentations. We evaluate the impact of each of these approaches for the segmentation of nuclei in 2D widefield images of human precancerous polyp biopsies in order to define an optimal strategy.

Keywords: Deep learning; conditional GANs; image annotation; nuclei segmentation; semantic and instance segmentations.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Cell Nucleus
  • Deep Learning*
  • Humans
  • Image Processing, Computer-Assisted / methods
  • Neural Networks, Computer
  • Semantics