Variance-aware attention U-Net for multi-organ segmentation

Med Phys. 2021 Dec;48(12):7864-7876. doi: 10.1002/mp.15322. Epub 2021 Nov 13.

Abstract

Purpose: With the continuous development of deep learning based medical image segmentation technology, it is expected to attain more robust and accurate performance for more challenging tasks, such as multi-organs, small/irregular areas, and ambiguous boundary issues.

Methods: We propose a variance-aware attention U-Net to solve the problem of multi-organ segmentation. Specifically, a simple yet effective variance-based uncertainty mechanism is devised to evaluate the discrimination of each voxel via its prediction probability. The proposed variance uncertainty is further embedded into an attention architecture, which not only aggregates multi-level deep features in a global-level but also enforces the network to pay extra attention to voxels with uncertain predictions during training.

Results: Extensive experiments on challenging abdominal multi-organ CT dataset show that our proposed method consistently outperforms cutting-edge attention networks with respect to the evaluation metrics of Dice index (DSC), 95% Hausdorff distance (95HD) and average symmetric surface distance (ASSD).

Conclusions: The proposed network provides an accurate and robust solution for multi-organ segmentation and has the potential to be used for improving other segmentation applications.

Keywords: abdominal multi-organ segmentation; attention mechanism; computed tomography; convolutional neural networks; uncertainty.

MeSH terms

  • Image Processing, Computer-Assisted*
  • Probability
  • Tomography, X-Ray Computed*