Semi-supervised medical image segmentation via cross-guidance and feature-level consistency dual regularization schemes

Abstract

Background: Semi-supervised learning is becoming an effective solution for medical image segmentation because of the lack of a large amount of labeled data.

Purpose: Consistency-based strategy is widely used in semi-supervised learning. However, it is still a challenging problem because of the coupling of CNN-based isomorphic models. In this study, we propose a new semi-supervised medical image segmentation network (DRS-Net) based on a dual-regularization scheme to address this challenge.

Methods: The proposed model consists of a CNN and a multidecoder hybrid Transformer, which adopts two regularization schemes to extract more generalized representations for unlabeled data. Considering the difference in learning paradigm, we introduce the cross-guidance between CNN and hybrid Transformer, which uses the pseudo label output from one model to supervise the other model better to excavate valid representations from unlabeled data. In addition, we use feature-level consistency regularization to effectively improve the feature extraction performance. We apply different perturbations to the feature maps output from the hybrid Transformer encoder and keep an invariance of the predictions to enhance the encoder's representations.

Results: We have extensively evaluated our approach on three typical medical image datasets, including CT slices from Spleen, MRI slices from the Heart, and FM Nuclei. We compare DRS-Net with state-of-the-art methods, and experiment results show that DRS-Net performs better on the Spleen dataset, where the dice similarity coefficient increased by about 3.5%. The experimental results on the Heart and Nuclei datasets show that DRS-Net also improves the segmentation effect of the two datasets.

Conclusions: The proposed DRS-Net enhances the segmentation performance of the datasets with three different medical modalities, where the dual-regularization scheme extracts more generalized representations and solves the overfitting problem.

Keywords: co-training; consistency regularization; semi-supervised segmentation.