Multi-region saliency-aware learning for cross-domain placenta image segmentation

Zhuomin Zhang; Dolzodmaa Davaasuren; Chenyan Wu; Jeffery A Goldstein; Alison D Gernand; James Z Wang

doi:10.1016/j.patrec.2020.10.004

Multi-region saliency-aware learning for cross-domain placenta image segmentation

Pattern Recognit Lett. 2020 Dec:140:165-171. doi: 10.1016/j.patrec.2020.10.004.

Authors

Zhuomin Zhang¹, Dolzodmaa Davaasuren¹, Chenyan Wu¹, Jeffery A Goldstein², Alison D Gernand¹, James Z Wang¹

Affiliations

¹ The Pennsylvania State University, University Park, PA, USA.
² Northwestern University, Chicago, IL, USA.

Abstract

We propose a multi-region saliency-aware learning (MSL) method for cross-domain placenta image segmentation. Unlike most existing image-level transfer learning methods that fail to preserve the semantics of paired regions, our MSL incorporates the attention mechanism and a saliency constraint into the adversarial translation process, which can realize multi-region mappings in the semantic level. Specifically, the built-in attention module serves to detect the most discriminative semantic regions that the generator should focus on. Then we use the attention consistency as another guidance for retaining semantics after translation. Furthermore, we exploit the specially designed saliency-consistent constraint to enforce the semantic consistency by requiring the saliency regions unchanged. We conduct experiments using two real-world placenta datasets we have collected. We examine the efficacy of this approach in (1) segmentation and (2) prediction of the placental diagnoses of fetal and maternal inflammatory response (FIR, MIR). Experimental results show the superiority of the proposed approach over the state of the art.

Keywords: Pathology; Photo image analysis; Placenta; Transfer learning.