Multicenter PET image harmonization using generative adversarial networks

Eur J Nucl Med Mol Imaging. 2024 Jul;51(9):2532-2546. doi: 10.1007/s00259-024-06708-8. Epub 2024 May 2.

Abstract

Purpose: To improve reproducibility and predictive performance of PET radiomic features in multicentric studies by cycle-consistent generative adversarial network (GAN) harmonization approaches.

Methods: GAN-harmonization was developed to harmonize whole-body PET scans to perform image style and texture translation between different centers and scanners. GAN-harmonization was evaluated by application to two retrospectively collected open datasets and different tasks. First, GAN-harmonization was performed on a dual-center lung cancer cohort (127 female, 138 male) where the reproducibility of radiomic features in healthy liver tissue was evaluated. Second, GAN-harmonization was applied to a head and neck cancer cohort (43 female, 154 male) acquired from three centers. Here, the clinical impact of GAN-harmonization was analyzed by predicting the development of distant metastases using a logistic regression model incorporating first-order statistics and texture features from baseline 18F-FDG PET before and after harmonization.

Results: Image quality remained high (structural similarity: left kidney 0.800, right kidney 0.806, liver 0.780, lung 0.838, spleen 0.793, whole-body 0.832) after image harmonization across all utilized datasets. Using GAN-harmonization, inter-site reproducibility of radiomic features in healthy liver tissue increased at least by 5 ± 14% (first-order), 16 ± 7% (GLCM), 19 ± 5% (GLRLM), 16 ± 8% (GLSZM), 17 ± 6% (GLDM), and 23 ± 14% (NGTDM). In the head and neck cancer cohort, the outcome prediction improved from AUC 0.68 (95% CI 0.66-0.71) to AUC 0.73 (0.71-0.75) by application of GAN-harmonization.

Conclusions: GANs are capable of performing image harmonization and increase reproducibility and predictive performance of radiomic features derived from different centers and scanners.

Keywords: Deep learning; Generative adversarial networks; Harmonization; Multicenter; Quantitative PET.

Publication types

  • Multicenter Study

MeSH terms

  • Aged
  • Female
  • Fluorodeoxyglucose F18
  • Head and Neck Neoplasms / diagnostic imaging
  • Humans
  • Image Processing, Computer-Assisted* / methods
  • Lung Neoplasms / diagnostic imaging
  • Male
  • Middle Aged
  • Positron-Emission Tomography* / methods
  • Positron-Emission Tomography* / standards
  • Reproducibility of Results
  • Retrospective Studies

Substances

  • Fluorodeoxyglucose F18