Computer-aided diagnostic system for thyroid nodule sonographic evaluation outperforms the specificity of less experienced examiners

J Ultrasound. 2020 Jun;23(2):169-174. doi: 10.1007/s40477-020-00453-y. Epub 2020 Apr 3.

Abstract

Purpose: Computer-aided diagnosis (CAD) may improve interobserver agreement in the risk stratification of thyroid nodules. This study aims to evaluate the performance of the Korean Thyroid Imaging Reporting and Data System (K-TIRADS) classification as estimated by an expert radiologist, a senior resident, a medical student, and a CAD system, as well as the interobserver agreement among them.

Methods: Between July 2016 and 2018, 107 nodules (size 5-40 mm, 27 malignant) were classified according to the K-TIRADS by an expert radiologist and CAD software. A third-year resident and a medical student with basic imaging training, both blinded to previous findings, retrospectively estimated the K-TIRADS classification. The diagnostic performance was calculated, including sensitivity, specificity, positive and negative predictive values, and the area under the receiver operating characteristic curve.

Results: The CAD system and the expert achieved a sensitivity of 70.37% (95% CI 49.82-86.25%) and 81.48% (61.92-93.7%) and a specificity of 87.50% (78.21-93.84%) and 88.75% (79.72-94.72%), respectively. The specificity of the student was significantly lower (76.25% [65.42-85.05%], p = 0.02).

Conclusion: In our opinion, the CAD evaluation of thyroid nodules stratification risk has a potential role in a didactic field and does not play a real and effective role in the clinical field, where not only images but also specialistic medical practice is fundamental to achieve a diagnosis based on family history, genetics, lab tests, and so on. The CAD system may be useful for less experienced operators as its specificity was significantly higher.

Keywords: Computer-assisted diagnosis; Medical students; Observer variation; Thyroid nodule.

MeSH terms

  • Clinical Competence / statistics & numerical data*
  • Diagnosis, Computer-Assisted
  • Diagnosis, Differential
  • Female
  • Humans
  • Male
  • Middle Aged
  • Observer Variation
  • Prospective Studies
  • Reproducibility of Results
  • Retrospective Studies
  • Sensitivity and Specificity
  • Thyroid Gland / diagnostic imaging
  • Thyroid Nodule / diagnostic imaging*
  • Ultrasonography / methods*