The value of expert review in prospective trials of automated assisted screening devices

Diagn Cytopathol. 2014 Feb;42(2):117-9. doi: 10.1002/dc.23001. Epub 2013 May 2.

Abstract

Previous prospective studies of automated assisted gynecologic screening devices have used a panel of experts for truth determination. We sought to determine the value of this practice. The relative sensitivity of the devices compared with manual screening was calculated using an expert panel for truth determination and compared using likelihood ratios to the relative sensitivity assuming all abnormal cases were truly abnormal. These results show that expert panel review has no significant effect on relative sensitivity at the threshold of ASCUS+ but may have an effect at HSIL+. Trials without expert consensus review may be compared to those with expert consensus review at the threshold of ASCUS+ but may not be reliable at the threshold of HSIL+ without additional confirmatory data.

Keywords: Pap smear; gynecologic cytology; performance; sensitivity; workload.

MeSH terms

  • Biopsy / instrumentation
  • Biopsy / standards
  • Clinical Trials as Topic
  • Consensus
  • Cytological Techniques / instrumentation*
  • Evaluation Studies as Topic
  • Female
  • Gynecological Examination / instrumentation*
  • Gynecological Examination / standards*
  • Humans
  • Image Processing, Computer-Assisted / instrumentation*
  • Likelihood Functions
  • Mass Screening / instrumentation*
  • Mass Screening / standards*
  • Papanicolaou Test / instrumentation
  • Papanicolaou Test / standards
  • Professional Competence / standards*