Context: Current regulatory proficiency testing scoring results in an automatic failure for identifying high-grade squamous intraepithelial lesion (HSIL) as negative.
Objective: The College of American Pathologists Interlaboratory Comparison Program in Cervicovaginal Cytology data from January 2004 to April 2005 were analyzed to estimate the percentage of failure based on negative responses for HSIL and validation criteria.
Design: More than 15,000 participants received field-validated and educational slide sets for conventional, ThinPrep, and SurePath modules. Educational sets fulfilled the validation criteria of the Center for Medicare and Medicaid Services, which required the consensus diagnosis of biopsy-proven HSIL (not field-validated) after review by 3 pathologists. The College of American Pathologists field validation required at least 20 responses to the HSIL+ series, with 70% matched to HSIL+ (standard error < or = 0.05). Minimum regulatory proficiency testing failure estimates were based on incorrect negative responses for the reference category of HSIL.
Results: For both cytotechnologists and pathologists, there was a statistically significant higher failure rate for slides that were not field-validated versus those that were field-validated. In conventional modules, 5.3% of the slides that were not field-validated were called negative, versus 1.2% of the field-validated slides. In all liquid-based preparations, 4.0% of the non-field-validated versus 2.2% field-validated slides were called negative. Pathologists would have failed more often than cytotechnologists for the slides that were not field-validated, whereas there was no statistical difference in failure performance with field-validated slides.
Conclusions: Failures were significantly greater with the slides that were not field-validated for both conventional and liquid-based preparations (ThinPrep only) and have implications for both regulatory proficiency testing and expert legal review. Poor performance of pathologists relative to that of cytotechnologists may reflect a lack of prescreening of slides or scope of practice issues.