Time trends in radiologists' interpretive performance at screening mammography from the community-based Breast Cancer Surveillance Consortium, 1996-2004

Radiology. 2010 Jul;256(1):74-82. doi: 10.1148/radiol.10091881. Epub 2010 May 26.

Abstract

Purpose: To examine time trends in radiologists' interpretive performance at screening mammography between 1996 and 2004.

Materials and methods: All study procedures were institutional review board approved and HIPAA compliant. Data were collected on subsequent screening mammograms obtained from 1996 to 2004 in women aged 40-79 years who were followed up for 1 year for breast cancer. Recall rate, sensitivity, and specificity were examined annually. Generalized estimating equation (GEE) and random-effects models were used to test for linear trend. The area under the receiver operating characteristic curve (AUC), tumor histologic findings, and size of the largest dimension or diameter of the tumor were also examined.

Results: Data on 2,542,049 subsequent screening mammograms and 12,498 cancers diagnosed in the follow-up period were included in this study. Recall rate increased from 6.7% to 8.6%, sensitivity increased from 71.4% to 83.8%, and specificity decreased from 93.6% to 91.7%. In GEE models, adjusted odds ratios per calendar year were 1.04 (95% confidence interval [CI]: 1.02, 1.05) for recall rate, 1.09 (95% CI: 1.07. 1.12) for sensitivity, and 0.96 (95% CI: 0.95, 0.98) for specificity (P < .001 for all). Random-effects model results were similar. The AUC increased over time: 0.869 (95% CI: 0.861, 0.877) for 1996-1998, 0.884 (95% CI: 0.879, 0.890) for 1999-2001, and 0.891 (95% CI: 0.885, 0.896) for 2002-2004 (P < .001). Tumor histologic findings and size remained constant.

Conclusion: Recall rate and sensitivity for screening mammograms increased, whereas specificity decreased from 1996 to 2004 among women with a prior mammogram. This trend remained after accounting for risk factors. The net effect was an improvement in overall discrimination, a measure of the probability that a mammogram with cancer in the follow-up period has a higher Breast Imaging Reporting and Data System assessment category than does a mammogram without cancer in the follow-up period.

MeSH terms

  • Adult
  • Aged
  • Area Under Curve
  • Breast Neoplasms / diagnostic imaging*
  • Breast Neoplasms / epidemiology
  • Breast Neoplasms / pathology
  • Clinical Competence*
  • Female
  • Humans
  • Mammography*
  • Middle Aged
  • Practice Patterns, Physicians' / statistics & numerical data*
  • ROC Curve
  • Radiographic Image Interpretation, Computer-Assisted
  • Sensitivity and Specificity
  • Time Factors
  • United States / epidemiology