Markers of good performance in mammography depend on number of annual readings

Radiology. 2013 Oct;269(1):61-7. doi: 10.1148/radiol.13122581. Epub 2013 Jun 4.


Purpose: To explore relationships between reader performance and reader characteristics in mammography for specific radiologist groupings on the basis of annual number of readings.

Materials and methods: The institutional review board approved the study and waived the need for patient consent to use all images. Readers gave informed consent. One hundred sixteen radiologists independently reviewed 60 mammographic cases: 20 cases with cancer and 40 cases with normal findings. Readers located any visualized cancer, and levels of confidence were scored from 1 to 5. A jackknifing free response operating characteristic (JAFROC) method was used, and figures of merit along with sensitivity and specificity were correlated with reader characteristics by using Spearman techniques and standard multiple regressions.

Results: Reader performance was positively correlated with number of years since qualification as a radiologist (P ≤ .01), number of years reading mammograms (P ≤ .03), and number of readings per year (P ≤ .0001). The number of years since qualification as a radiologist (P ≤ .004) and number of years of reading mammograms (P ≤ .002) were negatively related to JAFROC values for radiologists with annual volumes of less than 1000 mammographic readings. For individuals with more than 5000 mammographic readings per year, JAFROC values were positively related to the number of years that the reader was qualified as a radiologist (P ≤ .01), number of years of reading mammograms (P ≤ .002), and number of hours per week of reading mammograms (P ≤ .003). Number of mammographic readings per year was positively related with JAFROC scores for readers with an annual volume between 1000 and 5000 readings (P ≤ .03). Differences in JAFROC scores appear to be more related to specificity than location sensitivity, with the former demonstrating significant relationships with four of the five characteristics analyzed, whereas no relationships were shown for the latter.

Conclusion: Radiologists' determinants of performance are associated with annual reading volumes. Ability to recognize normal images is a discriminating factor in individuals with a high volume of mammographic readings.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adult
  • Aged
  • Breast Neoplasms / diagnostic imaging*
  • Breast Neoplasms / epidemiology*
  • Female
  • Humans
  • Image Enhancement / methods
  • Image Interpretation, Computer-Assisted / methods*
  • Mammography / statistics & numerical data*
  • Middle Aged
  • New South Wales / epidemiology
  • Observer Variation
  • Prevalence
  • Professional Competence / statistics & numerical data*
  • Reproducibility of Results
  • Sensitivity and Specificity
  • Ultrasonography