A comparison of conventional film, CR hard copy and PACS soft copy images of the chest: analyses of ROC curves and inter-observer agreement

Eur J Radiol. 2003 Sep;47(3):206-14. doi: 10.1016/s0720-048x(02)00214-0.


Study objective: The aim of this study was to determine whether the accuracy of diagnosis of a spectrum of chest pathology was affected by the imaging technique used, and to compare conventional film/screen, hard copy computed (phosphor plate) radiography (CR) and soft copy CR (PACS) images.

Materials and methods: For each of 44 patients who had a CT examination of the thorax, PA and lateral chest radiographs were produced using conventional film, hard copy CR and soft copy PACS images. Five radiologists independently scored all images for the presence of abnormalities. The data were analysed in two stages using the result of the CT scan as the reference standard diagnosis: firstly, to investigate differences in abnormality scores between image modalities and observers using ROC analysis; secondly, to investigate the agreement of the diagnoses with the reference standard by the analysis of kappa scores.

Results: The ROC analyses and comparison of kappa scores showed no differences between image modalities (P=0.72, P=0.87), but highly significant differences between observers (P<0.001, P=0.003).

Conclusion: The detection of chest lesions did not vary between conventional film, CR hard copy and PACS soft copy images. For all three image types, there were statistically significant differences between observers.

Publication types

  • Comparative Study
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Analysis of Variance
  • Humans
  • Observer Variation
  • ROC Curve
  • Radiography, Thoracic / instrumentation*
  • Radiography, Thoracic / statistics & numerical data*
  • Radiology Information Systems / instrumentation*
  • Radiology Information Systems / statistics & numerical data*
  • Thorax
  • United Kingdom
  • X-Ray Film*