Objective: We determined the relative value of teleradiology and radiology resident coverage of the emergency department by measuring and comparing the effects of physician specialty, training level, and image display method on accuracy of radiograph interpretation.
Materials and methods: A sample of four faculty emergency medicine physicians, four emergency medicine residents, four faculty radiologists, and four radiology residents participated in our study. Each physician interpreted 120 radiographs, approximately half containing a clinically important index finding. Radiographs were interpreted using the original films and high-resolution digital monitors. Accuracy of radiograph interpretation was measured as the area under the physicians' receiver operating characteristic (ROC) curves.
Results: The area under the ROC curve was 0.15 (95% confidence interval [CI], 0.10-0.20) greater for radiologists than for emergency medicine physicians, 0.07 (95% CI, 0.02-0.12) greater for faculty than for residents, and 0.07 (95% CI, 0.02-0.12) greater for films than for video monitors. Using these results, we estimated that teleradiology coverage by faculty radiologists would add 0.09 (95% CI, 0.03-0.15) to the area under the ROC curve for radiograph interpretation by emergency medicine faculty alone, and radiology resident coverage would add 0.08 (95% CI, 0.02-0.14) to this area.
Conclusion: We observed significant differences between the interpretation of radiographs on film and on digital monitors. However, we observed differences of equal or greater magnitude associated with the training level and physician specialty of each observer. In evaluating teleradiology services, observer characteristics must be considered in addition to the quality of image display.