Skip to main page content
Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
, 148 (3), 839-43

A Method of Comparing the Areas Under Receiver Operating Characteristic Curves Derived From the Same Cases

A Method of Comparing the Areas Under Receiver Operating Characteristic Curves Derived From the Same Cases

J A Hanley et al. Radiology.

Abstract

Receiver operating characteristic (ROC) curves are used to describe and compare the performance of diagnostic technology and diagnostic algorithms. This paper refines the statistical comparison of the areas under two ROC curves derived from the same set of patients by taking into account the correlation between the areas that is induced by the paired nature of the data. The correspondence between the area under an ROC curve and the Wilcoxon statistic is used and underlying Gaussian distributions (binormal) are assumed to provide a table that converts the observed correlations in paired ratings of images into a correlation between the two ROC areas. This between-area correlation can be used to reduce the standard error (uncertainty) about the observed difference in areas. This correction for pairing, analogous to that used in the paired t-test, can produce a considerable increase in the statistical sensitivity (power) of the comparison. For studies involving multiple readers, this method provides a measure of a component of the sampling variation that is otherwise difficult to obtain.

Similar articles

See all similar articles

Cited by 1,210 PubMed Central articles

See all "Cited by" articles

Publication types

LinkOut - more resources

Feedback