Model checking for ROC regression analysis

Biometrics. 2007 Mar;63(1):152-63. doi: 10.1111/j.1541-0420.2006.00620.x.


The receiver operating characteristic (ROC) curve is a prominent tool for characterizing the accuracy of a continuous diagnostic test. To account for factors that might influence the test accuracy, various ROC regression methods have been proposed. However, as in any regression analysis, when the assumed models do not fit the data well, these methods may render invalid and misleading results. To date, practical model-checking techniques suitable for validating existing ROC regression models are not yet available. In this article, we develop cumulative residual-based procedures to graphically and numerically assess the goodness of fit for some commonly used ROC regression models, and show how specific components of these models can be examined within this framework. We derive asymptotic null distributions for the residual processes and discuss resampling procedures to approximate these distributions in practice. We illustrate our methods with a dataset from the cystic fibrosis registry.

Publication types

  • Research Support, N.I.H., Extramural

MeSH terms

  • Body Height
  • Cystic Fibrosis / epidemiology
  • Humans
  • Medical Records
  • Models, Statistical*
  • ROC Curve*
  • Reference Values
  • Registries
  • Regression Analysis*
  • Statistics, Nonparametric
  • Washington