Receiver operating characteristic curve inference from a sample with a limit of detection

Am J Epidemiol. 2007 Feb 1;165(3):325-33. doi: 10.1093/aje/kwk011. Epub 2006 Nov 16.

Abstract

The receiver operating characteristic curve is a commonly used tool for evaluating biomarker usefulness in clinical diagnosis of disease. Frequently, biomarkers being assessed have immeasurable or unreportable samples below some limit of detection. Ignoring observations below the limit of detection leads to negatively biased estimates of the area under the curve. Several correction methods are suggested in the areas of mean estimation and testing but nothing regarding the receiver operating characteristic curve or its summary measures. In this paper, the authors show that replacement values below the limit of detection, including those suggested, result in the same biased area under the curve when properly accounted for, but they also provide guidance on the usefulness of these values in limited situations. The authors demonstrate maximum likelihood techniques leading to asymptotically unbiased estimators of the area under the curve for both normally and gamma distributed biomarker levels. Confidence intervals are proposed, the coverage probability of which is scrutinized by simulation study. An example using polychlorinated biphenyl levels to classify women with and without endometriosis illustrates the potential benefits of these methods.

Publication types

  • Research Support, N.I.H., Intramural

MeSH terms

  • Biomarkers / analysis*
  • Case-Control Studies
  • Endometriosis / chemically induced
  • Endometriosis / classification
  • Female
  • Humans
  • Likelihood Functions
  • Polychlorinated Biphenyls / blood
  • Polychlorinated Biphenyls / toxicity
  • ROC Curve*
  • Sensitivity and Specificity

Substances

  • Biomarkers
  • Polychlorinated Biphenyls