Results of diagnostic accuracy studies are not always validated

J Clin Epidemiol. 2006 Jun;59(6):559-66. doi: 10.1016/j.jclinepi.2005.10.011. Epub 2006 May 2.

Abstract

Background and objective: Internal validation of a diagnostic test estimates the degree of random error, using the original data of a diagnostic accuracy study. External validation requires a new study in an independent but similar population. Here we describe whether diagnostic research is validated, which technique is used, and to what extent the validation study results differ from the original.

Study design and setting: All original diagnostic accuracy studies published in 1993 in a predefined set of journals were selected. Validation of these studies was assessed in the original article and in articles published within a period of 10 years, through a literature search and contacting the authors.

Results: None of the original studies reported any form of validation. Validation studies published later could be identified for 7 of the 11 original studies. Test characteristics were difficult to compare. Despite what was generally believed, not every validation study showed results inferior to the original. We found more studies that evaluated the test in a different population than in a similar one.

Conclusion: Not every diagnostic accuracy study is validated. Diagnostic tests are more often repeated in different populations.

Publication types

  • Review

MeSH terms

  • Databases, Bibliographic
  • Diagnostic Techniques and Procedures / standards*
  • Humans
  • Periodicals as Topic
  • Predictive Value of Tests
  • Reproducibility of Results*
  • Research Design