Skip to main page content
Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2010 Sep 17;10:81.
doi: 10.1186/1471-2288-10-81.

The Search for Stable Prognostic Models in Multiple Imputed Data Sets

Free PMC article

The Search for Stable Prognostic Models in Multiple Imputed Data Sets

David Vergouw et al. BMC Med Res Methodol. .
Free PMC article


Background: In prognostic studies model instability and missing data can be troubling factors. Proposed methods for handling these situations are bootstrapping (B) and Multiple imputation (MI). The authors examined the influence of these methods on model composition.

Methods: Models were constructed using a cohort of 587 patients consulting between January 2001 and January 2003 with a shoulder problem in general practice in the Netherlands (the Dutch Shoulder Study). Outcome measures were persistent shoulder disability and persistent shoulder pain. Potential predictors included socio-demographic variables, characteristics of the pain problem, physical activity and psychosocial factors. Model composition and performance (calibration and discrimination) were assessed for models using a complete case analysis, MI, bootstrapping or both MI and bootstrapping.

Results: Results showed that model composition varied between models as a result of how missing data was handled and that bootstrapping provided additional information on the stability of the selected prognostic model.

Conclusion: In prognostic modeling missing data needs to be handled by MI and bootstrap model selection is advised in order to provide information on model stability.

Similar articles

See all similar articles

Cited by 9 articles

See all "Cited by" articles


    1. Schiøttz-Christensen B, Nielsen GL, Hansen VK, Schødt T, Sørensen HT, Olesen F. Long-term prognosis of acute low back pain in patients seen in general practice: a 1-year prospective follow-up study. Fam Pract. 1999;16:223–32. doi: 10.1093/fampra/16.3.223. - DOI - PubMed
    1. Jellema P, van der Windt DA, van der Horst HE, Stalman WA, Bouter LM. Prediction of an unfavourable course of low back pain in general practice: comparison of four instruments. Br J Gen Pract. 2007;57:15–22. - PMC - PubMed
    1. Heymans MW, Anema JR, van Buuren S, Knol DL, van Mechelen W, de Vet HC. Return to work in a cohort of low back pain patients: development and validation of a clinical prediction rule. J Occup Rehabil. 2009;19:155–65. doi: 10.1007/s10926-009-9166-3. - DOI - PubMed
    1. Dionne CE, Bourbonnais R, Frémont P, Rossignol M, Stock SR, Larocque I. A clinical return-to-work rule for patients with back pain. CMAJ. 2005;172:1559–67. - PMC - PubMed
    1. Thomas E, Dunn KM, Mallen C, Peat G. A prognostic approach to defining chronic pain: Application to knee pain in older adults. Pain. 2008;139:389–97. doi: 10.1016/j.pain.2008.05.010. - DOI - PubMed

LinkOut - more resources