Cross-cohort heterogeneity encountered while validating a model for HIV disease progression among antiretroviral initiators

J Clin Epidemiol. 2009 Jul;62(7):729-37. doi: 10.1016/j.jclinepi.2008.09.002. Epub 2008 Dec 23.

Abstract

Objective: To evaluate a model for predicting time to AIDS or death among HIV-infected persons initiating highly active antiretroviral therapy (HAART).

Study design and setting: The model was constructed from 1,891 HAART initiators in the Collaborations in HIV Outcomes Research/US (CHORUS) cohort. The model's predictive ability was assessed using internal bootstrap validation techniques and data from 716 HAART initiators at Johns Hopkins HIV Clinical Cohort (JHHCC) in whom HIV disease was, in general, more advanced.

Results: The estimated concordance statistic was 0.632 with the bootstrap method and 0.625 in JHHCC. Mean predicted and observed 3-year AIDS-free survival for JHHCC was 0.76 and 0.73 (95% confidence interval [CI], 0.69-0.77), respectively; mean predicted and observed 5-year AIDS-free survival was 0.69 and 0.57 (95% CI, 0.52-0.62), respectively. Sensitivity analyses showed that the discrepancy between predicted and observed AIDS-free survival after 3 years could be due to differences in lost-to-follow-up rates between cohorts.

Conclusion: The model was fair at using baseline characteristics to order patients' risk of disease progression, but did not accurately predict AIDS-free survival >3 years after HAART initiation. Different variable definitions, patient characteristics, and loss to follow-up highlight the challenges of using data from one cohort to predict AIDS-free survival in an independent cohort.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adult
  • Anti-HIV Agents / therapeutic use*
  • Antiretroviral Therapy, Highly Active
  • CD4 Lymphocyte Count
  • Disease Progression
  • Epidemiologic Methods
  • Female
  • HIV Infections / drug therapy*
  • HIV Infections / immunology
  • HIV Infections / virology
  • HIV-1 / isolation & purification*
  • Humans
  • Male
  • Patient Compliance
  • Prognosis
  • Treatment Outcome
  • Viral Load

Substances

  • Anti-HIV Agents