Effects of aggregation of drug and diagnostic codes on the performance of the high-dimensional propensity score algorithm: an empirical example

BMC Med Res Methodol. 2013 Nov 19:13:142. doi: 10.1186/1471-2288-13-142.

Abstract

Background: The High-Dimensional Propensity Score (hd-PS) algorithm can select and adjust for baseline confounders of treatment-outcome associations in pharmacoepidemiologic studies that use healthcare claims data. How hd-PS performance is affected by aggregating medications or medical diagnoses has not been assessed.

Methods: We evaluated the effects of aggregating medications or diagnoses on hd-PS performance in an empirical example using resampled cohorts with small sample size, rare outcome incidence, or low exposure prevalence. In a cohort study comparing the risk of upper gastrointestinal complications in celecoxib or traditional NSAIDs (diclofenac, ibuprofen) initiators with rheumatoid arthritis and osteoarthritis, we (1) aggregated medications and International Classification of Diseases-9 (ICD-9) diagnoses into hierarchies of the Anatomical Therapeutic Chemical classification (ATC) and the Clinical Classification Software (CCS), respectively, and (2) sampled the full cohort using techniques validated by simulations to create 9,600 samples to compare 16 aggregation scenarios across 50% and 20% samples with varying outcome incidence and exposure prevalence. We applied hd-PS to estimate relative risks (RR) using 5 dimensions, predefined confounders, ≤ 500 hd-PS covariates, and propensity score deciles. For each scenario, we calculated: (1) the geometric mean RR; (2) the difference between the scenario mean ln(RR) and the ln(RR) from published randomized controlled trials (RCT); and (3) the proportional difference in the degree of estimated confounding between that scenario and the base scenario (no aggregation).

Results: Compared with the base scenario, aggregations of medications into ATC level 4 alone or in combination with aggregation of diagnoses into CCS level 1 improved the hd-PS confounding adjustment in most scenarios, reducing residual confounding compared with the RCT findings by up to 19%.

Conclusions: Aggregation of codes using hierarchical coding systems may improve the performance of the hd-PS to control for confounders. The balance of advantages and disadvantages of aggregation is likely to vary across research settings.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adolescent
  • Adult
  • Aged
  • Algorithms
  • Arthritis / drug therapy
  • Celecoxib
  • Confounding Factors, Epidemiologic
  • Cyclooxygenase 2 Inhibitors / adverse effects
  • Cyclooxygenase 2 Inhibitors / therapeutic use
  • Diclofenac / adverse effects
  • Diclofenac / therapeutic use
  • Gastrointestinal Diseases / chemically induced
  • Gastrointestinal Diseases / epidemiology
  • Hemorrhage / chemically induced
  • Hemorrhage / epidemiology
  • Humans
  • Ibuprofen / adverse effects
  • Ibuprofen / therapeutic use
  • Incidence
  • Middle Aged
  • Models, Statistical
  • Prevalence
  • Propensity Score*
  • Pyrazoles / adverse effects
  • Pyrazoles / therapeutic use
  • Randomized Controlled Trials as Topic
  • Risk Factors
  • Sulfonamides / adverse effects
  • Sulfonamides / therapeutic use
  • Treatment Outcome
  • Young Adult

Substances

  • Cyclooxygenase 2 Inhibitors
  • Pyrazoles
  • Sulfonamides
  • Diclofenac
  • Celecoxib
  • Ibuprofen