External validity of the Society of Thoracic Surgeons risk stratification tool for deep sternal wound infection after cardiac surgery in a UK population

Interact Cardiovasc Thorac Surg. 2013 Sep;17(3):479-84. doi: 10.1093/icvts/ivt222. Epub 2013 Jun 12.

Abstract

Objectives: Deep sternal wound infection (DSWI) is a devastating complication of cardiac surgery, with a historical incidence of 0.4-5%. Predicting which patients are at higher risk of infection may help instituting various preventive measures. Risk calculations for mortality have been used as surrogates to estimate the risk of deep sternal wound infection, with limited success. The Society of Thoracic Surgeons (STS) 2008 Risk Calculator modelled the risk of DSWI for cardiac surgical patients, but it has not been validated since its publication. We sought to assess the external validity of the STS-estimated risk of DSWI in a United Kingdom (UK) population.

Methods: Using our prospectively captured database, we retrospectively calculated the risk of DSWI for 14 036 patients undergoing valve, coronary artery bypass grafts or combined procedures between February 2001 and March 2010. DSWI was identified according to the Centre for Disease Control and Prevention definition. The receiver operator characteristic (ROC) curve was employed to test the performance of the model using the area under the ROC curve (AUROC). The calibration of the model was interrogated using the Hosmer-Lemeshow test for Goodness of Fit.

Results: A total of 135 (0.95%) patients developed DSWI. Although there was a statistically significant difference in the calculated risk of patients who contracted DSWI (0.44% ± 0.01) vs those who did not (0.28% ± 0.00, P < 0.0001), the AUROC of 0.699 (95% confidence interval: 0.6522-0.7414) denoted a modest discriminatory power, with the Hosmer-Lemeshow Goodness of Fit statistic (P < 0.001) suggesting poor calibration. A risk-adjusted modifier improved the calibration (P = 0.08).

Conclusions: The STS risk calculator lacks adequate discriminatory power for estimating the isolated risk of developing deep sternal wound infection in a UK population. The discrimination is similar to the tool's validation c-statistic and may have a place in an integrated calculator.

Keywords: Complications; Infection; Risk analysis/modelling; Statistics; Sternum.

Publication types

  • Validation Study

MeSH terms

  • Aged
  • Area Under Curve
  • Cardiac Surgical Procedures / adverse effects*
  • Cardiac Surgical Procedures / mortality
  • Coronary Artery Bypass / adverse effects
  • Databases, Factual
  • Decision Support Techniques*
  • Discriminant Analysis
  • England / epidemiology
  • Female
  • Heart Valves / surgery
  • Humans
  • Incidence
  • Male
  • Middle Aged
  • ROC Curve
  • Reproducibility of Results
  • Retrospective Studies
  • Risk Assessment
  • Risk Factors
  • Societies, Medical
  • Sternotomy / adverse effects*
  • Surgical Wound Infection / epidemiology*
  • Surgical Wound Infection / mortality
  • Survival Analysis
  • Time Factors
  • Treatment Outcome