Validation of the pneumonia severity index. Importance of study-specific recalibration

J Gen Intern Med. 1999 Jun;14(6):333-40. doi: 10.1046/j.1525-1497.1999.00351.x.

Abstract

Objective: To evaluate the predictive validity and calibration of the pneumonia severity-of-illness index (PSI) in patients with community-acquired pneumonia (CAP).

Patients: Randomly selected patients (n = 1,024) admitted with CAP to 22 community hospitals.

Measurements and main results: Medical records were abstracted to obtain prognostic information used in the PSI. The discriminatory ability of the PSI to identify patients who died and the calibration of the PSI across deciles of risk were determined. The PSI discriminates well between patients with high risk of death and those with a lower risk. In contrast, calibration of the PSI was poor, and the PSI predicted about 2.4 times more deaths than actually occurred in our population of patients with CAP.

Conclusions: We found that the PSI had good discriminatory ability. The original PSI overestimated absolute risk of death in our population. We describe a simple approach to recalibration, which corrected the overestimation in our population. Recalibration may be needed when transporting this prediction rule across populations.

Publication types

  • Clinical Trial
  • Comparative Study
  • Multicenter Study
  • Randomized Controlled Trial

MeSH terms

  • Adult
  • Aged
  • Aged, 80 and over
  • Community-Acquired Infections / classification
  • Community-Acquired Infections / diagnosis
  • Community-Acquired Infections / mortality
  • Humans
  • Incidence
  • Middle Aged
  • Pneumonia / classification*
  • Pneumonia / diagnosis
  • Pneumonia / mortality
  • Prognosis
  • ROC Curve
  • Reproducibility of Results
  • Retrospective Studies
  • Severity of Illness Index*
  • Survival Rate