Incorporating initial treatments improves performance of a mortality prediction model for patients with sepsis

Abstract

Purpose: Mortality prediction models can be used to adjust for presenting severity of illness in observational studies of treatment effectiveness. We aimed to determine the incremental benefit of adding information about critical care services to a sepsis mortality prediction model.

Methods: In a retrospective cohort of 166 931 eligible sepsis patients at 309 hospitals, we developed nested logistic regression models to predict mortality at the patient level. Our initial model included only demographic information. We then added progressively more detailed information such as comorbidities and initial treatments. We calculated each model's area under the receiver operating characteristic curve (AUROC) and also used a sheaf coefficient analysis to determine the relative effect of each additional group of variables.

Results: Model discrimination increased as more detailed patient information was added. With demographics alone, the AUROC was 0.59; adding comorbidities increased the AUROC to 0.67. The final model, which took into account mixed (hierarchical) effects at the hospital level as well as initial treatments administered within the first two hospital days, resulted in an AUROC of 0.78. The standardized sheaf coefficient for the initial treatments was approximately 30% greater than that for demographics or infection source.

Conclusions: A sepsis disease risk score that incorporates information about the use of mechanical ventilation and vasopressors is superior to models that rely only on demographic information and comorbidities. Until administrative datasets include clinical information (such as vital signs and laboratory results), models such as this one could allow researchers to conduct observational studies of treatment effectiveness in sepsis patients.