Benchmarking statewide trauma mortality using Agency for Healthcare Research and Quality's patient safety indicators

Abstract

Background: Improving clinical outcomes of trauma patients is a challenging problem at a statewide level, particularly if data from the state's registry are not publicly available. Promotion of optimal care throughout the state is not possible unless clinical benchmarks are available for comparison. Using publicly available administrative data from the State Department of Health and the Agency for Healthcare Research and Quality (AHRQ) patient safety indicators (PSIs), we sought to create a statewide method for benchmarking trauma mortality and at the same time also identifying a pattern of unique complications that have an independent influence on mortality.

Methods: Data for this study were obtained from State of Florida Agency for Health Care Administration. Adult trauma patients were identified as having International Classification of Disease ninth edition codes defined by the state. Multivariate logistic regression was used to create a predictive inpatient expected mortality model. The expected value of PSIs was created using the multivariate model and their beta coefficients provided by the AHRQ. Case-mix adjusted mortality results were reported as observed to expected (O/E) ratios to examine mortality, PSIs, failure to prevent complications, and failure to rescue from death.

Results: There were 50,596 trauma patients evaluated during the study period. The overall fit of the expected mortality model was very strong at a c-statistic of 0.93. Twelve of 25 trauma centers had O/E ratios <1 or better than expected. Nine statewide PSIs had failure to prevent O/E ratios higher than expected. Five statewide PSIs had failure to rescue O/E ratios higher than expected. The PSI that had the strongest influence on trauma mortality for the state was PSI no. 9 or perioperative hemorrhage or hematoma. Mortality could be further substratified by PSI complications at the hospital level.

Conclusions: AHRQ PSIs can have an integral role in an adjusted benchmarking method that screens at risk trauma centers in the state for higher than expected mortality. Stratifying mortality based on failure to prevent PSIs may identify areas of needed improvement at a statewide level.

Keywords: AHCA; AHRQ; Benchmarking; Clinical outcomes; Failure to prevent; Failure to rescue; Mortality; Patient safety indicators; Quality indicators; Trauma.