How can Never Event data be used to reflect or improve hospital safety performance?

Abstract

The absolute number of Never Events is used by UK regulators to help assess hospital safety performance, without account of hospital workload. We applied funnel plots, as an established means of taking workload into account, to published Never Event data for 151 acute Trusts in NHS England, matched to finished consultant episodes for 3 years, 2017-2020. Trusts with excess event rates should have the most Never Events if absolute number is a valid way to judge performance. The absolute number of Never Events was correlated with workload (r² = 0.51, p < 0.001), but the five Trusts above the upper 95% confidence limit did not have the highest number of Never Events. However, a limitation to interpretation was that the data were skewed; 12 out of 151 Trusts lay below the lower 95% limit. This skew probably arises because funnel plots pool all Never Events and workload data; whereas, ideally, different Never Events should use as denominator only the relevant workload actions that could cause them. We conclude that the manner in which Never Event data are currently used by regulators, in part to judge or rate hospitals, is mathematically invalid. The focus should shift from identifying 'outlier' hospitals to reducing the overall national mean Never Event rate through shared learning and an integrated system-wide approach.

Keywords: Never Event; complications; performance; safety; statistics.