International comparability of patient safety indicators in 15 OECD member countries: a methodological approach of adjustment by secondary diagnoses

Abstract

Objective: To improve the international comparability of patient safety indicators based on administrative hospital data, adjustment of country-specific rates by a proxy measure of diagnostic coding intensity was tested.

Data sources: Secondary data (numerator and denominator counts of patient safety indicators) based on adults discharged from acute care hospitals between 2006 and 2008 was used.

Study design: A retrospective cross-sectional study using hospital administrative data was performed.

Data collection: Belgium, Canada, Denmark, Germany, Italy, Ireland, New Zealand, Norway, Portugal, Singapore, Spain, Sweden, Switzerland, the United Kingdom, and the United States provided data according to detailed instructions.

Principal findings: Age- and sex-standardized rates varied across countries. An ordinary least squares regression model was estimated for each Patient Safety Indicator (PSI) using the mean number of secondary diagnoses among denominator cases as the predictor (R(2) =23 percent to 56 percent). Estimated country-specific residuals were linearly transformed into adjusted PSI rates. Variation among age-sex standardized PSI rates decreased substantially after this adjustment.

Conclusions: International comparisons of health system performance based on unadjusted patient safety indicators are problematic due to suspected coding or ascertainment bias. The model could be an interim approach to provide comparable information on hospital quality, with a long-term goal of improving international consistency in diagnostic reporting in administrative data.

Figure 1

Scatter Plots of Mean Number of Secondary Diagnoses among Denominator Cases at Risk (x-Axis) and Age–Sex Standardized Patient Safety Indicator Rates (y-Axis) among 15 Participating OECD Countries

Figure 2

Position Differences of Country Ranking after Adjustment of Age–Sex Standardized Patient Safety Indicator Rates by Mean Number of Secondary Diagnoses among Denominator Cases at Risk x-Axis: Difference in Country Rank Position