Background: A model using administrative claims data that is suitable for profiling hospital performance for heart failure would be useful in quality assessment and improvement efforts.
Methods and results: We developed a hierarchical regression model using Medicare claims data from 1998 that produces hospital risk-standardized 30-day mortality rates. We validated the model by comparing state-level standardized estimates with state-level standardized estimates calculated from a medical record model. To determine the stability of the model over time, we used annual Medicare cohorts discharged in 1999-2001. The final model included 24 variables and had an area under the receiver operating characteristic curve of 0.70. In the derivation set from 1998, the 25th and 75th percentiles of the risk-standardized mortality rates across hospitals were 11.6% and 12.8%, respectively. The 95th percentile was 14.2%, and the 5th percentile was 10.5%. In the validation samples, the 5th and 95th percentiles of risk-standardized mortality rates across states were 9.9% and 13.9%, respectively. Correlation between risk-standardized state mortality rates from claims data and rates derived from medical record data was 0.95 (SE=0.015). The slope of the weighted regression line from the 2 data sources was 0.76 (SE=0.04) with intercept of 0.03 (SE=0.004). The median difference between the claims-based state risk-standardized estimates and the chart-based rates was <0.001 (25th percentile=-0.003; 75th percentile=0.002). The performance of the model was stable over time.
Conclusions: This administrative claims-based model produces estimates of risk-standardized state mortality that are very good surrogates for estimates derived from a medical record model.