Inter-rater reliability of pressure ulcer staging: ordinal probit Bayesian hierarchical model that allows for uncertain rater response

Abstract

This article describes a method for estimating the inter-rater reliability of pressure ulcer (PU) staging (stages I-IV) from raters in National Database of Nursing Quality Indicators (NDNQI) participating hospitals. The method models ordinal spanning data utilizing an ordinal probit Bayesian hierarchical model (BHM) across several hospitals in which raters monitor patient's PUs. An ulcer that cannot be accurately assessed because the base of the wound cannot be seen is defined as unstageable. Our novel approach allows for an unstageable PU rating to be included in the analysis. We compare the ordinal probit BHM to an approximate random-effects (standard approach in the literature) model that assumes that the raw ordinal data are continuous.