Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2017 Jan;12(1):18-22.
doi: 10.1002/jhm.2680.

Do Clinicians Understand Quality Metric Data? An Evaluation in a Twitter-Derived Sample

Sushant Govindan  1 , Vineet Chopra  1   2   3 , Theodore J Iwashyna  1   2
Affiliations

Do Clinicians Understand Quality Metric Data? An Evaluation in a Twitter-Derived Sample

Sushant Govindan et al. J Hosp Med. 2017 Jan.

Abstract

Objective: Despite significant efforts and cost, quality metrics do not consistently influence practice. While research has focused on improving data through statistical risk-adjustment, whether clinicians understand these data is unknown. Therefore, we assessed clinician comprehension of central line-associated blood stream infection (CLABSI) quality metric data.

Design: Cross-sectional survey with an 11-item test of CLABSI data comprehension. Each question assessed 1 of 3 concepts concerning CLABSI understanding: basic numeracy, risk-adjustment numeracy, and risk-adjustment interpretation. Hypothetical data were used and presented in a validated format.

Participants: Clinicians were recruited from 6 nations via Twitter to take an online survey. Clinician eligibility was confirmed by assessing responses to a question regarding CLABSI.

Main measures: The primary outcome was percent correct of attempted questions pertaining to the presented CLABSI data.

Results: Ninety-seven clinicians answered at least 1 item, providing 939 responses; 72 answered all 11 items. The mean percentage of correct answers was 61% (95% confidence interval [CI], 57%-65%). Overall, doctor performance was better than performance by nurses and other respondents (68% [95% CI, 63%-73%] vs. 57% [95% CI, 52%-62%], P = 0.003). In basic numeracy, mean percent correct was 82% (95% CI, 77%-87%). For risk-adjustment numeracy, the mean percent correct was 70% (95% CI, 64%-76%). Risk-adjustment interpretation had the lowest average percent correct, 43% (95% CI, 37%-49%). All pairwise differences between concepts were statistically significant at P <0.05.

Conclusions: CLABSI quality metric comprehension appears low and varies substantially among clinicians. These findings may contribute to the limited impact of quality metric reporting programs, and further research is needed. Journal of Hospital Medicine 2017;12:18-22.

PubMed Disclaimer

Conflict of interest statement

Disclosures: The authors report no conflicts of interest.

Figures

FIG. 1
FIG. 1
Percent correct of attempted questions
FIG. 2
FIG. 2
Performance by conceptual category
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

References

    1. Scott RD., II The direct medical costs of healthcare-associated infections in us hospitals and the benefits of prevention. [Accessed November 8, 2016];Centers for Disease Control and Prevention. Available at: http://www.cdc.gov/HAI/pdfs/hai/Scott_CostPaper.pdf. Published March 2009.
    1. O’Grady NP, Alexander M, Burns LA, et al. Guidelines for the prevention of intravascular catheter-related infections. Am J Infect Control. 2011;39(4 suppl 1):S1–S34. - PubMed
    1. Blot K, Bergs J, Vogelaers D, Blot S, Vandijck D. Prevention of central line-associated bloodstream infections through quality improvement interventions: a systematic review and meta-analysis. Clin Infect Dis. 2014;59(1):96–105. - PMC - PubMed
    1. Mermel LA. Prevention of intravascular catheter-related infections. Ann Intern Med. 2000;132(5):391–402. - PubMed
    1. Siempos II, Kopterides P, Tsangaris I, Dimopoulou I, Armaganidis AE. Impact of catheter-related bloodstream infections on the mortality of critically ill patients: a meta-analysis. Crit Care Med. 2009;37(7):2283–2289. - PubMed

Publication types

MeSH terms

LinkOut - more resources