Skip to main page content
Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2017 Feb 20;7(2):e012431.
doi: 10.1136/bmjopen-2016-012431.

Evaluating Investment in Quality Improvement Capacity Building: A Systematic Review

Affiliations
Free PMC article
Review

Evaluating Investment in Quality Improvement Capacity Building: A Systematic Review

Gustavo Mery et al. BMJ Open. .
Free PMC article

Abstract

Purpose: Leading health systems have invested in substantial quality improvement (QI) capacity building, but little is known about the aggregate effect of these investments at the health system level. We conducted a systematic review to identify key steps and elements that should be considered for system-level evaluations of investment in QI capacity building.

Methods: We searched for evaluations of QI capacity building and evaluations of QI training programmes. We included the most relevant indexed databases in the field and a strategic search of the grey literature. The latter included direct electronic scanning of 85 relevant government and institutional websites internationally. Data were extracted regarding evaluation design and common assessment themes and components.

Results: 48 articles met the inclusion criteria. 46 articles described initiative-level non-economic evaluations of QI capacity building/training, while 2 studies included economic evaluations of QI capacity building/training, also at the initiative level. No system-level QI capacity building/training evaluations were found. We identified 17 evaluation components that fit within 5 overarching dimensions (characteristics of QI training; characteristics of QI activity; individual capacity; organisational capacity and impact) that should be considered in evaluations of QI capacity building. 8 key steps in return-on-investment (ROI) assessments in QI capacity building were identified: (1) planning-stakeholder perspective; (2) planning-temporal perspective; (3) identifying costs; (4) identifying benefits; (5) identifying intangible benefits that will not be included in the ROI estimation; (6) discerning attribution; (7) ROI calculations; (8) sensitivity analysis.

Conclusions: The literature on QI capacity building evaluation is limited in the number and scope of studies. Our findings, summarised in a Framework to Guide Evaluations of QI Capacity Building, can be used to start closing this knowledge gap.

Conflict of interest statement

Competing interests: None declared.

Figures

Figure 1
Figure 1
Searching and screening process and number of articles identified.
Figure 2
Figure 2
Framework to guide evaluations of quality improvement capacity building.

Similar articles

See all similar articles

Cited by 4 articles

References

    1. Øvretveit J. Does improving quality save money? A review of evidence of which improvements to quality reduce costs to health service providers. London: The Health Foundation, 2009.
    1. Dentzer S. Still crossing the quality chasm—or suspended over? Health Aff (Millwood) 2011;30:554–5. 10.1377/hlthaff.2011.0287 - DOI - PubMed
    1. Adler PS, Riley P, Kwon SW et al. Performance improvement capability: keys to accelerating improvement to hospitals. California Manag Rev 2003;45:12–33.
    1. Chassin MR, Loeb JM. The ongoing quality improvement journey: next stop, high reliability. Health Aff (Millwood) 2011;30:559–68. 10.1377/hlthaff.2011.0076 - DOI - PubMed
    1. Batalden PB, Davidoff F. What is “quality improvement”, and how can it transform health care? Qual Saf Health Care 2007;16:2–3. 10.1136/qshc.2006.022046 - DOI - PMC - PubMed
Feedback