Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2012 Mar 12:7:15.
doi: 10.1186/1748-5908-7-15.

Methods and metrics challenges of delivery-system research

Jeffrey A Alexander  1 , Larry R Hearld
Affiliations

Methods and metrics challenges of delivery-system research

Jeffrey A Alexander et al. Implement Sci. .

Abstract

Background: Many delivery-system interventions are fundamentally about change in social systems (both planned and unplanned). This systems perspective raises a number of methodological challenges for studying the effects of delivery-system change--particularly for answering questions related to whether the change will work under different conditions and how the change is integrated (or not) into the operating context of the delivery system.

Methods: The purpose of this paper is to describe the methodological and measurement challenges posed by five key issues in delivery-system research: (1) modeling intervention context; (2) measuring readiness for change; (3) assessing intervention fidelity and sustainability; (4) assessing complex, multicomponent interventions; and (5) incorporating time in delivery-system models to discuss recommendations for addressing these issues. For each issue, we provide recommendations for how research may be designed and implemented to overcome these challenges.

Results and conclusions: We suggest that a more refined understanding of the mechanisms underlying delivery-system interventions (treatment theory) and the ways in which outcomes for different classes of individuals change over time are fundamental starting points for capturing the heterogeneity in samples of individuals exposed to delivery-system interventions. To support the research recommendations outlined in this paper and to advance understanding of the "why" and "how" questions of delivery-system change and their effects, funding agencies should consider supporting studies with larger organizational sample sizes; longer duration; and nontraditional, mixed-methods designs.A version of this paper was prepared under contract with the Agency for Healthcare Research and Quality (AHRQ), US Department of Health and Human Services for presentation and discussion at a meeting on "The Challenge and Promise of Delivery System Research," held in Sterling, VA, on February 16-17, 2011. The opinions in the paper are those of the author and do not represent the views or recommendations of AHRQ or the US Department of Health and Human Services.1.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Method and metric challenges associated with studying delivery-system changea.
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Harrison MI, Henriksen K, Hughes RG. Improving the Health Care Work Environment: Implications for Research, Practice, and Policy. JtComm J Qual Patient Saf. 2007;33(Supplement 1):81–84. - PubMed
    1. Institute of Medicine. To err is human: Building a safer health care system. Washington, DC: National Academies Press; 2000. - PubMed
    1. Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academy Press; 2001. - PubMed
    1. Pawson R, Tilley N. Realistic Evaluation. London: Sage Publications, Ltd; 1997.
    1. Berwick D. The stories beneath. Med Care. 2007;45(12):1123–1125. doi: 10.1097/MLR.0b013e31815d18e6. - DOI - PubMed