Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2013 Aug;66(8):874-82.
doi: 10.1016/j.jclinepi.2013.03.006.

The Oxford Implementation Index: a new tool for incorporating implementation data into systematic reviews and meta-analyses

Paul Montgomery  1 , Kristen Underhill, Frances Gardner, Don Operario, Evan Mayo-Wilson
Affiliations

The Oxford Implementation Index: a new tool for incorporating implementation data into systematic reviews and meta-analyses

Paul Montgomery et al. J Clin Epidemiol. 2013 Aug.

Abstract

Objectives: This article presents a new tool that helps systematic reviewers to extract and compare implementation data across primary trials. Currently, systematic review guidance does not provide guidelines for the identification and extraction of data related to the implementation of the underlying interventions.

Study design and setting: A team of systematic reviewers used a multistaged consensus development approach to develop this tool. First, a systematic literature search on the implementation and synthesis of clinical trial evidence was performed. The team then met in a series of subcommittees to develop an initial draft index. Drafts were presented at several research conferences and circulated to methodological experts in various health-related disciplines for feedback. The team systematically recorded, discussed, and incorporated all feedback into further revisions. A penultimate draft was discussed at the 2010 Cochrane-Campbell Collaboration Colloquium to finalize its content.

Results: The Oxford Implementation Index provides a checklist of implementation data to extract from primary trials. Checklist items are organized into four domains: intervention design, actual delivery by trial practitioners, uptake of the intervention by participants, and contextual factors. Systematic reviewers piloting the index at the Cochrane-Campbell Colloquium reported that the index was helpful for the identification of implementation data.

Conclusion: The Oxford Implementation Index provides a framework to help reviewers assess implementation data across trials. Reviewers can use this tool to identify implementation data, extract relevant information, and compare features of implementation across primary trials in a systematic review. The index is a work-in-progress, and future efforts will focus on refining the index, improving usability, and integrating the index with other guidance on systematic reviewing.

PubMed Disclaimer

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Chalmers I. Trying to do more good than harm in policy and practice: the role of rigorous, transparent, up-to-date, replicable evaluations. Ann Am Acad Polit Soc Sci. 2003;589(1):22–40.
    1. Jackson N, Waters E. for the Guidelines for Systematic Reviews of Health Promotion and Public Health Interventions Taskforce. The challenges of systematically reviewing public health interventions. J Public Health. 2004;26(3):303–307. - PubMed
    1. Dane A, Schneider B. Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clin Psychol Rev. 1998;18:23–45. - PubMed
    1. Dobson KS, Singer AR. Definitional and practical issues in the assessment of treatment integrity. Clin Psychol Sci Prac. 2005;12:384–387.
    1. Dusenbury L, Brannigan R, Falco M, Hansen W. A review of research on fidelity of implementation: implications for drug abuse in school settings. Health Educ Res. 2003;18(2):237–256. - PubMed

Publication types