An evidence-based practice guideline for the peer review of electronic search strategies

J Clin Epidemiol. 2009 Sep;62(9):944-52. doi: 10.1016/j.jclinepi.2008.10.012. Epub 2009 Feb 20.

Abstract

Objective: Complex and highly sensitive electronic literature search strategies are required for systematic reviews; however, no guidelines exist for their peer review. Poor searches may fail to identify existing evidence because of inadequate recall (sensitivity) or increase the resource requirements of reviews as a result of inadequate precision. Our objective was to create an annotated checklist for electronic search strategy peer review.

Study design: A systematic review of the library and information retrieval literature for important elements in electronic search strategies was conducted, along with a survey of individuals experienced in systematic review searching.

Results: Six elements with a strong consensus as to their importance in peer review were accurate translation of the research question into search concepts, correct choice of Boolean operators and of line numbers, adequate translation of the search strategy for each database, inclusion of relevant subject headings, and absence of spelling errors. Seven additional elements had partial support and are included in this guideline.

Conclusion: This evidence-based guideline facilitates the improvement of search quality through peer review, and thus the improvement in quality of systematic reviews. It is relevant for librarians/information specialists, journal editors, developers of knowledge translation tools, research organizations, and funding bodies.

Publication types

  • Research Support, Non-U.S. Gov't
  • Review
  • Systematic Review

MeSH terms

  • Bibliometrics
  • Databases, Bibliographic
  • Evidence-Based Practice
  • Information Storage and Retrieval / methods
  • Information Storage and Retrieval / standards*
  • Peer Review*
  • Review Literature as Topic
  • Technology Assessment, Biomedical / methods