Consensus building for development of outpatient adverse drug event triggers

J Patient Saf. 2011 Jun;7(2):66-71. doi: 10.1097/PTS.0b013e31820c98ba.


Objectives: Adverse drug event (ADE) detection is an important priority of patient safety research. Trigger tools have been developed to help identify ADEs. As part of a larger study, we developed complex and specific trigger algorithms intended for concurrent use with clinical care to detect outpatient ADEs. This article assesses the use of a modified Delphi process to obtain expert consensus on the value of these triggers.

Methods: We selected a panel of distinguished clinical and research experts to participate in the modified Delphi process. We created a set of outpatient ADE triggers based on literature review, clinical input, and methodological expertise. The importance of the targeted ADEs, associated drug classes, and trigger logic was used to rate each trigger. Specific criteria were developed to establish consensus.

Results: The modified Delphi process established consensus on 6 outpatient ADE triggers to test with patient-level data based on high ratings of utility for patient-level interventions. These triggers focused on detecting ADEs caused by the following drugs or drug classes: bone marrow toxins, potassium raisers, potassium reducers, creatinine, warfarin, and sedative hypnotics. Participants reported including all aspects of the trigger in their ratings, despite our efforts to separate evaluation of clinical need and trigger logic. Participants' expertise affected the evaluation of trigger rules, leading to contradictory feedback on how to improve trigger design.

Conclusions: The efficiency of the modified Delphi method could be improved by allowing participants to produce an overall summary score that incorporates both the clinical value and the general logic of the trigger. Revising and improving trigger design should be conducted in a separate process limited only to trigger experts.

Publication types

  • Research Support, U.S. Gov't, P.H.S.

MeSH terms

  • Ambulatory Care / methods*
  • Consensus
  • Decision Support Systems, Clinical*
  • Delphi Technique
  • Drug-Related Side Effects and Adverse Reactions / diagnosis*
  • Drug-Related Side Effects and Adverse Reactions / etiology
  • Humans
  • Medication Errors / adverse effects*