Objective: In this study, we used human factors (HF) methods and principles to design a clinical decision support (CDS) that provides cognitive support to the pulmonary embolism (PE) diagnostic decision-making process in the emergency department. We hypothesised that the application of HF methods and principles will produce a more usable CDS that improves PE diagnostic decision-making, in particular decision about appropriate clinical pathway.
Materials and methods: We conducted a scenario-based simulation study to compare a HF-based CDS (the so-called CDS for PE diagnosis (PE-Dx CDS)) with a web-based CDS (MDCalc); 32 emergency physicians performed various tasks using both CDS. PE-Dx integrated HF design principles such as automating information acquisition and analysis, and minimising workload. We assessed all three dimensions of usability using both objective and subjective measures: effectiveness (eg, appropriate decision regarding the PE diagnostic pathway), efficiency (eg, time spent, perceived workload) and satisfaction (perceived usability of CDS).
Results: Emergency physicians made more appropriate diagnostic decisions (94% with PE-Dx; 84% with web-based CDS; p<0.01) and performed experimental tasks faster with the PE-Dx CDS (on average 96 s per scenario with PE-Dx; 117 s with web-based CDS; p<0.001). They also reported lower workload (p<0.001) and higher satisfaction (p<0.001) with PE-Dx.
Conclusions: This simulation study shows that HF methods and principles can improve usability of CDS and diagnostic decision-making. Aspects of the HF-based CDS that provided cognitive support to emergency physicians and improved diagnostic performance included automation of information acquisition (eg, auto-populating risk scoring algorithms), minimisation of workload and support of decision selection (eg, recommending a clinical pathway). These HF design principles can be applied to the design of other CDS technologies to improve diagnostic safety.
Keywords: decision making; decision support, clinical; diagnostic errors; emergency department; human factors.
© Author(s) (or their employer(s)) 2019. No commercial re-use. See rights and permissions. Published by BMJ.
Conflict of interest statement
Competing interests: None declared.
Usability Testing of a Complex Clinical Decision Support Tool in the Emergency Department: Lessons LearnedA Press et al. JMIR Hum Factors 2 (2), e14. PMID 27025540.This study successfully combined "think-aloud" protocol analysis with "near-live" clinical simulations in a usability evaluation of a CDS tool that will be implemented in …
The Design of PE Dx, a CDS to Support Pulmonary Embolism Diagnosis in the EDPLT Hoonakker et al. Stud Health Technol Inform 265, 134-140. PMID 31431589.Designing and implementing clinical decision support (CDS) in health care has been challenging. Attempts have been made to design and implement CDS to support clinical pr …
Applying Human Factors Principles to Alert Design Increases Efficiency and Reduces Prescribing Errors in a Scenario-Based SimulationAL Russ et al. J Am Med Inform Assoc 21 (e2), e287-96. PMID 24668841.This simulation study provides evidence that applying human factors design principles to medication alerts can improve usability and prescribing outcomes.
Integrative Review of Clinical Decision Support for Registered Nurses in Acute Care SettingsK Dunn Lopez et al. J Am Med Inform Assoc 24 (2), 441-450. PMID 27330074. - ReviewClinical support systems targeting bedside nurses have positive effects on outcomes and hold promise for improving care quality; however, this research is lagging behind …
Adoption of Clinical Decision Support in Multimorbidity: A Systematic ReviewP Fraccaro et al. JMIR Med Inform 3 (1), e4. PMID 25785897. - ReviewThis review shows that multimorbidity is underinvestigated in the informatics of supporting clinical decisions. CDS interventions that systematize clinical practice guide …