Does user-centred design affect the efficiency, usability and safety of CPOE order sets?
- PMID: 21486886
- PMCID: PMC3078654
- DOI: 10.1136/amiajnl-2010-000026
Does user-centred design affect the efficiency, usability and safety of CPOE order sets?
Abstract
Background: Application of user-centred design principles to Computerized provider order entry (CPOE) systems may improve task efficiency, usability or safety, but there is limited evaluative research of its impact on CPOE systems.
Objective: We evaluated the task efficiency, usability, and safety of three order set formats: our hospital's planned CPOE order sets (CPOE Test), computer order sets based on user-centred design principles (User Centred Design), and existing pre-printed paper order sets (Paper).
Participants: 27 staff physicians, residents and medical students.
Setting: Sunnybrook Health Sciences Centre, an academic hospital in Toronto, Canada. Methods Participants completed four simulated order set tasks with three order set formats (two CPOE Test tasks, one User Centred Design, and one Paper). Order of presentation of order set formats and tasks was randomized. Users received individual training for the CPOE Test format only.
Main measures: Completion time (efficiency), requests for assistance (usability), and errors in the submitted orders (safety).
Results: 27 study participants completed 108 order sets. Mean task times were: User Centred Design format 273 s, Paper format 293 s (p=0.73 compared to UCD format), and CPOE Test format 637 s (p<0.0001 compared to UCD format). Users requested assistance in 31% of the CPOE Test format tasks, whereas no assistance was needed for the other formats (p<0.01). There were no significant differences in number of errors between formats.
Conclusions: The User Centred Design format was more efficient and usable than the CPOE Test format even though training was provided for the latter. We conclude that application of user-centred design principles can enhance task efficiency and usability, increasing the likelihood of successful implementation.
Conflict of interest statement
Figures
Similar articles
-
Usability evaluation of order sets in a computerised provider order entry system.BMJ Qual Saf. 2011 Nov;20(11):932-40. doi: 10.1136/bmjqs.2010.050021. Epub 2011 Jul 31. BMJ Qual Saf. 2011. PMID: 21807652
-
Longitudinal study of user experiences of a CPOE system in a pediatric hospital.Int J Med Inform. 2018 Jan;109:5-14. doi: 10.1016/j.ijmedinf.2017.10.018. Epub 2017 Oct 31. Int J Med Inform. 2018. PMID: 29195706
-
Use of order sets in inpatient computerized provider order entry systems: a comparative analysis of usage patterns at seven sites.Int J Med Inform. 2012 Nov;81(11):733-45. doi: 10.1016/j.ijmedinf.2012.04.003. Epub 2012 Jul 18. Int J Med Inform. 2012. PMID: 22819199 Free PMC article.
-
CPOE system design aspects and their qualitative effect on usability.Stud Health Technol Inform. 2008;136:309-14. Stud Health Technol Inform. 2008. PMID: 18487749 Review.
-
The impact of CPOE medication systems' design aspects on usability, workflow and medication orders: a systematic review.Methods Inf Med. 2010;49(1):3-19. doi: 10.3414/ME0630. Epub 2009 Jul 6. Methods Inf Med. 2010. PMID: 19582333 Review.
Cited by
-
Designing and testing clinical simulations of an early warning system for implementation in acute care settings.JAMIA Open. 2024 Oct 16;7(4):ooae092. doi: 10.1093/jamiaopen/ooae092. eCollection 2024 Dec. JAMIA Open. 2024. PMID: 39415945 Free PMC article.
-
Human factors and ergonomics methods for pharmacy research and clinical practice.Res Social Adm Pharm. 2021 Dec;17(12):2019-2027. doi: 10.1016/j.sapharm.2021.04.024. Epub 2021 May 2. Res Social Adm Pharm. 2021. PMID: 33985892 Free PMC article. Review.
-
Effectiveness of an eHealth self-management tool for older adults with multimorbidity (KeepWell): protocol for a hybrid effectiveness-implementation randomised controlled trial.BMJ Open. 2021 Feb 17;11(2):e048350. doi: 10.1136/bmjopen-2020-048350. BMJ Open. 2021. PMID: 33597147 Free PMC article.
-
The cirrhosis care Alberta (CCAB) protocol: implementing an evidence-based best practice order set for the management of liver cirrhosis - a hybrid type I effectiveness-implementation trial.BMC Health Serv Res. 2020 Jun 18;20(1):558. doi: 10.1186/s12913-020-05427-8. BMC Health Serv Res. 2020. PMID: 32552833 Free PMC article.
-
Evaluating users' experiences of electronic prescribing systems in relation to patient safety: a mixed methods study.BMC Med Inform Decis Mak. 2020 Apr 3;20(1):62. doi: 10.1186/s12911-020-1080-9. BMC Med Inform Decis Mak. 2020. PMID: 32245467 Free PMC article.
References
-
- Kaushal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch Intern Med 2003;163:1409–16 - PubMed
-
- Aarts J, Koppel R. Implementation of computerized physician order entry in seven countries. Health Aff (Millwood) 2009;28:404–14 - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Medical
