An automated procedure logging system improves resident documentation compliance

Abstract

Objectives: The purpose of this study was to determine the effect of an automated procedure logging (APL) system on the number of procedures logged by emergency medicine (EM) residents. Secondary objectives were to assess the APL's effect on completeness and accuracy of procedure logging and to measure resident compliance with the system.

Methods: This was a before-and-after study conducted at a university-affiliated, urban medical center, with an annual emergency department census of >130,000. The EM residency is a 4-year, Residency Review Committee (RRC)-accredited program with 12 residents per year. We developed software to electronically search and abstract resident procedures documented in the electronic medical record (EMR) and automatically export them into a Web-based residency management system. We compared the mean daily number of procedures logged for two 6-month periods: October 1, 2009, to March 31, 2010 (pre-APL), and October 1, 2010, to March 31, 2011 (post-APL), using a two-sample t-test. We also generated a random sample of 231 logged procedures from both the pre- and post-APL time periods to assess for completeness and accuracy of data transfer. Completeness and accuracy in the pre- and post-APL periods were compared using Fisher's exact test. Aggregate resident compliance with the system was also measured.

Results: The mean daily number of procedures logged increased by 168% (10.0 vs. 26.8, mean difference = 16.8, 95% confidence interval [CI] = 15.4 to 18.2, p < 0.001) after the implementation of APL. Procedures logged with the APL system were more complete (76% vs. 100%, p < 0.001) and more accurate (87% vs. 99%, p < 0.001). Most residents (42/48, 88%) used APL to log at least 90% of procedures. Only 4% of procedures eligible for automation were logged manually in the post-APL period.

Conclusions: There was a significant increase in the daily mean number of procedures logged after the implementation of APL. Recorded data were more complete and more accurate during this time frame. This innovative system improved resident logging of required procedures and helped our assessment of Accreditation Council for Graduate Medical Education (ACGME) Patient Care and Practice-Based Learning Competencies for individual residents.