Quantification of the impact of multifaceted initiatives intended to improve operational efficiency and the safety culture: a case study from an academic medical center radiation oncology department

Abstract

Purpose: We have systematically been incorporating several operational efficiency and safety initiatives into our academic radiation oncology clinic. We herein quantify the impact of these initiatives on prospectively collected, clinically meaningful, metrics.

Methods and materials: The data from 5 quality improvement initiatives, each focused on a specific safety/process concern in our clinic, are presented. Data was collected prospectively: operational metrics recorded before and after implementation of the initiative were compared using statistical analysis. Results from the Agency for Health Care Research and Quality (AHRQ) patient safety culture surveys administered during and after many of these initiatives were similarly compared.

Results: (1) Workload levels for nurses assisting with brachytherapy were high (National Aeronautics and Space Administration Task Load Index (NASA-TLX) scores >55-60, suggesting, "overwork"). Changes in work flow and procedure room layout reduced workload to more acceptable levels (NASA-TLX <55; P < .01). (2) The rate of treatment therapists being interrupted was reduced from a mean of 4 (range, 1-11) times per patient treatment to a mean <1 (range, 0-3; P < .001) after implementing standards for electronic communication and placement of monitors informing patients and staff of the treatment machine status (ie, delayed, on time). (3) The rates of replans by dosimetrists was reduced from 11% to 6% (P < .01) through a more systematic pretreatment peer review process. (4) Standardizing nursing and resident functions reduced patient wait times by ≈ 45% (14 min; P < .01). (5) Standardizing presimulation instructions from the physician reduced the number of patients experiencing delays on the simulator (>50% to <10%; P < .01). To assess the overall changes in "patient safety culture," we conducted a pre- and postanalysis using the AHRQ survey. Improvements in all measured dimensions were noted.

Conclusions: Quality improvement initiatives can be successfully implemented in an academic radiation oncology department to yield measurable improvements in operations resulting in improvement in patient safety culture.