Background: Evaluation studies of clinical decision support systems (CDSS) have tended to focus on assessments of system quality and clinical performance in a laboratory setting. Relatively few studies have used field trials to determine if CDSS are likely to be used in routine clinical settings and whether reminders generated are likely to be acted upon by end-users. Moreover, such studies when performed tend not to identify distinct user groups, nor to classify user feedback.
Aim: To assess medical residents' acceptance and adoption of a clinical reminder system for chronic disease and preventive care management and to use expressed preferences for system attributes and functionality as a basis for system re-engineering.
Design of study: Longitudinal, correlational study using a novel developmental trajectory analysis (DTA) statistical method, followed by a qualitative analysis based on user satisfaction surveys and field interviews.
Setting: An ambulatory primary care clinic of an urban teaching hospital offering comprehensive healthcare services. 41 medical residents used a CDSS over 10 months in their daily practice. Use of this system was strongly recommended but not mandatory.
Methods: A group-based, semi-parametric statistical modeling method to identify distinct groups, with distinct usage trajectories, followed by qualitative instruments of usability and satisfaction surveys and structured interviews to validate insights derived from usage trajectories.
Results: Quantitative analysis delineates three types of user adoption behavior: "light", "moderate" and "heavy" usage. Qualitative analysis reveals that clinicians of distinct types tend to exhibit views of the system consistent with their demonstrated adoption behavior. Drawbacks in the design of the CDSS identified by users of all types (in different ways) motivate a redesign based on current physician workflows.
Conclusion: We conclude that this mixed methodology has considerable promise to provide new insights into system usability and adoption issues that may benefit clinical decision support systems as well as information systems more generally.