Qualitative review of usability problems in health information systems for radiology

J Biomed Inform. 2017 Dec:76:19-33. doi: 10.1016/j.jbi.2017.10.004. Epub 2017 Oct 21.

Abstract

Background: Radiology processes are commonly supported by Radiology Information System (RIS), Picture Archiving and Communication System (PACS) and other software for radiology. However, these information technologies can present usability problems that affect the performance of radiologists and physicians, especially considering the complexity of the tasks involved.

Objectives: The purpose of this study was to extract, classify and analyze qualitatively the usability problems in PACS, RIS and other software for radiology.

Method: A systematic review was performed to extract usability problems reported in empirical usability studies in the literature. The usability problems were categorized as violations of Nielsen and Molich's usability heuristics.

Results: The qualitative analysis indicated the causes and the effects of the identified usability problems. From the 431 papers initially identified, 10 met the study criteria. The analysis of the papers identified 90 instances of usability problems, classified into categories corresponding to established usability heuristics. The five heuristics with the highest number of instances of usability problems were "Flexibility and efficiency of use", "Consistency and standards", "Match between system and the real world", "Recognition rather than recall" and "Help and documentation", respectively.

Conclusion: These problems can make the interaction time consuming, causing delays in tasks, dissatisfaction, frustration, preventing users from enjoying all the benefits and functionalities of the system, as well as leading to more errors and difficulties in carrying out clinical analyses. Furthermore, the present paper showed a lack of studies performed on systems for radiology, especially usability evaluations using formal methods of evaluation involving the final users.

Keywords: Nielsen heuristics; PACS; Qualitative analysis; RIS; Radiology; Systematic review; Usability problems.

Publication types

  • Review
  • Systematic Review

MeSH terms

  • Humans
  • Qualitative Research
  • Radiology Information Systems / statistics & numerical data*
  • Software
  • User-Computer Interface