Healthcare provider evaluation of machine learning-directed care: reactions to deployment on a randomised controlled study

BMJ Health Care Inform. 2023 Feb;30(1):e100674. doi: 10.1136/bmjhci-2022-100674.


Objectives: Clinical artificial intelligence and machine learning (ML) face barriers related to implementation and trust. There have been few prospective opportunities to evaluate these concerns. System for High Intensity EvaLuation During Radiotherapy (NCT03775265) was a randomised controlled study demonstrating that ML accurately directed clinical evaluations to reduce acute care during cancer radiotherapy. We characterised subsequent perceptions and barriers to implementation.

Methods: An anonymous 7-question Likert-type scale survey with optional free text was administered to multidisciplinary staff focused on workflow, agreement with ML and patient experience.

Results: 59/71 (83%) responded. 81% disagreed/strongly disagreed their workflow was disrupted. 67% agreed/strongly agreed patients undergoing intervention were high risk. 75% agreed/strongly agreed they would implement the ML approach routinely if the study was positive. Free-text feedback focused on patient education and ML predictions.

Conclusions: Randomised data and firsthand experience support positive reception of clinical ML. Providers highlighted future priorities, including patient counselling and workflow optimisation.

Keywords: Delivery of Health Care; Machine Learning.

Publication types

  • Randomized Controlled Trial

MeSH terms

  • Artificial Intelligence*
  • Health Personnel*
  • Humans
  • Machine Learning
  • Prospective Studies
  • Surveys and Questionnaires