Effect of Feedback Modality on Simulated Surgical Skills Learning Using Automated Educational Systems- A Four-Arm Randomized Control Trial

Recai Yilmaz; Ali M Fazlollahi; Alexander Winkler-Schwartz; Anna Wang; Hafila Hassan Makhani; Ahmad Alsayegh; Mohamad Bakhaidar; Dan Huy Tran; Carlo Santaguida; Rolando F Del Maestro

doi:10.1016/j.jsurg.2023.11.001

Effect of Feedback Modality on Simulated Surgical Skills Learning Using Automated Educational Systems- A Four-Arm Randomized Control Trial

J Surg Educ. 2024 Feb;81(2):275-287. doi: 10.1016/j.jsurg.2023.11.001. Epub 2023 Dec 29.

Authors

Affiliations

¹ Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada; Faculty of Medicine and Health Sciences, McGill University, Montreal, Canada. Electronic address: recai.yilmaz@mail.com.
² Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada; Faculty of Medicine and Health Sciences, McGill University, Montreal, Canada.
³ Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada; Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada.
⁴ Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada.
⁵ Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada; Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada; Division of Neurosurgery, Department of Surgery, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia.
⁶ Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada.
⁷ Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada; Faculty of Medicine and Health Sciences, McGill University, Montreal, Canada; Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada.

PMID: 38160107
DOI: 10.1016/j.jsurg.2023.11.001

Abstract

Objective: To explore optimal feedback methodologies to enhance trainee skill acquisition in simulated surgical bimanual skills learning during brain tumor resections.

Hypotheses: (1) Providing feedback results in better learning outcomes in teaching surgical technical skill when compared to practice alone with no tailored performance feedback. (2) Providing more visual and visuospatial feedback results in better learning outcomes when compared to providing numerical feedback.

Design: A prospective 4-parallel-arm randomized controlled trial.

Setting: Neurosurgical Simulation and Artificial Intelligence Learning Centre, McGill University, Canada.

Participants: Medical students (n = 120) from 4 Quebec medical schools.

Results: Participants completed a virtually simulated tumor resection task 5 times while receiving 1 of 4 feedback based on their group allocation: (1) practice-alone without feedback, (2) numerical feedback, (3) visual feedback, and (4) visuospatial feedback. Outcome measures were participants' scores on 14-performance metrics and the number of expert benchmarks achieved during each task. There were no significant differences in the first task which determined baseline performance. A statistically significant interaction between feedback allocation and task repetition was found on the number of benchmarks achieved, F (10.558, 408.257)=3.220, p < 0.001. Participants in all feedback groups significantly improved their performance compared to baseline. The visual feedback group achieved significantly higher number of benchmarks than the practice-alone group by the third repetition of the task, p = 0.005, 95%CI [0.42 3.25]. Visual feedback and visuospatial feedback improved performance significantly by the second repetition of the task, p = 0.016, 95%CI [0.19 2.71] and p = 0.003, 95%CI [0.4 2.57], respectively.

Conclusion: Simulations with autonomous visual computer assistance may be effective pedagogical tools in teaching bimanual operative skills via visual and visuospatial feedback information delivery.

Keywords: neurosurgery; simulation; surgical education; technical skill; virtual reality.

Publication types

Randomized Controlled Trial

MeSH terms

Artificial Intelligence*
Clinical Competence
Computer Simulation
Feedback
Humans
Prospective Studies
Simulation Training* / methods