Validation of a flexible endoscopy simulator

Am J Surg. 2005 Apr;189(4):497-500. doi: 10.1016/j.amjsurg.2005.01.008.

Abstract

Background: Virtual reality (VR) simulation is a rapidly proliferating adjunct of surgical training. Numerous devices have evolved as educational tools in a variety of fields. Whether these tools can be used for validation of physicians' skills has yet to be determined. The objective of this study was to determine whether the GI Mentor (Simbionix, Lod, Israel) flexible endoscopy simulator construct could distinguish experienced endoscopists from beginners.

Methods: Seventy-five surgical attendings, fellows, and residents were recruited for participation in the study. Two cohorts were used and these groups were selected from 2 separate scientific sessions. Participants completed a standardized questionnaire documenting their endoscopic training and experience. Physicians subsequently were designated as experienced or beginner after their endoscopic training and experience were evaluated. All participants completed 1 of 2 colonoscopic simulations. The GI Mentor objectively evaluated performance on the basis of programmed data points, including the time to reach the cecum, the percentage of mucosa visualized, the completed polypectomy rate, the percentage of time spent in clear view through the lumen, the percentage of time that the patient was in pain, and overall efficiency.

Results: In both simulations, experienced endoscopists were more efficient than beginners (.32%/s vs. .26%/s, P=.02; and .53%/s vs. .37%/s, P=.03) and achieved a greater polypectomy rate (78% vs. 43%, P=.03; and 87% vs. 48%, P=.01). Furthermore, experienced endoscopists visualized more of the colonic surface (86% vs. 82%, P=.02) and spent a greater proportion of the time in clear view of the lumen (55% vs. 47%, P=.05) than beginners completing the first simulation. In the second simulation, experienced participants reached the cecum more rapidly than beginners (175 vs. 262 s, P=.01).

Conclusions: The G1 Mentor VR colonoscopy construct appears valid. Significant performance differences were shown between the experienced and beginner cohorts. The beginner participants in this study were all physicians with some degree of endoscopic experience. Therefore, the G1 Mentor distinguished endoscopists of varying experience and exposure. Further validation studies are needed to evaluate the breadth of programs inherent to this simulator and to determine whether it may be used in the future for qualification and certification purposes.

Publication types

  • Comparative Study
  • Validation Study

MeSH terms

  • Clinical Competence*
  • Cohort Studies
  • Colonoscopes*
  • Colonoscopy / methods*
  • Computer Simulation*
  • Fellowships and Scholarships
  • Female
  • Fiber Optic Technology
  • Gastroenterology / education
  • Humans
  • Internship and Residency
  • Male
  • Medical Staff, Hospital
  • Probability
  • Sensitivity and Specificity
  • Surveys and Questionnaires
  • United States
  • User-Computer Interface*