Development and evaluation of an objective laparoscopic assessment tool: LapPass®

Ann R Coll Surg Engl. 2021 Nov 25. doi: 10.1308/rcsann.2021.0207. Online ahead of print.

Abstract

Introduction: Laparoscopic surgery is technically challenging and assessment of competency is necessary to ensure patient safety and guide training. We report on the development of LapPass®, an accessible objective simulation assessment tool with credentialing potential. We provide a preliminary evaluation of its usability and aspects of validity.

Methods: The domains of LapPass® were defined through a consensus process by the executive council of the Association of Laparoscopic Surgeons of Great Britain and Ireland (ALSGBI). A survey of both assessors and trainees was used to test for usability, face and content validity of LapPass®. Internal consistency was tested with Cronbach's alpha, and a composite marker of validity and usability was obtained.

Results: LapPass® was developed to consist of four tasks: (1) grasping and manipulation, (2) simulated appendicectomy, (3) cutting a disk and (4) intracorporeal suturing. A total of 76 participants contributed to the evaluation of LapPass®: 13 assessors and 63 trainees. For assessors, Cronbach's alpha for usability of tasks 1-4 was 0.84, 0.84, 0.76 and 0.86, whereas validity was 0.80, 0.85, 0.88, 0.95, respectively. For trainees, Cronbach's alpha was 0.75, 0.77, 0.80 and 0.85 for usability, and 0.79, 093, 0.87 and 0.91 for validity. Consensus was that each task was usable and had face and content validity, with median scores of 4.0 or higher (interquartile range 0.0-1.0).

Conclusion: LapPass® has potential for the objective assessment of basic laparoscopic skills but further research is required to explore its predictive capabilities in a clinical setting.

Keywords: Laparoscopic training – Simulation assessment – Objective assessment – Surgical skills.