Twin-S: a digital twin for skull base surgery

Int J Comput Assist Radiol Surg. 2023 Jun;18(6):1077-1084. doi: 10.1007/s11548-023-02863-9. Epub 2023 May 9.

Abstract

Purpose: Digital twins are virtual replicas of real-world objects and processes, and they have potential applications in the field of surgical procedures, such as enhancing situational awareness. We introduce Twin-S, a digital twin framework designed specifically for skull base surgeries.

Methods: Twin-S is a novel framework that combines high-precision optical tracking and real-time simulation, making it possible to integrate it into image-guided interventions. To guarantee accurate representation, Twin-S employs calibration routines to ensure that the virtual model precisely reflects all real-world processes. Twin-S models and tracks key elements of skull base surgery, including surgical tools, patient anatomy, and surgical cameras. Importantly, Twin-S mirrors real-world drilling and updates the virtual model at frame rate of 28.

Results: Our evaluation of Twin-S demonstrates its accuracy, with an average error of 1.39 mm during the drilling process. Our study also highlights the benefits of Twin-S, such as its ability to provide augmented surgical views derived from the continuously updated virtual model, thus offering additional situational awareness to the surgeon.

Conclusion: We present Twin-S, a digital twin environment for skull base surgery. Twin-S captures the real-world surgical progresses and updates the virtual model in real time through the use of modern tracking technologies. Future research that integrates vision-based techniques could further increase the accuracy of Twin-S.

Keywords: Computer vision; Human–computer interaction; Image-guided intervention; Intervention planning and simulation.

MeSH terms

  • Computer Simulation
  • Humans
  • Imaging, Three-Dimensional / methods
  • Neurosurgical Procedures
  • Skull Base / surgery
  • Surgery, Computer-Assisted* / methods