Assessment of a virtual reality temporal bone surgical simulator: a national face and content validity study

J Otolaryngol Head Neck Surg. 2020 Apr 7;49(1):17. doi: 10.1186/s40463-020-00411-y.

Abstract

Background: Trainees in Otolaryngology-Head and Neck Surgery must gain proficiency in a variety of challenging temporal bone surgical techniques. Traditional teaching has relied on the use of cadavers; however, this method is resource-intensive and does not allow for repeated practice. Virtual reality surgical training is a growing field that is increasingly being adopted in Otolaryngology. CardinalSim is a virtual reality temporal bone surgical simulator that offers a high-quality, inexpensive adjunct to traditional teaching methods. The objective of this study was to establish the face and content validity of CardinalSim through a national study.

Methods: Otolaryngologists and resident trainees from across Canada were recruited to evaluate CardinalSim. Ethics approval and informed consent was obtained. A face and content validity questionnaire with questions categorized into 13 domains was distributed to participants following simulator use. Descriptive statistics were used to describe questionnaire results, and either Chi-square or Fishers exact tests were used to compare responses between junior residents, senior residents, and practising surgeons.

Results: Sixty-two participants from thirteen different Otolaryngology-Head and Neck Surgery programs were included in the study (32 practicing surgeons; 30 resident trainees). Face validity was achieved for 5 out of 7 domains, while content validity was achieved for 5 out of 6 domains. Significant differences between groups (p-value of < 0.05) were found for one face validity domain (realistic ergonomics, p = 0.002) and two content validity domains (teaching drilling technique, p = 0.011 and overall teaching utility, p = 0.006). The assessment scores, global rating scores, and overall attitudes towards CardinalSim, were universally positive. Open-ended questions identified limitations of the simulator.

Conclusion: CardinalSim met acceptable criteria for face and content validity. This temporal bone virtual reality surgical simulation platform may enhance surgical training and be suitable for patient-specific surgical rehearsal for practicing Otolaryngologists.

Keywords: Content validity; Dissection; Education; Face validity; Patient-specific; Surgical simulation; Temporal bone; Virtual reality.

MeSH terms

  • Attitude of Health Personnel*
  • Canada
  • Clinical Competence
  • Ergonomics
  • Humans
  • Internship and Residency*
  • Medical Staff, Hospital / education
  • Otolaryngology / education*
  • Otorhinolaryngologic Surgical Procedures / education*
  • Reproducibility of Results
  • Temporal Bone / surgery*
  • Virtual Reality*