Assessment of quality, absorbability, and educational value of YouTube videos regarding ankle fractures

Tanner R Stumpe; Austin M Graf; Christopher D Melton; Aditya K Devarakonda; Michael J Steflik; James A Blair; Stephen A Parada; Jana M Davis

doi:10.1016/j.jor.2023.02.016

Assessment of quality, absorbability, and educational value of YouTube videos regarding ankle fractures

J Orthop. 2023 Mar 7:38:32-37. doi: 10.1016/j.jor.2023.02.016. eCollection 2023 Apr.

Authors

Tanner R Stumpe¹, Austin M Graf¹, Christopher D Melton¹, Aditya K Devarakonda¹, Michael J Steflik¹, James A Blair¹, Stephen A Parada¹, Jana M Davis¹

Affiliation

¹ Medical College of Georgia at Augusta University, Department of Orthopaedic Surgery, 1120 15 Street, Augusta, GA, 30912, USA.

Abstract

Aims & objectives: YouTube is a non-peer-reviewed platform with a large library of healthcare-related videos which attempt to provide educational content. The goal of this study is to analyze the quality, absorbability, and educational content of videos available to patients on YouTube regarding ankle fractures.

Materials & methods: On May 31, 2022, over 550 videos populated the initial search of "ankle fracture" within YouTube's platform. The first 100 videos were reviewed, and 62 videos were included in the final analysis. Video characteristics were recorded and evaluated. Videos were assessed using three objective scoring systems: (1) the Journal of American Medical Association (JAMA) benchmark criteria, (2) the Patient Education Materials Assessment Tool for audio and visual materials (PEMAT), and (3) the novel Ankle Fracture Content Score (AFCS).

Results: Each scoring system had high internal consistency and interrater reliability. The mean JAMA, PEMAT understandability, PEMAT actionability, and AFCS were 2.92, 61.85%, 16.38%, and 4.67, respectively. No association was seen between video popularity metrics and quality of information. The understandability of the patient-targeted videos was greater than those targeted at healthcare professionals (P = 0.049).

Conclusion: The information regarding ankle fractures available on YouTube for patient education is poor with no correlation between quality and popularity. This study illustrates the need for future collaboration between YouTube and trusted medical societies to provide patients with the highest quality information.

Keywords: AAOS, America Academy of Orthopaedic Surgeons; ACFA, American College of Foot and Ankle Surgeons; AFCS, Ankle Fracture Content Score; AOFAS, American Orthopaedic Foot and Ankle Society; APMA, American Podiatric Medical Association; Ankle fracture education; Ankle injury; JAMA, Journal of American Medical Association benchmark criteria; OTA, Orthopaedic Trauma Association; PEMAT, Patient Education Materials Assessment Tool for audio and visual materials; Patient education; Video patient education; YouTube ankle fracture analysis.