Dr Google - assessing the reliability and readability of information on general surgical procedures found via search engines

ANZ J Surg. 2023 Mar;93(3):590-596. doi: 10.1111/ans.18289. Epub 2023 Jan 30.

Abstract

Background: The most common general surgical emergency operations are laparoscopic appendicectomy, laparoscopic cholecystectomy, hernia repair, hemorrhoidectomy and colectomy. Patients commonly perform an internet search for more information prior to undergoing surgery, which can lead to an inappropriate understanding of their procedure. The aim is to assess the quality of information available on three of the most used search engines.

Methods: A search was conducted on Google.com, Bing.com and Yahoo.com using the terms related to laparoscopic appendicectomy, laparoscopic cholecystectomy, hemorrhoidectomy, hernia repair and colectomy. First 20 results from each search engine were collected for evaluation. Results were excluded if they were sponsored, duplicates, academic publications, advertisements, forums, audiovisual tools, social media or any non-English information. Included results were assessed for reliability using DISCERN and JAMA benchmark score. Readability was assessed using Flesch Reading Ease (FRE) Score and Simple Measure of Gobbledygook (SMOG).

Results: Hundred and ninety-seven websites were analysed, 44.7% were published by institutions, 34.5% by health websites and 20.8% by independent surgeons. Mean DISCERN scores for Institutions was 54.6 ± 11.3, independent surgeons 45.9 ± 11.4 and health websites 58.7 ± 10.3. Mean JAMA score for Institutions was 1.0 ± 1.0, independent surgeons 0.1 ± 0.4 and health websites 1.7 ± 1.1. FRE scores for institutions was 51.6 ± 10.3, independent surgeons 40.9 ± 10.2, and health websites 45.7 ± 12.3. SMOG scores were 9.8 ± 1.5 for institutions, 11.4 ± 1.6 for independent surgeons and 10.6 ± 1.7 for health websites.

Conclusion: Health information on common general surgical procedures found on search engines are generally fair to good quality but still above the suggested reading level of the population. Information on surgical procedures should be written at recommended reading level of 13-14 years old.

Keywords: appendicectomy; cholecystectomy; colectomy; haemorrhoidectomy; hernia repair; patient information; readability; reliability; search engine; surgical procedures.

MeSH terms

  • Adolescent
  • Comprehension
  • Consumer Health Information* / methods
  • Humans
  • Internet
  • Reproducibility of Results
  • Search Engine*
  • Smog

Substances

  • Smog