Evaluation of the Potential Utility of an Artificial Intelligence Chatbot in Gastroesophageal Reflux Disease Management

Am J Gastroenterol. 2023 Dec 1;118(12):2276-2279. doi: 10.14309/ajg.0000000000002397. Epub 2023 Jul 10.

Abstract

Introduction: Artificial intelligence chatbots could serve as an information resource for patients and a tool for clinicians. Their ability to respond appropriately to questions regarding gastroesophageal reflux disease is unknown.

Methods: Twenty-three prompts regarding gastroesophageal reflux disease management were submitted to ChatGPT, and responses were rated by 3 gastroenterologists and 8 patients.

Results: ChatGPT provided largely appropriate responses (91.3%), although with some inappropriateness (8.7%) and inconsistency. Most responses (78.3%) contained at least some specific guidance. Patients considered this a useful tool (100%).

Discussion: ChatGPT's performance demonstrates the potential for this technology in health care, although also its limitations in its current state.

Publication types

  • Research Support, N.I.H., Extramural

MeSH terms

  • Artificial Intelligence
  • Gastroenterologists*
  • Gastroesophageal Reflux* / diagnosis
  • Gastroesophageal Reflux* / therapy
  • Humans
  • Software