Bariatric Evaluation Through AI: a Survey of Expert Opinions Versus ChatGPT-4 (BETA-SEOV)

Amir Hossein Davarpanah Jazi; Mohammad Mahjoubi; Shahab Shahabi; Aayed R Alqahtani; Ashraf Haddad; Abdolreza Pazouki; Arun Prasad; Bassem Y Safadi; Sonja Chiappetta; Halit Eren Taskin; Helmuth Thorlakur Billy; Kazunori Kasama; Kamal Mahawar; Khaled Gawdat; Karl Peter Rheinwalt; Karl A Miller; Lilian Kow; Manoel Galvao Neto; Wah Yang; Mariano Palermo; Omar M Ghanem; Panagiotis Lainas; Ralph Peterli; Radwan Kassir; Ramon Vilallonga Puy; Rui José Da Silva Ribeiro; Sergio Verboonen; Tadeja Pintar; Asim Shabbir; Mario Musella; Mohammad Kermansaravi

doi:10.1007/s11695-023-06903-w

Bariatric Evaluation Through AI: a Survey of Expert Opinions Versus ChatGPT-4 (BETA-SEOV)

Obes Surg. 2023 Dec;33(12):3971-3980. doi: 10.1007/s11695-023-06903-w. Epub 2023 Oct 27.

Authors

Amir Hossein Davarpanah Jazi¹, Mohammad Mahjoubi², Shahab Shahabi³, Aayed R Alqahtani⁴, Ashraf Haddad⁵, Abdolreza Pazouki¹, Arun Prasad⁶, Bassem Y Safadi⁷, Sonja Chiappetta⁸, Halit Eren Taskin⁹, Helmuth Thorlakur Billy¹⁰, Kazunori Kasama¹¹, Kamal Mahawar¹², Khaled Gawdat¹³, Karl Peter Rheinwalt¹⁴, Karl A Miller¹⁵, Lilian Kow¹⁶, Manoel Galvao Neto¹⁷, Wah Yang¹⁸, Mariano Palermo¹⁹, Omar M Ghanem²⁰, Panagiotis Lainas²¹, Ralph Peterli²², Radwan Kassir²³, Ramon Vilallonga Puy²⁴, Rui José Da Silva Ribeiro²⁵, Sergio Verboonen²⁶, Tadeja Pintar²⁷, Asim Shabbir²⁸, Mario Musella²⁹, Mohammad Kermansaravi¹

Affiliations

¹ Department of Surgery, Minimally Invasive Surgery Research Center, Division of Minimally Invasive and Bariatric Surgery, School of Medicine, Rasool-E Akram Hospital, Iran University of Medical Sciences, Niyaesh Avenue, Sattar Khan Street, Tehran, Iran.
² Clinical Research Development Center, Najafabad Branch, Islamic Azad University, Najafabad, Iran.
³ Department of Surgery, Minimally Invasive Surgery Research Center, Division of Minimally Invasive and Bariatric Surgery, School of Medicine, Rasool-E Akram Hospital, Iran University of Medical Sciences, Niyaesh Avenue, Sattar Khan Street, Tehran, Iran. shshahabi@yahoo.com.
⁴ New Medical Center, Riyadh, Saudi Arabia.
⁵ Gastrointestinal Metabolic and Bariatric Center, GBMC M, Jordan Hospital, Amman, Jordan.
⁶ GI, Bariatric and Robotic Surgery Apollo Hospital, New Delhi, India.
⁷ Surgical Services Aman Hospital, Doha, Qatar.
⁸ Bariatric and Metabolic Surgery Unit, Ospedale Evangelico Betania, Naples, Italy.
⁹ Department of General Surgery, Cerrahpaşa Medical Faculty, Istanbul University Cerrahpaşa, Istanbul, Turkey.
¹⁰ Ventura Advanced Surgical Associates, Ventura, CA, USA.
¹¹ Weight Loss and Metabolic Surgery Center, Yotsuya Medical Cube, Tokyo, Japan.
¹² Sunderland Royal Hospital, Sunderland, UK.
¹³ Ain Shams University Faculty of Medicine Department of General Surgery, Cairo, Egypt.
¹⁴ Department of Bariatric, Metabolic and Plastic Surgery, St. Franziskus Hospital, Cologne, Germany.
¹⁵ Dubai London Hospital, Dubai, UAE.
¹⁶ Department GI Surgery Flinders, University South Australia, Adelaide, Australia.
¹⁷ Mohak Bariatric and Robotic Center, Indore, India.
¹⁸ The First Affiliated Hospital of Jinan University, Guangzhou, China.
¹⁹ Gastrointestinal and Bariatric Surgery, University of Buenos Aires, Buenos Aires, Argentina.
²⁰ Mayo Clinic, Rochester, MN, USA.
²¹ Department of Digestive and Bariatric Surgery, Metropolitan Hospital, HEAL Academy, Athens, Greece.
²² Deputy Head of Visceral Surgery and Head of Bariatric-Metabolic Surgery Clarunis, Department of Visceral Surgery, University Centre for Gastrointestinal and Liver Diseases St. Clara Hospital and University Hospital Basel, 4002, Basel, Switzerland.
²³ Digestive Surgery Unit, University Hospital of La Réunion -Félix Guyon Hospital, Saint-Denis, La Réunion, France.
²⁴ Head Endocrine-Metabolic and Bariatric Surgery Unit, Vall Hebron Barcelona Hospital Campus, Pg. De La Vall d'hebron, 119-129, 08035, Barcelona, Spain.
²⁵ General Surgery Department, Multidisciplinary Center for Obesity Treatment - Hospital Lusíadas Amadora, Amadora, Portugal.
²⁶ Obesity Goodbye Center, Tijuana, Mexico.
²⁷ UMC Ljubljana, Department of Abdominal Surgery and Medical Faculty, Ljubljana, Slovenia.
²⁸ National University of Singapore, Singapore, Singapore.
²⁹ Advanced Biomedical Sciences Department, "Federico II" University, Naples, Italy.

PMID: 37889368
DOI: 10.1007/s11695-023-06903-w

Abstract

Background: Recent advancements in artificial intelligence, such as OpenAI's ChatGPT-4, are revolutionizing various sectors, including healthcare. This study investigates the use of ChatGPT-4 in identifying suitable candidates for bariatric surgery and providing surgical recommendations to improve decision-making in obesity treatment amid the global obesity epidemic.

Methods: We devised ten patient scenarios, thoughtfully encompassing a spectrum that spans from uncomplicated cases to more complex ones. Our objective was to delve into the decision-making process regarding the recommendation of bariatric surgery. From July 29th to August 10th, 2023, we conducted a voluntary online survey involving thirty prominent bariatric surgeons, ensuring that there was no predetermined bias in the selection of a specific type of bariatric surgery. This survey was designed to collect their insights on these scenarios and gain a deeper understanding of their professional experience and background in the field of bariatric surgery. Additionally, we consulted ChatGPT-4 in two separate conversations to evaluate its alignment with expert opinions on bariatric surgery options.

Results: In 40% of the scenarios, disparities were identified between the two conversations with ChatGPT-4. It matched expert opinions in 30% of cases. Differences were noted in cases like gastrointestinal metaplasia and gastric adenocarcinoma, but there was alignment with conditions like endometriosis and GERD.

Conclusion: The evaluation of ChatGPT-4's role in determining bariatric surgery suitability uncovered both potential and shortcomings. Its alignment with experts was inconsistent, and it often overlooked key factors, emphasizing human expertise's value. Its current use requires caution, and further refinement is needed for clinical application.

Keywords: Artificial Intelligence; Bariatric Evaluation; Bariatric Surgery; ChatGPT; Health Literacy; Language Learning Models.

MeSH terms

Artificial Intelligence
Bariatrics*
Expert Testimony
Female
Humans
Obesity
Obesity, Morbid* / surgery