ChatGPT versus DeepSeek in head and neck cancer staging and treatment planning: guideline-based study

Burcu Vural Camalan; Sumeyra Doluoglu; Nazlim Hilal Taraf; Mehmet Murat Gunay; Samet Ozlugedik

doi:10.1007/s00405-025-09524-4

ChatGPT versus DeepSeek in head and neck cancer staging and treatment planning: guideline-based study

Eur Arch Otorhinolaryngol. 2025 Sep;282(9):4815-4824. doi: 10.1007/s00405-025-09524-4. Epub 2025 Jun 17.

Authors

Burcu Vural Camalan¹, Sumeyra Doluoglu², Nazlim Hilal Taraf², Mehmet Murat Gunay², Samet Ozlugedik²

Affiliations

¹ Department of Otorhinolaryngology Head and Neck Surgery, University of Health Sciences Ankara Etlik City Hospital, Varlık Mahallesi, Halil Sezai Erkut Caddesi, No:5, 06170, Yenimahalle, Ankara, Turkey. burcuvural@gmail.com.
² Department of Otorhinolaryngology Head and Neck Surgery, University of Health Sciences Ankara Etlik City Hospital, Varlık Mahallesi, Halil Sezai Erkut Caddesi, No:5, 06170, Yenimahalle, Ankara, Turkey.

Abstract

Purpose: This prospective simulation study was conducted to evaluate and compare the performance of ChatGPT (o1, 2023) and DeepSeek (V3, 2024) in staging and treatment planning for head and neck cancers.

Methods: This prospective simulation study was conducted in March 2025 to evaluate and compare the performance of two advanced artificial intelligence (AI) models, ChatGPT (o1, 2023) and DeepSeek (V3, 2024), in clinical decision-making for head and neck malignancies. A total of 50 hypothetical, guideline-based clinical scenarios were carefully designed in English by two otorhinolaryngologists in alignment with the National Comprehensive Cancer Network® (NCCN®) Guidelines Version 2.2025.

Results: In the overall analysis of treatment planning performance, DeepSeek (V3, 2024) demonstrated statistically superior accuracy compared to ChatGPT (o1, 2023) (p = 0.04). Both models showed comparable performance in tumor staging (p = 0.83). Both DeepSeek (p = 0.0001) and ChatGPT (p = 0.02) were statistically successful in respect of staging accuracy and providing fully correct answers on the subject of treatment.

Conclusion: Although DeepSeek V3 demonstrated promising capability for clinical decision support in head and neck oncology, these artificial intelligence tools cannot replace multidisciplinary tumor boards. However, they can significantly streamline clinical workflows by rapidly organizing patient data, thereby enhancing board efficiency. Future efforts should prioritize the development and integration of secure, institution-specific, local large language models tailored for oncological decision-making.

Keywords: Artificial intelligence; ChatGPT; DeepSeek; Head and neck cancer; Large language models.

Publication types

Comparative Study

MeSH terms

Artificial Intelligence*
Clinical Decision-Making* / methods
Generative Artificial Intelligence
Head and Neck Neoplasms* / pathology
Head and Neck Neoplasms* / therapy
Humans
Neoplasm Staging*
Practice Guidelines as Topic
Prospective Studies