Background: Accurate tumor staging and treatment response evaluation (TRE) are critical for nasopharyngeal carcinoma (NPC) clinical decisions. Conventional methods relying on manual imaging analysis are expertise-dependent, time-consuming, and prone to inter-observer variability and errors.
Purpose: To assess the performance of two large language models (LLMs): ChatGPT-4o-latest and DeepSeek-V3-0324 in automating T, N staging and TRE for NPC patients.
Study type: Retrospective.
Population: Three hundred seven NPC patients from three centers (mean age: 45.5 ± 11.3 years; 216 men, 91 women).
Field strength/sequence: All imaging was conducted using 3.0T or 1.5T scanners. The imaging sequence included axial T1-weighted fast spin-echo, T2-weighted fast spin-echo, T2-weighted fat-suppressed spin-echo, and Contrast-Enhanced T1-weighted fast spin-echo.
Assessment: Two radiologists established the reference standards for TN staging at baseline and for TRE at two time points: post-induction chemotherapy (TRE-1) and post-concurrent chemoradiotherapy (TRE-2), based on the 9th version of AJCC/UICC guidelines and the RECIST1.1 criteria. LLMs were via few-shot chain-of-thought prompting and tested on 277 patients with 831 reports. Additionally, four radiologists independently assessed 68 cases both with and without the assistance of LLMs and compared the performance and efficiency in both conditions.
Statistical tests: McNemar-Bowker test, Wilcoxon signed-rank test. p < 0.05 was considered statistically significant.
Results: DeepSeek-V3-0324 significantly outperformed GPT-4o-latest in TRE-1 staging (96.5% vs. 82.9%, p < 0.001). For T staging (95.3% vs. 93.5%, p = 0.24), N staging (93.8% vs. 89.6%, p = 0.265), and TRE-2 (94.9% vs. 93.2%, p = 0.556), the accuracy between DeepSeek-V3-0324 and ChatGPT-4o-latest showed no significant difference. DeepSeek-V3-0324 also showed stronger agreement with expert annotation (κ = 0.85-0.90), compared to ChatGPT-4o-latest (κ = 0.49-0.86). Significant improvements in time efficiency were observed across all radiologists with LLM assistance (p < 0.001).
Data conclusion: LLMs, particularly DeepSeek-V3-0324, can automate NPC TN staging and TRE with high accuracy, enhancing clinical efficiency. LLMs integration may improve diagnostic consistency, especially for junior clinicians.
Technical efficacy: Stage 4.
Keywords: large language models; magnetic resonance imaging; nasopharyngeal carcinoma.
Staging and treatment response evaluation are crucial for guiding nasopharyngeal carcinoma management. This study investigated large language models for automatically extracting such information from imaging reports. Results showed performance comparable to doctors, indicating potential application to other cancers. This approach may reduce clinician workload, improve efficiency, and demonstrates the innovative use of a general‐purpose large language model to interpret professional medical documents and perform specific medical tasks.
© 2025 International Society for Magnetic Resonance in Medicine.