Burcu Vural Camalan, Sumeyra Doluoglu, Nazlim Hilal Taraf, Mehmet Murat Gunay, Samet Ozlugedik
{"title":"ChatGPT与DeepSeek在头颈癌分期和治疗计划中的比较:基于指南的研究","authors":"Burcu Vural Camalan, Sumeyra Doluoglu, Nazlim Hilal Taraf, Mehmet Murat Gunay, Samet Ozlugedik","doi":"10.1007/s00405-025-09524-4","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>This prospective simulation study was conducted to evaluate and compare the performance of ChatGPT (o1, 2023) and DeepSeek (V3, 2024) in staging and treatment planning for head and neck cancers.</p><p><strong>Methods: </strong>This prospective simulation study was conducted in March 2025 to evaluate and compare the performance of two advanced artificial intelligence (AI) models, ChatGPT (o1, 2023) and DeepSeek (V3, 2024), in clinical decision-making for head and neck malignancies. A total of 50 hypothetical, guideline-based clinical scenarios were carefully designed in English by two otorhinolaryngologists in alignment with the National Comprehensive Cancer Network® (NCCN®) Guidelines Version 2.2025.</p><p><strong>Results: </strong>In the overall analysis of treatment planning performance, DeepSeek (V3, 2024) demonstrated statistically superior accuracy compared to ChatGPT (o1, 2023) (p = 0.04). Both models showed comparable performance in tumor staging (p = 0.83). Both DeepSeek (p = 0.0001) and ChatGPT (p = 0.02) were statistically successful in respect of staging accuracy and providing fully correct answers on the subject of treatment.</p><p><strong>Conclusion: </strong>Although DeepSeek V3 demonstrated promising capability for clinical decision support in head and neck oncology, these artificial intelligence tools cannot replace multidisciplinary tumor boards. However, they can significantly streamline clinical workflows by rapidly organizing patient data, thereby enhancing board efficiency. Future efforts should prioritize the development and integration of secure, institution-specific, local large language models tailored for oncological decision-making.</p>","PeriodicalId":520614,"journal":{"name":"European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery","volume":" ","pages":""},"PeriodicalIF":2.2000,"publicationDate":"2025-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"ChatGPT versus DeepSeek in head and neck cancer staging and treatment planning: guideline-based study.\",\"authors\":\"Burcu Vural Camalan, Sumeyra Doluoglu, Nazlim Hilal Taraf, Mehmet Murat Gunay, Samet Ozlugedik\",\"doi\":\"10.1007/s00405-025-09524-4\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>This prospective simulation study was conducted to evaluate and compare the performance of ChatGPT (o1, 2023) and DeepSeek (V3, 2024) in staging and treatment planning for head and neck cancers.</p><p><strong>Methods: </strong>This prospective simulation study was conducted in March 2025 to evaluate and compare the performance of two advanced artificial intelligence (AI) models, ChatGPT (o1, 2023) and DeepSeek (V3, 2024), in clinical decision-making for head and neck malignancies. A total of 50 hypothetical, guideline-based clinical scenarios were carefully designed in English by two otorhinolaryngologists in alignment with the National Comprehensive Cancer Network® (NCCN®) Guidelines Version 2.2025.</p><p><strong>Results: </strong>In the overall analysis of treatment planning performance, DeepSeek (V3, 2024) demonstrated statistically superior accuracy compared to ChatGPT (o1, 2023) (p = 0.04). Both models showed comparable performance in tumor staging (p = 0.83). Both DeepSeek (p = 0.0001) and ChatGPT (p = 0.02) were statistically successful in respect of staging accuracy and providing fully correct answers on the subject of treatment.</p><p><strong>Conclusion: </strong>Although DeepSeek V3 demonstrated promising capability for clinical decision support in head and neck oncology, these artificial intelligence tools cannot replace multidisciplinary tumor boards. However, they can significantly streamline clinical workflows by rapidly organizing patient data, thereby enhancing board efficiency. Future efforts should prioritize the development and integration of secure, institution-specific, local large language models tailored for oncological decision-making.</p>\",\"PeriodicalId\":520614,\"journal\":{\"name\":\"European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":2.2000,\"publicationDate\":\"2025-06-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1007/s00405-025-09524-4\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s00405-025-09524-4","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
ChatGPT versus DeepSeek in head and neck cancer staging and treatment planning: guideline-based study.
Purpose: This prospective simulation study was conducted to evaluate and compare the performance of ChatGPT (o1, 2023) and DeepSeek (V3, 2024) in staging and treatment planning for head and neck cancers.
Methods: This prospective simulation study was conducted in March 2025 to evaluate and compare the performance of two advanced artificial intelligence (AI) models, ChatGPT (o1, 2023) and DeepSeek (V3, 2024), in clinical decision-making for head and neck malignancies. A total of 50 hypothetical, guideline-based clinical scenarios were carefully designed in English by two otorhinolaryngologists in alignment with the National Comprehensive Cancer Network® (NCCN®) Guidelines Version 2.2025.
Results: In the overall analysis of treatment planning performance, DeepSeek (V3, 2024) demonstrated statistically superior accuracy compared to ChatGPT (o1, 2023) (p = 0.04). Both models showed comparable performance in tumor staging (p = 0.83). Both DeepSeek (p = 0.0001) and ChatGPT (p = 0.02) were statistically successful in respect of staging accuracy and providing fully correct answers on the subject of treatment.
Conclusion: Although DeepSeek V3 demonstrated promising capability for clinical decision support in head and neck oncology, these artificial intelligence tools cannot replace multidisciplinary tumor boards. However, they can significantly streamline clinical workflows by rapidly organizing patient data, thereby enhancing board efficiency. Future efforts should prioritize the development and integration of secure, institution-specific, local large language models tailored for oncological decision-making.