Reliability and efficiency of ChatGPT 3.5 and 4.0 as a tool for scalenovertebral triangle anatomy education.

IF 1.4 4区医学 Q2 Medicine

Surgical and Radiologic Anatomy Pub Date : 2024-12-09 DOI:10.1007/s00276-024-03513-8

Anjali Singal, Swati Goyal

{"title":"Reliability and efficiency of ChatGPT 3.5 and 4.0 as a tool for scalenovertebral triangle anatomy education.","authors":"Anjali Singal, Swati Goyal","doi":"10.1007/s00276-024-03513-8","DOIUrl":null,"url":null,"abstract":"Purpose: As the popularity and the usage of the artificial intelligence (AI) tools is increasing in medical education, it is important to critically evaluate these resources and confirm their reliability. The current study proposes to assess the reliability and effectiveness of ChatGPT 3.5 and 4 for gross anatomical information on scalenovertebral triangle.Methods: ChatGPT versions 3.5 and 4 AI tools were used to explore the anatomical information on scalenovertebral triangle eight times on different days. The responses were qualitatively compared to the actual anatomy of the region and comments were made by the authors for each response.Results: The replies given by ChatGPT were not appropriate (either incorrect, partially correct or incomplete) in any of the conversations. There was no major difference between the accuracy of responses, while comparing ChatGPT 3.5 and 4. Almost three out of four times, ChatGPT confused scalenovertebral triangle with scalene or interscalene triangle.Conclusions: None of the responses provided by ChatGPT 3.5 and 4 across all eight instances aligned even once with the standard anatomical description of the scalenovertebral triangle. A novice medical student may not be able to judge the difference between correct and incorrect, consequently may wrongly interpret the anatomy. So cautious planning and educator check is important while it is used. Further development and modifications of this AI tool are required to increase its potential to be used in medical education and healthcare.","PeriodicalId":49461,"journal":{"name":"Surgical and Radiologic Anatomy","volume":"47 1","pages":"24"},"PeriodicalIF":1.4000,"publicationDate":"2024-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Surgical and Radiologic Anatomy","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s00276-024-03513-8","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"Medicine","Score":null,"Total":0}

引用次数: 0

Abstract

Purpose: As the popularity and the usage of the artificial intelligence (AI) tools is increasing in medical education, it is important to critically evaluate these resources and confirm their reliability. The current study proposes to assess the reliability and effectiveness of ChatGPT 3.5 and 4 for gross anatomical information on scalenovertebral triangle.

Methods: ChatGPT versions 3.5 and 4 AI tools were used to explore the anatomical information on scalenovertebral triangle eight times on different days. The responses were qualitatively compared to the actual anatomy of the region and comments were made by the authors for each response.

Results: The replies given by ChatGPT were not appropriate (either incorrect, partially correct or incomplete) in any of the conversations. There was no major difference between the accuracy of responses, while comparing ChatGPT 3.5 and 4. Almost three out of four times, ChatGPT confused scalenovertebral triangle with scalene or interscalene triangle.

Conclusions: None of the responses provided by ChatGPT 3.5 and 4 across all eight instances aligned even once with the standard anatomical description of the scalenovertebral triangle. A novice medical student may not be able to judge the difference between correct and incorrect, consequently may wrongly interpret the anatomy. So cautious planning and educator check is important while it is used. Further development and modifications of this AI tool are required to increase its potential to be used in medical education and healthcare.

查看原文本刊更多论文

ChatGPT 3.5和4.0作为尺度椎体三角区解剖教学工具的可靠性和有效性。

目的：随着人工智能（AI）工具在医学教育中的普及和使用越来越多，对这些资源进行批判性评估并确认其可靠性非常重要。本研究拟评估ChatGPT 3.5和4对鳞椎三角区大体解剖信息的可靠性和有效性。方法：采用ChatGPT 3.5版本和4种人工智能工具，在不同的时间内8次探查鳞状椎体三角区的解剖信息。这些反应与该地区的实际解剖结构进行了定性比较，并由作者对每个反应进行了评论。结果：ChatGPT给出的回答在任何对话中都不合适（不正确，部分正确或不完整）。与ChatGPT 3.5和ChatGPT 4相比，回答的准确性没有明显差异。几乎四分之三的情况下，ChatGPT混淆了斜角三角形与斜角三角形或斜角间三角形。结论：在所有8个病例中，ChatGPT 3.5和4提供的所有反应都没有一次与鳞骨-椎间三角的标准解剖描述一致。初学医的学生可能无法判断正确与不正确的区别，因此可能会错误地解释解剖。因此，谨慎的计划和教育检查是重要的，而使用。需要进一步开发和修改这一人工智能工具，以增加其在医学教育和保健方面的应用潜力。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Surgical and Radiologic Anatomy Medicine-Pathology and Forensic Medicine

CiteScore

2.40

自引率

14.30%

发文量

期刊介绍： Anatomy is a morphological science which cannot fail to interest the clinician. The practical application of anatomical research to clinical problems necessitates special adaptation and selectivity in choosing from numerous international works. Although there is a tendency to believe that meaningful advances in anatomy are unlikely, constant revision is necessary. Surgical and Radiologic Anatomy, the first international journal of Clinical anatomy has been created in this spirit. Its goal is to serve clinicians, regardless of speciality-physicians, surgeons, radiologists or other specialists-as an indispensable aid with which they can improve their knowledge of anatomy. Each issue includes: Original papers, review articles, articles on the anatomical bases of medical, surgical and radiological techniques, articles of normal radiologic anatomy, brief reviews of anatomical publications of clinical interest. Particular attention is given to high quality illustrations, which are indispensable for a better understanding of anatomical problems. Surgical and Radiologic Anatomy is a journal written by anatomists for clinicians with a special interest in anatomy.