Yuval Avidan, Hussein Sliman, Baruch Weizman, Orel Ben Court, Alexander Fuks, Salim Adawi, Amir Aker
{"title":"ChatGPT: the essential patient's companion for transesophageal echocardiogram education.","authors":"Yuval Avidan, Hussein Sliman, Baruch Weizman, Orel Ben Court, Alexander Fuks, Salim Adawi, Amir Aker","doi":"10.1007/s40477-025-01071-2","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Transesophageal echocardiography (TOE) necessitates meticulous patient preparation. Artificial intelligence (AI) chatbots, such as ChatGPT, hold promise in delivering medical information. This study sought to assess the suitability of the latest iteration, ChatGPT-4 Omni (GPT-4o), as a supplemental resource for providing information on topics related to TOE.</p><p><strong>Methods: </strong>Fifty questions pertaining to patient education, covering both fundamental knowledge (25) and management aspects (25) of TOE results, were submitted to GPT-4o in three separate sessions. Three senior echocardiographers systematically evaluated the responses using a four-point scale, focusing on their appropriateness, clarity, and consistency. Additionally, they assessed confabulations and the omission of relevant content on a binary scale.</p><p><strong>Results: </strong>Overall, 94% of GPT-4o's responses were rated as \"highly appropriate\" across 50 tasks, with 98% deemed \"highly comprehensible\". Responses related to basic knowledge were 96% appropriate and 100% comprehensible, while management-related responses were 92% appropriate and 96% comprehensible. In total, two responses (4%) were rated negatively as quite inappropriate. Minor inconsistencies were observed in 12% of regenerated responses, with relevant content missing in 6% of inquiries.</p><p><strong>Conclusions: </strong>GPT-4o demonstrated high accuracy and reliability in addressing patient inquiries related to TOE. These findings suggest that this AI platform could effectively supplement patient education and complement healthcare professionals' guidance, thereby reducing the workload of echocardiography lab staff.</p>","PeriodicalId":51528,"journal":{"name":"Journal of Ultrasound","volume":" ","pages":""},"PeriodicalIF":1.4000,"publicationDate":"2025-08-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Ultrasound","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s40477-025-01071-2","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: Transesophageal echocardiography (TOE) necessitates meticulous patient preparation. Artificial intelligence (AI) chatbots, such as ChatGPT, hold promise in delivering medical information. This study sought to assess the suitability of the latest iteration, ChatGPT-4 Omni (GPT-4o), as a supplemental resource for providing information on topics related to TOE.
Methods: Fifty questions pertaining to patient education, covering both fundamental knowledge (25) and management aspects (25) of TOE results, were submitted to GPT-4o in three separate sessions. Three senior echocardiographers systematically evaluated the responses using a four-point scale, focusing on their appropriateness, clarity, and consistency. Additionally, they assessed confabulations and the omission of relevant content on a binary scale.
Results: Overall, 94% of GPT-4o's responses were rated as "highly appropriate" across 50 tasks, with 98% deemed "highly comprehensible". Responses related to basic knowledge were 96% appropriate and 100% comprehensible, while management-related responses were 92% appropriate and 96% comprehensible. In total, two responses (4%) were rated negatively as quite inappropriate. Minor inconsistencies were observed in 12% of regenerated responses, with relevant content missing in 6% of inquiries.
Conclusions: GPT-4o demonstrated high accuracy and reliability in addressing patient inquiries related to TOE. These findings suggest that this AI platform could effectively supplement patient education and complement healthcare professionals' guidance, thereby reducing the workload of echocardiography lab staff.
期刊介绍:
The Journal of Ultrasound is the official journal of the Italian Society for Ultrasound in Medicine and Biology (SIUMB). The journal publishes original contributions (research and review articles, case reports, technical reports and letters to the editor) on significant advances in clinical diagnostic, interventional and therapeutic applications, clinical techniques, the physics, engineering and technology of ultrasound in medicine and biology, and in cross-sectional diagnostic imaging. The official language of Journal of Ultrasound is English.