{"title":"A New Era in Medical Information: ChatGPT Outperforms Medical Information Provided by Online Information Sheets About Congenital Malformations.","authors":"Maya Paran, Anastasia Almog, Yael Dreznik, Nadav Nesher, Dragan Kravarusic","doi":"10.1016/j.jpedsurg.2024.161894","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>ChatGPT has demonstrated notable capabilities and has gained popularity in various medical tasks, including patient education. This study evaluates the content and readability of ChatGPT's responses to parents' questions about congenital anomalies.</p><p><strong>Methods: </strong>Information on four congenital anomalies (congenital diaphragmatic hernia, esophageal atresia and tracheoesophageal fistula, anorectal malformation, and gastroschisis) was assessed. Seven questions frequently asked by parents were posed for each anomaly, and responses generated by GPT-4 were compared to online information sheets from three top pediatric medical centers. Two senior pediatric surgeons, blinded to the source, evaluated the answers based on accuracy, comprehensiveness, and conciseness. Reading time and readability of the answers were also assessed.</p><p><strong>Results: </strong>ChatGPT answered all 28 questions, while online information sheets varied in completeness. ChatGPT's responses were rated significantly higher regarding full accuracy, comprehensiveness, and conciseness compared to the online information sheets (p < 0.00001, <0.00001, 0.0002, respectively). Despite having longer reading times and more challenging to read, ChatGPT's responses were more precise and detailed.</p><p><strong>Conclusions: </strong>ChatGPT outperforms online information sheets in providing accurate, comprehensive, and concise answers about congenital anomalies. This positions ChatGPT as a beneficial supplementary resource in pediatric healthcare. Future research should explore real-world applications and usability among parents.</p><p><strong>Level of evidence: </strong>Level III.</p>","PeriodicalId":16733,"journal":{"name":"Journal of pediatric surgery","volume":" ","pages":"161894"},"PeriodicalIF":2.4000,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of pediatric surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.jpedsurg.2024.161894","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PEDIATRICS","Score":null,"Total":0}
引用次数: 0
Abstract
Background: ChatGPT has demonstrated notable capabilities and has gained popularity in various medical tasks, including patient education. This study evaluates the content and readability of ChatGPT's responses to parents' questions about congenital anomalies.
Methods: Information on four congenital anomalies (congenital diaphragmatic hernia, esophageal atresia and tracheoesophageal fistula, anorectal malformation, and gastroschisis) was assessed. Seven questions frequently asked by parents were posed for each anomaly, and responses generated by GPT-4 were compared to online information sheets from three top pediatric medical centers. Two senior pediatric surgeons, blinded to the source, evaluated the answers based on accuracy, comprehensiveness, and conciseness. Reading time and readability of the answers were also assessed.
Results: ChatGPT answered all 28 questions, while online information sheets varied in completeness. ChatGPT's responses were rated significantly higher regarding full accuracy, comprehensiveness, and conciseness compared to the online information sheets (p < 0.00001, <0.00001, 0.0002, respectively). Despite having longer reading times and more challenging to read, ChatGPT's responses were more precise and detailed.
Conclusions: ChatGPT outperforms online information sheets in providing accurate, comprehensive, and concise answers about congenital anomalies. This positions ChatGPT as a beneficial supplementary resource in pediatric healthcare. Future research should explore real-world applications and usability among parents.
期刊介绍：
The journal presents original contributions as well as a complete international abstracts section and other special departments to provide the most current source of information and references in pediatric surgery. The journal is based on the need to improve the surgical care of infants and children, not only through advances in physiology, pathology and surgical techniques, but also by attention to the unique emotional and physical needs of the young patient.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
