Başak Can, Esra Deniz Kahvecioğlu, Fatih Palıt, Egemen Cebeci, Mehmet Küçük, Zeynep Karaali
{"title":"Assessing the performance of chat generative pretrained transformer (ChatGPT) in answering chronic kidney disease-related questions.","authors":"Başak Can, Esra Deniz Kahvecioğlu, Fatih Palıt, Egemen Cebeci, Mehmet Küçük, Zeynep Karaali","doi":"10.1111/1744-9987.14239","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Chatbots produced by artificial intelligence are frequently used in health information today. We aimed to investigate the reliability and reproducibility of the answers given by Chat Generative Pretrained Transformer (ChatGPT), one of the most used chatbots, to frequently asked questions related to chronic kidney failure.</p><p><strong>Methods: </strong>We reviewed frequently asked questions related to chronic kidney disease (CKD) from social media platforms and Internet. The questions were asked to ChatGPT, and the answers were scored from 1 to 4 by two experienced nephrologists.</p><p><strong>Results: </strong>Eighty-five frequently asked questions about chronic renal failure were examined and 60 of them were included in the study after exclusion criteria. Fifty-one (85%) of the questions received 1 point, 7 (11.7%) received 2 points and 2 (3.3%) received 3 points. The similarity rates of the answers to the repeated questions were between 80% and 100%.</p><p><strong>Conclusion: </strong>ChatGPT has provided reliable responses with high reproducibility to inquiries related to CKD.</p>","PeriodicalId":94253,"journal":{"name":"Therapeutic apheresis and dialysis : official peer-reviewed journal of the International Society for Apheresis, the Japanese Society for Apheresis, the Japanese Society for Dialysis Therapy","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Therapeutic apheresis and dialysis : official peer-reviewed journal of the International Society for Apheresis, the Japanese Society for Apheresis, the Japanese Society for Dialysis Therapy","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1111/1744-9987.14239","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Chatbots produced by artificial intelligence are frequently used in health information today. We aimed to investigate the reliability and reproducibility of the answers given by Chat Generative Pretrained Transformer (ChatGPT), one of the most used chatbots, to frequently asked questions related to chronic kidney failure.
Methods: We reviewed frequently asked questions related to chronic kidney disease (CKD) from social media platforms and Internet. The questions were asked to ChatGPT, and the answers were scored from 1 to 4 by two experienced nephrologists.
Results: Eighty-five frequently asked questions about chronic renal failure were examined and 60 of them were included in the study after exclusion criteria. Fifty-one (85%) of the questions received 1 point, 7 (11.7%) received 2 points and 2 (3.3%) received 3 points. The similarity rates of the answers to the repeated questions were between 80% and 100%.
Conclusion: ChatGPT has provided reliable responses with high reproducibility to inquiries related to CKD.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
