Aleksander P Mika, Hillary E Mulvey, Stephen M Engstrom, Gregory G Polkowski, J Ryan Martin, Jacob M Wilson
{"title":"ChatGPT 能否回答患者有关全膝关节置换术的问题?","authors":"Aleksander P Mika, Hillary E Mulvey, Stephen M Engstrom, Gregory G Polkowski, J Ryan Martin, Jacob M Wilson","doi":"10.1055/s-0044-1782233","DOIUrl":null,"url":null,"abstract":"<p><p>The internet has introduced many resources frequently accessed by patients prior to orthopaedic visits. Recently, Chat Generative Pre-Trained Transformer, an artificial intelligence-based chat application, has become publicly and freely available. The interface uses deep learning technology to mimic human interaction and provide convincing answers to questions posed by users. With its rapidly expanding usership, it is reasonable to assume that patients will soon use this technology for preoperative education. Therefore, we sought to determine the accuracy of answers to frequently asked questions (FAQs) pertaining to total knee arthroplasty (TKA).Ten FAQs were posed to the chatbot during a single online interaction with no follow-up questions or repetition. All 10 FAQs were analyzed for accuracy using an evidence-based approach. Answers were then rated as \"excellent response not requiring clarification,\" \"satisfactory requiring minimal clarification,\" satisfactory requiring moderate clarification,\" or \"unsatisfactory requiring substantial clarification.\"Of the 10 answers given by the chatbot, none received an \"unsatisfactory\" rating with the majority either requiring minimal (5) or moderate (4) clarification. While many answers required nuanced clarification, overall, answers tended to be unbiased and evidence-based, even when presented with controversial subjects.The chatbot does an excellent job of providing basic, evidence-based answers to patient FAQs prior to TKA. These data were presented in a manner that will be easily comprehendible by most patients and may serve as a useful clinical adjunct in the future.</p>","PeriodicalId":48798,"journal":{"name":"Journal of Knee Surgery","volume":" ","pages":"664-673"},"PeriodicalIF":1.6000,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Can ChatGPT Answer Patient Questions Regarding Total Knee Arthroplasty?\",\"authors\":\"Aleksander P Mika, Hillary E Mulvey, Stephen M Engstrom, Gregory G Polkowski, J Ryan Martin, Jacob M Wilson\",\"doi\":\"10.1055/s-0044-1782233\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>The internet has introduced many resources frequently accessed by patients prior to orthopaedic visits. Recently, Chat Generative Pre-Trained Transformer, an artificial intelligence-based chat application, has become publicly and freely available. The interface uses deep learning technology to mimic human interaction and provide convincing answers to questions posed by users. With its rapidly expanding usership, it is reasonable to assume that patients will soon use this technology for preoperative education. Therefore, we sought to determine the accuracy of answers to frequently asked questions (FAQs) pertaining to total knee arthroplasty (TKA).Ten FAQs were posed to the chatbot during a single online interaction with no follow-up questions or repetition. All 10 FAQs were analyzed for accuracy using an evidence-based approach. Answers were then rated as \\\"excellent response not requiring clarification,\\\" \\\"satisfactory requiring minimal clarification,\\\" satisfactory requiring moderate clarification,\\\" or \\\"unsatisfactory requiring substantial clarification.\\\"Of the 10 answers given by the chatbot, none received an \\\"unsatisfactory\\\" rating with the majority either requiring minimal (5) or moderate (4) clarification. While many answers required nuanced clarification, overall, answers tended to be unbiased and evidence-based, even when presented with controversial subjects.The chatbot does an excellent job of providing basic, evidence-based answers to patient FAQs prior to TKA. These data were presented in a manner that will be easily comprehendible by most patients and may serve as a useful clinical adjunct in the future.</p>\",\"PeriodicalId\":48798,\"journal\":{\"name\":\"Journal of Knee Surgery\",\"volume\":\" \",\"pages\":\"664-673\"},\"PeriodicalIF\":1.6000,\"publicationDate\":\"2024-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Knee Surgery\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1055/s-0044-1782233\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/3/5 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q3\",\"JCRName\":\"ORTHOPEDICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Knee Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1055/s-0044-1782233","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/3/5 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
Can ChatGPT Answer Patient Questions Regarding Total Knee Arthroplasty?
The internet has introduced many resources frequently accessed by patients prior to orthopaedic visits. Recently, Chat Generative Pre-Trained Transformer, an artificial intelligence-based chat application, has become publicly and freely available. The interface uses deep learning technology to mimic human interaction and provide convincing answers to questions posed by users. With its rapidly expanding usership, it is reasonable to assume that patients will soon use this technology for preoperative education. Therefore, we sought to determine the accuracy of answers to frequently asked questions (FAQs) pertaining to total knee arthroplasty (TKA).Ten FAQs were posed to the chatbot during a single online interaction with no follow-up questions or repetition. All 10 FAQs were analyzed for accuracy using an evidence-based approach. Answers were then rated as "excellent response not requiring clarification," "satisfactory requiring minimal clarification," satisfactory requiring moderate clarification," or "unsatisfactory requiring substantial clarification."Of the 10 answers given by the chatbot, none received an "unsatisfactory" rating with the majority either requiring minimal (5) or moderate (4) clarification. While many answers required nuanced clarification, overall, answers tended to be unbiased and evidence-based, even when presented with controversial subjects.The chatbot does an excellent job of providing basic, evidence-based answers to patient FAQs prior to TKA. These data were presented in a manner that will be easily comprehendible by most patients and may serve as a useful clinical adjunct in the future.
期刊介绍:
The Journal of Knee Surgery covers a range of issues relating to the orthopaedic techniques of arthroscopy, arthroplasty, and reconstructive surgery of the knee joint. In addition to original peer-review articles, this periodical provides details on emerging surgical techniques, as well as reviews and special focus sections. Topics of interest include cruciate ligament repair and reconstruction, bone grafting, cartilage regeneration, and magnetic resonance imaging.