Christopher A. White, Jamie L. Kator, Hannah S. Rhee, Thomas Boucher, Rachel Glenn, Amanda Walsh, Jaehon M. Kim
{"title":"标题:ChatGPT 4.0 能否可靠地回答患者关于拳击手骨折的常见问题?","authors":"Christopher A. White, Jamie L. Kator, Hannah S. Rhee, Thomas Boucher, Rachel Glenn, Amanda Walsh, Jaehon M. Kim","doi":"10.1016/j.hansur.2025.102082","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><div>Patients are increasingly turning to the internet, and recently artificial intelligence engines (e.g., ChatGPT), for answers to common medical questions. Regarding orthopedic hand surgery, recent literature has focused on ChatGPT’s ability to answer patient frequently asked questions (FAQs) regarding subjects such as carpal tunnel syndrome, distal radius fractures, and more. The present study seeks to determine how accurately ChatGPT can answer patient FAQs surrounding simple fracture patterns such as fifth metacarpal neck fractures.</div></div><div><h3>Methods</h3><div>Internet queries were used to identify the ten most FAQs regarding boxer’s fractures based on information from five trusted healthcare institutions. These ten questions were posed to ChatGPT 4.0, and the chatbot’s responses were recorded. Two fellowship trained orthopedic hand surgeons and one orthopedic hand surgery fellow then graded ChatGPT’s responses on an alphabetical grading scale (i.e., A–F); additional commentary was then provided for each response. Descriptive statistics were used to report question, grader, and overall ChatGPT response grades.</div></div><div><h3>Results</h3><div>ChatGPT achieved a cumulative grade of a B, indicating that the chatbot can provide adequate responses with only minor need for clarification when answering FAQs for boxer’s fractures. Individual graders provided comparable overall grades of B, B, and B+ respectively. ChatGPT deferred to a medical professional in 7/10 responses. General questions were graded at an A−. Management questions were graded at a C+.</div></div><div><h3>Conclusion</h3><div>Overall, with a grade of B, ChatGPT 4.0 provides adequate-to- complete responses as it pertains to patient FAQs surrounding boxer’s fractures.</div></div>","PeriodicalId":54301,"journal":{"name":"Hand Surgery & Rehabilitation","volume":"44 2","pages":"Article 102082"},"PeriodicalIF":0.9000,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Can ChatGPT 4.0 reliably answer patient frequently asked questions about boxer’s fractures?\",\"authors\":\"Christopher A. White, Jamie L. Kator, Hannah S. Rhee, Thomas Boucher, Rachel Glenn, Amanda Walsh, Jaehon M. Kim\",\"doi\":\"10.1016/j.hansur.2025.102082\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Background</h3><div>Patients are increasingly turning to the internet, and recently artificial intelligence engines (e.g., ChatGPT), for answers to common medical questions. Regarding orthopedic hand surgery, recent literature has focused on ChatGPT’s ability to answer patient frequently asked questions (FAQs) regarding subjects such as carpal tunnel syndrome, distal radius fractures, and more. The present study seeks to determine how accurately ChatGPT can answer patient FAQs surrounding simple fracture patterns such as fifth metacarpal neck fractures.</div></div><div><h3>Methods</h3><div>Internet queries were used to identify the ten most FAQs regarding boxer’s fractures based on information from five trusted healthcare institutions. These ten questions were posed to ChatGPT 4.0, and the chatbot’s responses were recorded. Two fellowship trained orthopedic hand surgeons and one orthopedic hand surgery fellow then graded ChatGPT’s responses on an alphabetical grading scale (i.e., A–F); additional commentary was then provided for each response. Descriptive statistics were used to report question, grader, and overall ChatGPT response grades.</div></div><div><h3>Results</h3><div>ChatGPT achieved a cumulative grade of a B, indicating that the chatbot can provide adequate responses with only minor need for clarification when answering FAQs for boxer’s fractures. Individual graders provided comparable overall grades of B, B, and B+ respectively. ChatGPT deferred to a medical professional in 7/10 responses. General questions were graded at an A−. Management questions were graded at a C+.</div></div><div><h3>Conclusion</h3><div>Overall, with a grade of B, ChatGPT 4.0 provides adequate-to- complete responses as it pertains to patient FAQs surrounding boxer’s fractures.</div></div>\",\"PeriodicalId\":54301,\"journal\":{\"name\":\"Hand Surgery & Rehabilitation\",\"volume\":\"44 2\",\"pages\":\"Article 102082\"},\"PeriodicalIF\":0.9000,\"publicationDate\":\"2025-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Hand Surgery & Rehabilitation\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2468122925000040\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"ORTHOPEDICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Hand Surgery & Rehabilitation","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2468122925000040","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
Can ChatGPT 4.0 reliably answer patient frequently asked questions about boxer’s fractures?
Background
Patients are increasingly turning to the internet, and recently artificial intelligence engines (e.g., ChatGPT), for answers to common medical questions. Regarding orthopedic hand surgery, recent literature has focused on ChatGPT’s ability to answer patient frequently asked questions (FAQs) regarding subjects such as carpal tunnel syndrome, distal radius fractures, and more. The present study seeks to determine how accurately ChatGPT can answer patient FAQs surrounding simple fracture patterns such as fifth metacarpal neck fractures.
Methods
Internet queries were used to identify the ten most FAQs regarding boxer’s fractures based on information from five trusted healthcare institutions. These ten questions were posed to ChatGPT 4.0, and the chatbot’s responses were recorded. Two fellowship trained orthopedic hand surgeons and one orthopedic hand surgery fellow then graded ChatGPT’s responses on an alphabetical grading scale (i.e., A–F); additional commentary was then provided for each response. Descriptive statistics were used to report question, grader, and overall ChatGPT response grades.
Results
ChatGPT achieved a cumulative grade of a B, indicating that the chatbot can provide adequate responses with only minor need for clarification when answering FAQs for boxer’s fractures. Individual graders provided comparable overall grades of B, B, and B+ respectively. ChatGPT deferred to a medical professional in 7/10 responses. General questions were graded at an A−. Management questions were graded at a C+.
Conclusion
Overall, with a grade of B, ChatGPT 4.0 provides adequate-to- complete responses as it pertains to patient FAQs surrounding boxer’s fractures.
期刊介绍:
As the official publication of the French, Belgian and Swiss Societies for Surgery of the Hand, as well as of the French Society of Rehabilitation of the Hand & Upper Limb, ''Hand Surgery and Rehabilitation'' - formerly named "Chirurgie de la Main" - publishes original articles, literature reviews, technical notes, and clinical cases. It is indexed in the main international databases (including Medline). Initially a platform for French-speaking hand surgeons, the journal will now publish its articles in English to disseminate its author''s scientific findings more widely. The journal also includes a biannual supplement in French, the monograph of the French Society for Surgery of the Hand, where comprehensive reviews in the fields of hand, peripheral nerve and upper limb surgery are presented.
Organe officiel de la Société française de chirurgie de la main, de la Société française de Rééducation de la main (SFRM-GEMMSOR), de la Société suisse de chirurgie de la main et du Belgian Hand Group, indexée dans les grandes bases de données internationales (Medline, Embase, Pascal, Scopus), Hand Surgery and Rehabilitation - anciennement titrée Chirurgie de la main - publie des articles originaux, des revues de la littérature, des notes techniques, des cas clinique. Initialement plateforme d''expression francophone de la spécialité, la revue s''oriente désormais vers l''anglais pour devenir une référence scientifique et de formation de la spécialité en France et en Europe. Avec 6 publications en anglais par an, la revue comprend également un supplément biannuel, la monographie du GEM, où sont présentées en français, des mises au point complètes dans les domaines de la chirurgie de la main, des nerfs périphériques et du membre supérieur.