Artificial Intelligence Performs Well for Patient-Level Education of Benign Anorectal Conditions.

IF 0.9 4区医学 Q3 SURGERY

American Surgeon Pub Date : 2025-10-01 Epub Date: 2025-05-06 DOI:10.1177/00031348251337156

Makenna Marty, Seija Maniskas, Jonathan Zuo, Gabriel Akopian, Adam Truong

{"title":"Artificial Intelligence Performs Well for Patient-Level Education of Benign Anorectal Conditions.","authors":"Makenna Marty, Seija Maniskas, Jonathan Zuo, Gabriel Akopian, Adam Truong","doi":"10.1177/00031348251337156","DOIUrl":null,"url":null,"abstract":"BackgroundChatGPT, the most widely recognized AI chatbot, has been increasingly utilized by patients for health care education, but its performance and knowledge base have not been evaluated for colorectal surgery topics. We hypothesize ChatGPT can provide accurate patient-level information for benign anorectal diseases.MethodsWe performed a single-institution prospective study evaluating OpenAI's GPT-4 chatbot against verified online medical literature using the modified EQIP (mEQIP) for hemorrhoids, anal fissures, and pruritus ani. Scoring was performed by three independent educated reviewers.ResultsChatGPT had a median overall score of 22/36 (61%) across all topics. It performed similarly for all topics: 24 for hemorrhoids, 22 for fissures, and 20 for pruritus (P = 0.15). ChatGPT was strongest within the mEQIP Content domain for all topics (P = 0.001). It performed weakest within the mEQIP Identification domain. It primarily lost points for recommending non-evidence-based treatments, lack of citations and visual aids, and generating broken source links.DiscussionChatGPT can provide accurate, reliable information at patient understanding level and is comparable to other validated online information for benign anorectal pathologies. It could improve on mEQIP performance by improving source documentation and visual aid capability, but it remains a promising patient resource with an intuitive user interface.","PeriodicalId":7782,"journal":{"name":"American Surgeon","volume":" ","pages":"1629-1634"},"PeriodicalIF":0.9000,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"American Surgeon","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1177/00031348251337156","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/5/6 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"SURGERY","Score":null,"Total":0}

引用次数: 0

Abstract

BackgroundChatGPT, the most widely recognized AI chatbot, has been increasingly utilized by patients for health care education, but its performance and knowledge base have not been evaluated for colorectal surgery topics. We hypothesize ChatGPT can provide accurate patient-level information for benign anorectal diseases.MethodsWe performed a single-institution prospective study evaluating OpenAI's GPT-4 chatbot against verified online medical literature using the modified EQIP (mEQIP) for hemorrhoids, anal fissures, and pruritus ani. Scoring was performed by three independent educated reviewers.ResultsChatGPT had a median overall score of 22/36 (61%) across all topics. It performed similarly for all topics: 24 for hemorrhoids, 22 for fissures, and 20 for pruritus (P = 0.15). ChatGPT was strongest within the mEQIP Content domain for all topics (P = 0.001). It performed weakest within the mEQIP Identification domain. It primarily lost points for recommending non-evidence-based treatments, lack of citations and visual aids, and generating broken source links.DiscussionChatGPT can provide accurate, reliable information at patient understanding level and is comparable to other validated online information for benign anorectal pathologies. It could improve on mEQIP performance by improving source documentation and visual aid capability, but it remains a promising patient resource with an intuitive user interface.

查看原文本刊更多论文

人工智能在良性肛肠疾病的患者层面教育中表现良好。

chatgpt是最被广泛认可的人工智能聊天机器人，已越来越多地被患者用于医疗保健教育，但其性能和知识库尚未被评估用于结直肠手术主题。我们假设ChatGPT可以为良性肛肠疾病提供准确的患者水平信息。方法我们进行了一项单机构前瞻性研究，使用改进的EQIP （mEQIP）对OpenAI的GPT-4聊天机器人进行痔疮、肛裂和瘙痒的评估，对照已验证的在线医学文献。评分由三名独立的受过教育的评论者完成。结果gpt在所有主题上的中位总分为22/36（61%）。所有主题的表现相似：痔疮24例，裂隙22例，瘙痒20例（P = 0.15）。ChatGPT在mEQIP内容域中对所有主题都是最强的（P = 0.001）。它在mEQIP识别域中表现最弱。它主要因推荐非循证治疗、缺乏引用和视觉辅助以及产生断裂的来源链接而失分。chatgpt可以在患者理解水平上提供准确、可靠的信息，可与其他经验证的良性肛肠病变在线信息相媲美。它可以通过改进源文档和视觉辅助功能来改善mEQIP的性能，但它仍然是一个有前途的患者资源，具有直观的用户界面。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

American Surgeon 医学-外科

CiteScore

1.40

自引率

0.00%

发文量

623

期刊介绍： The American Surgeon is a monthly peer-reviewed publication published by the Southeastern Surgical Congress. Its area of concentration is clinical general surgery, as defined by the content areas of the American Board of Surgery: alimentary tract (including bariatric surgery), abdomen and its contents, breast, skin and soft tissue, endocrine system, solid organ transplantation, pediatric surgery, surgical critical care, surgical oncology (including head and neck surgery), trauma and emergency surgery, and vascular surgery.