一种新型人工智能美容外科临床决策支持系统的开发:AURA。

IF 3 2区 医学 Q1 SURGERY
Berk B Ozmen, Nishant Singh, Kavach Shah, Ibrahim Berber, Fnu Damanjit Singh, Eugene Pinsky, Nicholas R Sinclair, Raymond Isakov, Graham S Schwarz
{"title":"一种新型人工智能美容外科临床决策支持系统的开发:AURA。","authors":"Berk B Ozmen, Nishant Singh, Kavach Shah, Ibrahim Berber, Fnu Damanjit Singh, Eugene Pinsky, Nicholas R Sinclair, Raymond Isakov, Graham S Schwarz","doi":"10.1093/asj/sjaf120","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Aesthetic surgery requires integration of specialized knowledge with clinical expertise, yet traditional literature search methods are time-intensive when addressing specific clinical questions. While artificial intelligence has transformed various aspects of healthcare delivery, no AI clinical decision support systems have been specifically developed to enhance evidence-based practice in aesthetic surgery.</p><p><strong>Objectives: </strong>We aimed to develop and evaluate AURA (Aesthetic surgery Using Retrieval Augmentation), a novel AI-powered clinical decision support system designed specifically for evidence-based guidance in aesthetic surgery.</p><p><strong>Methods: </strong>AURA integrates a comprehensive database of 6,546 full-text open-access aesthetic surgery publications (January 2001-September 2024) with a commercial large language model using retrieval-augmented generation technology. System performance was rigorously assessed across 14 complex clinical scenarios spanning facial rejuvenation, body contouring, breast procedures, and general aesthetic surgery considerations. Evaluation metrics included faithfulness to source materials (0-1), answer relevancy (0-1), G-Eval correctness (0-1), SEM semantic quality scores and SEM confidence ratings.</p><p><strong>Results: </strong>AURA demonstrated exceptional performance with mean scores of 0.94 for faithfulness, 0.86 for answer relevancy, and 0.77 for factual correctness. Semantic evaluation revealed strong results with average scores of 0.73 (SEM Score) and 0.80 (SEM Max Similarity), predominantly with moderate confidence ratings. Performance was notably stronger for established techniques and safety considerations compared to emerging procedures requiring comparative analysis.</p><p><strong>Conclusions: </strong>We present AURA, the first specialized AI clinical decision support system for aesthetic surgery. This novel system effectively delivers relevant, accurate information across diverse aesthetic surgery domains based on peer-reviewed literature. AURA offers aesthetic surgeons an efficient, evidence-based resource for clinical decision support. Future development should focus on expanding knowledge sources and prospective clinical validation, with implementation emphasizing transparent source presentation to complement surgical expertise.</p>","PeriodicalId":7728,"journal":{"name":"Aesthetic Surgery Journal","volume":" ","pages":""},"PeriodicalIF":3.0000,"publicationDate":"2025-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Development of a Novel Artificial Intelligence Clinical Decision Support System for Aesthetic Surgery: AURA.\",\"authors\":\"Berk B Ozmen, Nishant Singh, Kavach Shah, Ibrahim Berber, Fnu Damanjit Singh, Eugene Pinsky, Nicholas R Sinclair, Raymond Isakov, Graham S Schwarz\",\"doi\":\"10.1093/asj/sjaf120\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Aesthetic surgery requires integration of specialized knowledge with clinical expertise, yet traditional literature search methods are time-intensive when addressing specific clinical questions. While artificial intelligence has transformed various aspects of healthcare delivery, no AI clinical decision support systems have been specifically developed to enhance evidence-based practice in aesthetic surgery.</p><p><strong>Objectives: </strong>We aimed to develop and evaluate AURA (Aesthetic surgery Using Retrieval Augmentation), a novel AI-powered clinical decision support system designed specifically for evidence-based guidance in aesthetic surgery.</p><p><strong>Methods: </strong>AURA integrates a comprehensive database of 6,546 full-text open-access aesthetic surgery publications (January 2001-September 2024) with a commercial large language model using retrieval-augmented generation technology. System performance was rigorously assessed across 14 complex clinical scenarios spanning facial rejuvenation, body contouring, breast procedures, and general aesthetic surgery considerations. Evaluation metrics included faithfulness to source materials (0-1), answer relevancy (0-1), G-Eval correctness (0-1), SEM semantic quality scores and SEM confidence ratings.</p><p><strong>Results: </strong>AURA demonstrated exceptional performance with mean scores of 0.94 for faithfulness, 0.86 for answer relevancy, and 0.77 for factual correctness. Semantic evaluation revealed strong results with average scores of 0.73 (SEM Score) and 0.80 (SEM Max Similarity), predominantly with moderate confidence ratings. Performance was notably stronger for established techniques and safety considerations compared to emerging procedures requiring comparative analysis.</p><p><strong>Conclusions: </strong>We present AURA, the first specialized AI clinical decision support system for aesthetic surgery. This novel system effectively delivers relevant, accurate information across diverse aesthetic surgery domains based on peer-reviewed literature. AURA offers aesthetic surgeons an efficient, evidence-based resource for clinical decision support. Future development should focus on expanding knowledge sources and prospective clinical validation, with implementation emphasizing transparent source presentation to complement surgical expertise.</p>\",\"PeriodicalId\":7728,\"journal\":{\"name\":\"Aesthetic Surgery Journal\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":3.0000,\"publicationDate\":\"2025-06-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Aesthetic Surgery Journal\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1093/asj/sjaf120\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"SURGERY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Aesthetic Surgery Journal","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1093/asj/sjaf120","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"SURGERY","Score":null,"Total":0}
引用次数: 0

摘要

背景:美容外科需要将专业知识与临床专业知识相结合,而传统的文献检索方法在解决特定的临床问题时需要耗费大量时间。虽然人工智能已经改变了医疗保健服务的各个方面,但还没有专门开发人工智能临床决策支持系统来增强美容手术的循证实践。目的:我们旨在开发和评估AURA(使用检索增强的美容手术),这是一种新型的人工智能临床决策支持系统,专门用于美容手术的循证指导。方法:AURA使用检索增强生成技术将6546篇全文开放获取的美容外科出版物与商业大型语言模型集成在一起。系统的性能在14个复杂的临床场景中进行了严格的评估,包括面部年轻化、身体轮廓、乳房手术和一般美容手术。评估指标包括对源材料的忠实度(0-1)、答案相关性(0-1)、G-Eval正确性(0-1)、SEM语义质量得分和SEM置信度评级。结果:AURA表现出优异的表现,平均得分为0.94的忠实度,0.86的答案相关性,0.77的事实正确性。语义评价结果显示,平均得分为0.73 (SEM得分)和0.80 (SEM最大相似度),以中等可信度评分为主。与需要比较分析的新兴程序相比,已建立的技术和安全考虑的性能明显更强。结论:我们提出了AURA,这是第一个专门用于美容手术的人工智能临床决策支持系统。这种新颖的系统基于同行评议的文献,在不同的美容外科领域有效地传递相关的、准确的信息。AURA为美容外科医生提供了一个有效的、基于证据的临床决策支持资源。未来的发展应侧重于扩大知识来源和前瞻性临床验证,并强调透明的来源展示,以补充外科专业知识。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Development of a Novel Artificial Intelligence Clinical Decision Support System for Aesthetic Surgery: AURA.

Background: Aesthetic surgery requires integration of specialized knowledge with clinical expertise, yet traditional literature search methods are time-intensive when addressing specific clinical questions. While artificial intelligence has transformed various aspects of healthcare delivery, no AI clinical decision support systems have been specifically developed to enhance evidence-based practice in aesthetic surgery.

Objectives: We aimed to develop and evaluate AURA (Aesthetic surgery Using Retrieval Augmentation), a novel AI-powered clinical decision support system designed specifically for evidence-based guidance in aesthetic surgery.

Methods: AURA integrates a comprehensive database of 6,546 full-text open-access aesthetic surgery publications (January 2001-September 2024) with a commercial large language model using retrieval-augmented generation technology. System performance was rigorously assessed across 14 complex clinical scenarios spanning facial rejuvenation, body contouring, breast procedures, and general aesthetic surgery considerations. Evaluation metrics included faithfulness to source materials (0-1), answer relevancy (0-1), G-Eval correctness (0-1), SEM semantic quality scores and SEM confidence ratings.

Results: AURA demonstrated exceptional performance with mean scores of 0.94 for faithfulness, 0.86 for answer relevancy, and 0.77 for factual correctness. Semantic evaluation revealed strong results with average scores of 0.73 (SEM Score) and 0.80 (SEM Max Similarity), predominantly with moderate confidence ratings. Performance was notably stronger for established techniques and safety considerations compared to emerging procedures requiring comparative analysis.

Conclusions: We present AURA, the first specialized AI clinical decision support system for aesthetic surgery. This novel system effectively delivers relevant, accurate information across diverse aesthetic surgery domains based on peer-reviewed literature. AURA offers aesthetic surgeons an efficient, evidence-based resource for clinical decision support. Future development should focus on expanding knowledge sources and prospective clinical validation, with implementation emphasizing transparent source presentation to complement surgical expertise.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
6.20
自引率
20.70%
发文量
309
审稿时长
6-12 weeks
期刊介绍: Aesthetic Surgery Journal is a peer-reviewed international journal focusing on scientific developments and clinical techniques in aesthetic surgery. The official publication of The Aesthetic Society, ASJ is also the official English-language journal of many major international societies of plastic, aesthetic and reconstructive surgery representing South America, Central America, Europe, Asia, and the Middle East. It is also the official journal of the British Association of Aesthetic Plastic Surgeons, the Canadian Society for Aesthetic Plastic Surgery and The Rhinoplasty Society.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信