Artificial intelligence in emergency and trauma radiology: ASER AI/ML expert panel Delphi consensus statement on research guidelines, practices, and priorities.

IF 1.7 Q3 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING
David Dreizin, Garvit Khatri, Pedro V Staziaki, Karen Buch, Mathias Unberath, Mohammed Mohammed, Aaron Sodickson, Bharti Khurana, Anjali Agrawal, James Stephen Spann, Nicholas Beckmann, Zachary DelProposto, Christina A LeBedis, Melissa Davis, Gabrielle Dickerson, Michael Lev
{"title":"Artificial intelligence in emergency and trauma radiology: ASER AI/ML expert panel Delphi consensus statement on research guidelines, practices, and priorities.","authors":"David Dreizin, Garvit Khatri, Pedro V Staziaki, Karen Buch, Mathias Unberath, Mohammed Mohammed, Aaron Sodickson, Bharti Khurana, Anjali Agrawal, James Stephen Spann, Nicholas Beckmann, Zachary DelProposto, Christina A LeBedis, Melissa Davis, Gabrielle Dickerson, Michael Lev","doi":"10.1007/s10140-024-02306-1","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Emergency/trauma radiology artificial intelligence (AI) is maturing along all stages of technology readiness, with research and development (R&D) ranging from data curation and algorithm development to post-market monitoring and retraining.</p><p><strong>Purpose: </strong>To develop an expert consensus document on best research practices and methodological priorities for emergency/trauma radiology AI.</p><p><strong>Methods: </strong>A Delphi consensus exercise was conducted by the ASER AI/ML expert panel between 2022-2024. In phase 1, a steering committee (7 panelists) established key themes- curation; validity; human factors; workflow; barriers; future avenues; and ethics- and generated an edited, collated long-list of statements. In phase 2, two Delphi rounds using anonymous RAND/UCLA Likert grading were conducted with web-based data capture (round 1) and a bespoke excel document with literature hyperlinks (round 2). Between rounds, editing and knowledge synthesis helped maximize consensus. Statements reaching ≥80% agreement were included in the final document.</p><p><strong>Results: </strong>Delphi rounds 1 and 2 consisted of 81 and 78 items, respectively.18/21 expert panelists (86%) responded to round 1, and 15 to round 2 (17% drop-out). Consensus was reached for 65 statements. Observations were summarized and contextualized. Statements with unanimous consensus centered around transparent methodologic reporting; testing for generalizability and robustness with external data; and benchmarking performance with appropriate metrics and baselines. A manuscript draft was circulated to panelists for editing and final approval.</p><p><strong>Conclusions: </strong>The document is meant as a framework to foster best-practices and further discussion among researchers working on various aspects of emergency and trauma radiology AI.</p>","PeriodicalId":11623,"journal":{"name":"Emergency Radiology","volume":" ","pages":""},"PeriodicalIF":1.7000,"publicationDate":"2024-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Emergency Radiology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s10140-024-02306-1","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Emergency/trauma radiology artificial intelligence (AI) is maturing along all stages of technology readiness, with research and development (R&D) ranging from data curation and algorithm development to post-market monitoring and retraining.

Purpose: To develop an expert consensus document on best research practices and methodological priorities for emergency/trauma radiology AI.

Methods: A Delphi consensus exercise was conducted by the ASER AI/ML expert panel between 2022-2024. In phase 1, a steering committee (7 panelists) established key themes- curation; validity; human factors; workflow; barriers; future avenues; and ethics- and generated an edited, collated long-list of statements. In phase 2, two Delphi rounds using anonymous RAND/UCLA Likert grading were conducted with web-based data capture (round 1) and a bespoke excel document with literature hyperlinks (round 2). Between rounds, editing and knowledge synthesis helped maximize consensus. Statements reaching ≥80% agreement were included in the final document.

Results: Delphi rounds 1 and 2 consisted of 81 and 78 items, respectively.18/21 expert panelists (86%) responded to round 1, and 15 to round 2 (17% drop-out). Consensus was reached for 65 statements. Observations were summarized and contextualized. Statements with unanimous consensus centered around transparent methodologic reporting; testing for generalizability and robustness with external data; and benchmarking performance with appropriate metrics and baselines. A manuscript draft was circulated to panelists for editing and final approval.

Conclusions: The document is meant as a framework to foster best-practices and further discussion among researchers working on various aspects of emergency and trauma radiology AI.

急诊和创伤放射学中的人工智能:ASER AI/ML专家小组关于研究指南、实践和优先事项的德尔菲共识声明。
背景:紧急/创伤放射学人工智能(AI)在技术准备的各个阶段都在成熟,从数据管理和算法开发到上市后监测和再培训的研究和开发(R&D)都在进行。目的:就急诊/创伤放射学人工智能的最佳研究实践和方法重点制定专家共识文件。方法:在2022-2024年期间,由ASER AI/ML专家组进行德尔菲共识练习。在第一阶段,一个指导委员会(7名小组成员)确定了关键主题——策展;效度;人为因素;工作流;障碍;未来的途径;以及道德——并生成了一份经过编辑、整理的长长的声明清单。在第二阶段,通过基于网络的数据采集(第一轮)和带有文献超链接的定制excel文档(第二轮)进行了两轮德尔菲匿名RAND/UCLA Likert评分。在两轮之间,编辑和知识合成有助于最大限度地达成共识。一致性≥80%的陈述纳入最终文件。结果:德尔菲第1轮和第2轮分别有81项和78项。18/21的专家小组成员(86%)对第一轮有回应,15人对第2轮有回应(17%退出)。就65项发言达成协商一致意见。对观察结果进行了总结和背景分析。以透明的方法报告为中心,达成一致意见的陈述;外部数据的泛化性和鲁棒性测试;并使用适当的指标和基线对性能进行基准测试。一份草稿分发给小组成员进行编辑和最后批准。结论:该文件旨在作为一个框架,促进急诊和创伤放射学人工智能各个方面的研究人员之间的最佳实践和进一步讨论。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Emergency Radiology
Emergency Radiology RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING-
CiteScore
4.60
自引率
4.50%
发文量
98
期刊介绍: To advance and improve the radiologic aspects of emergency careTo establish Emergency Radiology as an area of special interest in the field of diagnostic imagingTo improve methods of education in Emergency RadiologyTo provide, through formal meetings, a mechanism for presentation of scientific papers on various aspects of Emergency Radiology and continuing educationTo promote research in Emergency Radiology by clinical and basic science investigators, including residents and other traineesTo act as the resource body on Emergency Radiology for those interested in emergency patient care Members of the American Society of Emergency Radiology (ASER) receive the Emergency Radiology journal as a benefit of membership!
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信