Artificial intelligence as a second reader for pneumothorax detection: redirecting rather than reducing chest CT use.

IF 3.1 3区 医学 Q1 EMERGENCY MEDICINE
Muhammed Fatih Cırıl, Ferhat Yıldız, Mustafa Akarca
{"title":"Artificial intelligence as a second reader for pneumothorax detection: redirecting rather than reducing chest CT use.","authors":"Muhammed Fatih Cırıl, Ferhat Yıldız, Mustafa Akarca","doi":"10.1186/s12873-026-01673-x","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Pneumothorax is a finding that is frequently missed in the emergency department, particularly in cases with subtle radiographic features, and can rapidly progress to tension pneumothorax when overlooked on the initial chest radiograph. Although artificial intelligence (AI)-assisted chest radiograph interpretation has been shown to improve diagnostic accuracy, its effect on the actual decision behaviour of emergency physicians - particularly on chest computed tomography (CT) ordering - remains insufficiently studied. This study evaluated the impact of AI-assisted chest radiograph interpretation on emergency physicians' pneumothorax diagnostic decisions and chest CT ordering behaviour, with a particular focus on the capacity of the AI alert to function as a second reader and capture diagnoses initially missed by the physician.</p><p><strong>Methods: </strong>This was a nationwide, online, cross-sectional simulation study conducted between 1 and 15 April 2026. Emergency physicians practising in Türkiye were asked to interpret 20 standardised posteroanterior chest radiographs presented in a randomised order (10 pneumothorax-positive [5 overt and 5 subtle] and 10 pneumothorax-negative cases, all confirmed by chest CT). For each case, participants first indicated whether they suspected pneumothorax on the unannotated radiograph, and then - after being shown the same image annotated by a CE-certified, deep learning-based chest radiograph interpretation system - indicated whether they would order a chest CT. The primary endpoint was the paired pre-AI versus post-AI change in simulated CT-ordering intent, derived from a predefined survey coding scheme and analysed using the McNemar exact test. As the pre- and post-AI items do not capture CT-ordering intent identically, this endpoint reflects simulated imaging intent rather than observed CT-ordering behaviour.</p><p><strong>Results: </strong>A total of 231 physicians (51.5% general practitioners, 25.5% emergency medicine residents, 22.9% emergency medicine specialists) completed the survey, yielding 4,620 physician-case response pairs. Simulated CT-ordering intent rose from 8.1% before AI exposure to 26.7% after AI exposure (absolute difference + 18.6% points; p < 0.001). The increase was concentrated in pneumothorax-positive cases (+ 31.6 points; p < 0.001) and remained limited in pneumothorax-negative cases (+ 5.7 points; p < 0.001). In subtle pneumothorax cases, the integrated diagnostic capture rate rose from 54.8% to 85.0% (+ 30.2 points); among the 339 cases in which physicians had initially answered \"no pneumothorax,\" 211 (62.2%) were converted into a CT order after the AI alert. The effect was statistically significant across all professional titles and seniority strata (p < 0.001 for all). The mean perceived usability score of the system was 8.1 out of 10 (interquartile range 7-10).</p><p><strong>Conclusions: </strong>In this simulation, AI-assisted chest radiograph interpretation did not reduce simulated CT-ordering intent; rather, the increase in intent was concentrated in true positive cases, with only a limited effect on negative cases. These findings are hypothesis-generating and require prospective confirmation with real CT-ordering data. The principal clinical value of the system lies in capturing pneumothorax diagnoses initially missed by emergency physicians, supporting its positioning as a second reader rather than as a CT-reduction tool.</p><p><strong>Trial registration: </strong>Not applicable.</p>","PeriodicalId":9002,"journal":{"name":"BMC Emergency Medicine","volume":" ","pages":""},"PeriodicalIF":3.1000,"publicationDate":"2026-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13599224/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMC Emergency Medicine","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12873-026-01673-x","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EMERGENCY MEDICINE","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Pneumothorax is a finding that is frequently missed in the emergency department, particularly in cases with subtle radiographic features, and can rapidly progress to tension pneumothorax when overlooked on the initial chest radiograph. Although artificial intelligence (AI)-assisted chest radiograph interpretation has been shown to improve diagnostic accuracy, its effect on the actual decision behaviour of emergency physicians - particularly on chest computed tomography (CT) ordering - remains insufficiently studied. This study evaluated the impact of AI-assisted chest radiograph interpretation on emergency physicians' pneumothorax diagnostic decisions and chest CT ordering behaviour, with a particular focus on the capacity of the AI alert to function as a second reader and capture diagnoses initially missed by the physician.

Methods: This was a nationwide, online, cross-sectional simulation study conducted between 1 and 15 April 2026. Emergency physicians practising in Türkiye were asked to interpret 20 standardised posteroanterior chest radiographs presented in a randomised order (10 pneumothorax-positive [5 overt and 5 subtle] and 10 pneumothorax-negative cases, all confirmed by chest CT). For each case, participants first indicated whether they suspected pneumothorax on the unannotated radiograph, and then - after being shown the same image annotated by a CE-certified, deep learning-based chest radiograph interpretation system - indicated whether they would order a chest CT. The primary endpoint was the paired pre-AI versus post-AI change in simulated CT-ordering intent, derived from a predefined survey coding scheme and analysed using the McNemar exact test. As the pre- and post-AI items do not capture CT-ordering intent identically, this endpoint reflects simulated imaging intent rather than observed CT-ordering behaviour.

Results: A total of 231 physicians (51.5% general practitioners, 25.5% emergency medicine residents, 22.9% emergency medicine specialists) completed the survey, yielding 4,620 physician-case response pairs. Simulated CT-ordering intent rose from 8.1% before AI exposure to 26.7% after AI exposure (absolute difference + 18.6% points; p < 0.001). The increase was concentrated in pneumothorax-positive cases (+ 31.6 points; p < 0.001) and remained limited in pneumothorax-negative cases (+ 5.7 points; p < 0.001). In subtle pneumothorax cases, the integrated diagnostic capture rate rose from 54.8% to 85.0% (+ 30.2 points); among the 339 cases in which physicians had initially answered "no pneumothorax," 211 (62.2%) were converted into a CT order after the AI alert. The effect was statistically significant across all professional titles and seniority strata (p < 0.001 for all). The mean perceived usability score of the system was 8.1 out of 10 (interquartile range 7-10).

Conclusions: In this simulation, AI-assisted chest radiograph interpretation did not reduce simulated CT-ordering intent; rather, the increase in intent was concentrated in true positive cases, with only a limited effect on negative cases. These findings are hypothesis-generating and require prospective confirmation with real CT-ordering data. The principal clinical value of the system lies in capturing pneumothorax diagnoses initially missed by emergency physicians, supporting its positioning as a second reader rather than as a CT-reduction tool.

Trial registration: Not applicable.

人工智能作为气胸检测的第二阅读器:重定向而不是减少胸部CT的使用。
背景:气胸是一种经常在急诊科被忽视的发现,特别是在有细微x线片特征的病例中,如果在最初的胸片上被忽视,气胸可以迅速发展为紧张性气胸。尽管人工智能(AI)辅助胸片解释已被证明可以提高诊断准确性,但其对急诊医生实际决策行为的影响——特别是对胸部计算机断层扫描(CT)排序的影响——仍未得到充分研究。本研究评估了人工智能辅助胸片解读对急诊医生气胸诊断决策和胸部CT排序行为的影响,特别关注了人工智能警报作为第二阅读器的能力,并捕捉了医生最初遗漏的诊断。方法:这是一项全国性的在线横断面模拟研究,于2026年4月1日至15日进行。在 rkiye执业的急诊医生被要求对随机顺序呈现的20张标准化胸片进行解读(10例气胸阳性[5例明显,5例不明显]和10例气胸阴性,均通过胸部CT确诊)。对于每个病例,参与者首先表明他们是否怀疑在未注释的x线片上有气胸,然后-在经过ce认证的基于深度学习的胸片解释系统注释的相同图像后-表明他们是否会订购胸部CT。主要终点是人工智能前与人工智能后模拟ct排序意图的配对变化,从预定义的调查编码方案中得出,并使用McNemar精确测试进行分析。由于人工智能前和人工智能后的项目不能完全捕获ct排序意图,因此该端点反映的是模拟的成像意图,而不是观察到的ct排序行为。结果:共有231名医生(51.5%为全科医生,25.5%为急诊住院医生,22.9%为急诊专科医生)完成了调查,产生了4,620对医案回复。人工智能暴露前的模拟ct定序意图从8.1%上升到26.7%(绝对差值+ 18.6%;p结论:在本模拟中,人工智能辅助胸片解读并未降低模拟ct定序意图,意图的增加集中在真阳性病例中,对阴性病例的影响有限。这些发现是假设生成的,需要用真实的ct排序数据进行前瞻性确认。该系统的主要临床价值在于捕捉急诊医生最初遗漏的气胸诊断,支持其作为第二阅读器的定位,而不是作为ct减影工具。试验注册:不适用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
BMC Emergency Medicine
BMC Emergency Medicine Medicine-Emergency Medicine
CiteScore
3.50
自引率
8.00%
发文量
178
审稿时长
29 weeks
期刊介绍: BMC Emergency Medicine is an open access, peer-reviewed journal that considers articles on all urgent and emergency aspects of medicine, in both practice and basic research. In addition, the journal covers aspects of disaster medicine and medicine in special locations, such as conflict areas and military medicine, together with articles concerning healthcare services in the emergency departments.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书