Assessing the diagnostic accuracy of artificial intelligence in post-endovascular aneurysm repair endoleak detection using dual-energy computed tomography angiography.

Polish journal of radiology Pub Date : 2024-08-28 eCollection Date: 2024-01-01 DOI:10.5114/pjr/192115
Ewa Nowak, Marcin Białecki, Agnieszka Białecka, Natalia Kazimierczak, Anna Kloska
{"title":"Assessing the diagnostic accuracy of artificial intelligence in post-endovascular aneurysm repair endoleak detection using dual-energy computed tomography angiography.","authors":"Ewa Nowak, Marcin Białecki, Agnieszka Białecka, Natalia Kazimierczak, Anna Kloska","doi":"10.5114/pjr/192115","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>The aim of this study was to evaluate the diagnostic accuracy of an artificial intelligence (AI) tool in detecting endoleaks in patients undergoing endovascular aneurysm repair (EVAR) using dual-energy computed tomography angiography (CTA).</p><p><strong>Material and methods: </strong>The study involved 95 patients who underwent EVAR and subsequent CTA follow-up. Dualenergy scans were performed, and images were reconstructed as linearly blended (LB) and 40 keV virtual monoenergetic (VMI) images. The AI tool PRAEVAorta<sup>®</sup>2 was used to assess arterial phase images for endoleaks. Two experienced readers independently evaluated the same images, and their consensus served as the reference standard. Key metrics, including accuracy, precision, recall, F1 score, and area under the receiver operating characteristic (ROC) curve (AUC), were calculated.</p><p><strong>Results: </strong>The final analysis included 94 patients. The AI tool demonstrated an accuracy of 78.7%, precision of 67.6%, recall of 10 71.9%, F1 score of 69.7%, and an AUC of 0.77 using LB images. However, the tool failed to process 40 keV VMI images correctly, limiting further analysis of these datasets.</p><p><strong>Conclusions: </strong>The AI tool showed moderate diagnostic accuracy in detecting endoleaks using LB images but failed to achieve the reliability needed for clinical use due to the significant number of misdiagnoses.</p>","PeriodicalId":94174,"journal":{"name":"Polish journal of radiology","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11384217/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Polish journal of radiology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.5114/pjr/192115","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Purpose: The aim of this study was to evaluate the diagnostic accuracy of an artificial intelligence (AI) tool in detecting endoleaks in patients undergoing endovascular aneurysm repair (EVAR) using dual-energy computed tomography angiography (CTA).

Material and methods: The study involved 95 patients who underwent EVAR and subsequent CTA follow-up. Dualenergy scans were performed, and images were reconstructed as linearly blended (LB) and 40 keV virtual monoenergetic (VMI) images. The AI tool PRAEVAorta®2 was used to assess arterial phase images for endoleaks. Two experienced readers independently evaluated the same images, and their consensus served as the reference standard. Key metrics, including accuracy, precision, recall, F1 score, and area under the receiver operating characteristic (ROC) curve (AUC), were calculated.

Results: The final analysis included 94 patients. The AI tool demonstrated an accuracy of 78.7%, precision of 67.6%, recall of 10 71.9%, F1 score of 69.7%, and an AUC of 0.77 using LB images. However, the tool failed to process 40 keV VMI images correctly, limiting further analysis of these datasets.

Conclusions: The AI tool showed moderate diagnostic accuracy in detecting endoleaks using LB images but failed to achieve the reliability needed for clinical use due to the significant number of misdiagnoses.

利用双能计算机断层扫描血管造影评估人工智能在血管内动脉瘤修补术后内漏检测中的诊断准确性。
目的:本研究旨在评估人工智能(AI)工具在使用双能计算机断层扫描血管造影(CTA)检测接受血管内动脉瘤修补术(EVAR)患者内漏方面的诊断准确性:研究涉及 95 名接受 EVAR 和后续 CTA 随访的患者。进行了双能扫描,并将图像重建为线性混合(LB)和 40 keV 虚拟单能(VMI)图像。使用人工智能工具 PRAEVAorta®2 评估动脉相位图像是否有内漏。两位经验丰富的读者独立评估了相同的图像,并将他们的共识作为参考标准。计算的关键指标包括准确度、精确度、召回率、F1得分和接收者操作特征曲线(ROC)下面积(AUC):最终分析包括 94 名患者。使用枸橼酸图像,人工智能工具的准确率为 78.7%,精确率为 67.6%,召回率为 10 71.9%,F1 得分为 69.7%,AUC 为 0.77。然而,该工具未能正确处理 40 keV VMI 图像,从而限制了对这些数据集的进一步分析:结论:人工智能工具在使用 LB 图像检测内漏方面显示出中等诊断准确性,但由于误诊率较高,未能达到临床使用所需的可靠性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
2.10
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信