Addressing the Contrast Media Recognition Challenge: A Fully Automated Machine Learning Approach for Predicting Contrast Phases in CT Imaging.

IF 7 1区 医学 Q1 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING
Investigative Radiology Pub Date : 2024-09-01 Epub Date: 2024-03-04 DOI:10.1097/RLI.0000000000001071
Giulia Baldini, René Hosch, Cynthia S Schmidt, Katarzyna Borys, Lennard Kroll, Sven Koitka, Patrizia Haubold, Obioma Pelka, Felix Nensa, Johannes Haubold
{"title":"Addressing the Contrast Media Recognition Challenge: A Fully Automated Machine Learning Approach for Predicting Contrast Phases in CT Imaging.","authors":"Giulia Baldini, René Hosch, Cynthia S Schmidt, Katarzyna Borys, Lennard Kroll, Sven Koitka, Patrizia Haubold, Obioma Pelka, Felix Nensa, Johannes Haubold","doi":"10.1097/RLI.0000000000001071","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>Accurately acquiring and assigning different contrast-enhanced phases in computed tomography (CT) is relevant for clinicians and for artificial intelligence orchestration to select the most appropriate series for analysis. However, this information is commonly extracted from the CT metadata, which is often wrong. This study aimed at developing an automatic pipeline for classifying intravenous (IV) contrast phases and additionally for identifying contrast media in the gastrointestinal tract (GIT).</p><p><strong>Materials and methods: </strong>This retrospective study used 1200 CT scans collected at the investigating institution between January 4, 2016 and September 12, 2022, and 240 CT scans from multiple centers from The Cancer Imaging Archive for external validation. The open-source segmentation algorithm TotalSegmentator was used to identify regions of interest (pulmonary artery, aorta, stomach, portal/splenic vein, liver, portal vein/hepatic veins, inferior vena cava, duodenum, small bowel, colon, left/right kidney, urinary bladder), and machine learning classifiers were trained with 5-fold cross-validation to classify IV contrast phases (noncontrast, pulmonary arterial, arterial, venous, and urographic) and GIT contrast enhancement. The performance of the ensembles was evaluated using the receiver operating characteristic area under the curve (AUC) and 95% confidence intervals (CIs).</p><p><strong>Results: </strong>For the IV phase classification task, the following AUC scores were obtained for the internal test set: 99.59% [95% CI, 99.58-99.63] for the noncontrast phase, 99.50% [95% CI, 99.49-99.52] for the pulmonary-arterial phase, 99.13% [95% CI, 99.10-99.15] for the arterial phase, 99.8% [95% CI, 99.79-99.81] for the venous phase, and 99.7% [95% CI, 99.68-99.7] for the urographic phase. For the external dataset, a mean AUC of 97.33% [95% CI, 97.27-97.35] and 97.38% [95% CI, 97.34-97.41] was achieved for all contrast phases for the first and second annotators, respectively. Contrast media in the GIT could be identified with an AUC of 99.90% [95% CI, 99.89-99.9] in the internal dataset, whereas in the external dataset, an AUC of 99.73% [95% CI, 99.71-99.73] and 99.31% [95% CI, 99.27-99.33] was achieved with the first and second annotator, respectively.</p><p><strong>Conclusions: </strong>The integration of open-source segmentation networks and classifiers effectively classified contrast phases and identified GIT contrast enhancement using anatomical landmarks.</p>","PeriodicalId":14486,"journal":{"name":"Investigative Radiology","volume":" ","pages":"635-645"},"PeriodicalIF":7.0000,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Investigative Radiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/RLI.0000000000001071","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/3/4 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0

Abstract

Objectives: Accurately acquiring and assigning different contrast-enhanced phases in computed tomography (CT) is relevant for clinicians and for artificial intelligence orchestration to select the most appropriate series for analysis. However, this information is commonly extracted from the CT metadata, which is often wrong. This study aimed at developing an automatic pipeline for classifying intravenous (IV) contrast phases and additionally for identifying contrast media in the gastrointestinal tract (GIT).

Materials and methods: This retrospective study used 1200 CT scans collected at the investigating institution between January 4, 2016 and September 12, 2022, and 240 CT scans from multiple centers from The Cancer Imaging Archive for external validation. The open-source segmentation algorithm TotalSegmentator was used to identify regions of interest (pulmonary artery, aorta, stomach, portal/splenic vein, liver, portal vein/hepatic veins, inferior vena cava, duodenum, small bowel, colon, left/right kidney, urinary bladder), and machine learning classifiers were trained with 5-fold cross-validation to classify IV contrast phases (noncontrast, pulmonary arterial, arterial, venous, and urographic) and GIT contrast enhancement. The performance of the ensembles was evaluated using the receiver operating characteristic area under the curve (AUC) and 95% confidence intervals (CIs).

Results: For the IV phase classification task, the following AUC scores were obtained for the internal test set: 99.59% [95% CI, 99.58-99.63] for the noncontrast phase, 99.50% [95% CI, 99.49-99.52] for the pulmonary-arterial phase, 99.13% [95% CI, 99.10-99.15] for the arterial phase, 99.8% [95% CI, 99.79-99.81] for the venous phase, and 99.7% [95% CI, 99.68-99.7] for the urographic phase. For the external dataset, a mean AUC of 97.33% [95% CI, 97.27-97.35] and 97.38% [95% CI, 97.34-97.41] was achieved for all contrast phases for the first and second annotators, respectively. Contrast media in the GIT could be identified with an AUC of 99.90% [95% CI, 99.89-99.9] in the internal dataset, whereas in the external dataset, an AUC of 99.73% [95% CI, 99.71-99.73] and 99.31% [95% CI, 99.27-99.33] was achieved with the first and second annotator, respectively.

Conclusions: The integration of open-source segmentation networks and classifiers effectively classified contrast phases and identified GIT contrast enhancement using anatomical landmarks.

应对对比介质识别挑战:预测 CT 成像中对比相位的全自动机器学习方法。
目的:在计算机断层扫描(CT)中准确获取和分配不同的对比度增强相位,对临床医生和人工智能协调选择最合适的序列进行分析都很重要。然而,这些信息通常是从 CT 元数据中提取的,而元数据往往是错误的。本研究旨在开发一种自动管道,用于对静脉注射(IV)造影剂阶段进行分类,以及识别胃肠道(GIT)中的造影剂:这项回顾性研究使用了研究机构在2016年1月4日至2022年9月12日期间收集的1200张CT扫描照片,以及来自癌症影像档案馆的多个中心的240张CT扫描照片进行外部验证。使用开源分割算法 TotalSegmentator 识别感兴趣区域(肺动脉、主动脉、胃、门静脉/脾静脉、肝脏、门静脉/肝静脉、下腔静脉、十二指肠、小肠、结肠、左/右肾、膀胱)、通过 5 次交叉验证对机器学习分类器进行训练,以对 IV 造影剂阶段(非造影剂、肺动脉、动脉、静脉和尿路造影剂)和 GIT 造影剂增强进行分类。使用接收器操作特征曲线下面积(AUC)和 95% 置信区间(CIs)对组合的性能进行了评估:在 IV 期分类任务中,内部测试集的 AUC 得分如下非对比相为 99.59% [95% CI,99.58-99.63],肺动脉相为 99.50% [95% CI,99.49-99.52],动脉相为 99.13% [95% CI,99.10-99.15],静脉相为 99.8% [95% CI,99.79-99.81],尿路相为 99.7% [95% CI,99.68-99.7]。对于外部数据集,第一位和第二位标注者在所有对比阶段的平均 AUC 分别为 97.33% [95% CI,97.27-97.35] 和 97.38% [95% CI,97.34-97.41]。在内部数据集中,GIT 中对比介质的识别率为 99.90% [95% CI, 99.89-99.9],而在外部数据集中,第一和第二注释者的识别率分别为 99.73% [95% CI, 99.71-99.73] 和 99.31% [95% CI, 99.27-99.33]:开源分割网络和分类器的整合有效地对对比度阶段进行了分类,并利用解剖地标识别了 GIT 对比度增强。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Investigative Radiology
Investigative Radiology 医学-核医学
CiteScore
15.10
自引率
16.40%
发文量
188
审稿时长
4-8 weeks
期刊介绍: Investigative Radiology publishes original, peer-reviewed reports on clinical and laboratory investigations in diagnostic imaging, the diagnostic use of radioactive isotopes, computed tomography, positron emission tomography, magnetic resonance imaging, ultrasound, digital subtraction angiography, and related modalities. Emphasis is on early and timely publication. Primarily research-oriented, the journal also includes a wide variety of features of interest to clinical radiologists.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信