Predicting Outcomes Following Carotid Artery Stenting Using Machine Learning.

IF 1.7 2区 医学 Q3 PERIPHERAL VASCULAR DISEASE
Ben Li, Badr Aljabri, Derek Beaton, Mohamad A Hussain, Douglas S Lee, Duminda N Wijeysundera, Ori D Rotstein, Charles de Mestral, Muhammad Mamdani, Graham Roche-Nagle, Mohammed Al-Omran
{"title":"Predicting Outcomes Following Carotid Artery Stenting Using Machine Learning.","authors":"Ben Li, Badr Aljabri, Derek Beaton, Mohamad A Hussain, Douglas S Lee, Duminda N Wijeysundera, Ori D Rotstein, Charles de Mestral, Muhammad Mamdani, Graham Roche-Nagle, Mohammed Al-Omran","doi":"10.1177/15266028251333670","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Carotid artery stenting (CAS) carries important perioperative risks. Outcome prediction tools may help guide clinical decision-making but remain limited. We developed machine learning (ML) algorithms that predict 30-day outcomes following transfemoral CAS.</p><p><strong>Methods: </strong>The National Surgical Quality Improvement Program (NSQIP) targeted vascular database was used to identify patients who underwent transfemoral CAS between 2011 and 2021. Input features included 36 preoperative demographic/clinical variables. The primary outcome was a 30-day major adverse cardiovascular event (MACE; composite of stroke, myocardial infarction [MI], or death). The secondary outcomes were 30-day stroke, MI, death, carotid-related morbidity, other morbidity, non-home discharge, and unplanned readmission. Our data were split into training (70%) and test (30%) sets. Using 10-fold cross-validation, we trained six ML models using preoperative features with logistic regression as the baseline comparator. The primary model evaluation metric was area under the receiver operating characteristic curve (AUROC). Model robustness was evaluated with calibration plot and Brier score. Variable importance scores were calculated to determine the top 10 predictive features. Performance was assessed on subgroups based on age, sex, race, ethnicity, symptom status, stent type, and urgency.</p><p><strong>Results: </strong>Overall, 2093 patients underwent CAS during the study period. Thirty-day MACE occurred in 130 (6.2%) patients. The best-performing prediction model for 30-day MACE was XGBoost, achieving an AUROC (95% CI) of 0.93 (0.92-0.94). In comparison, logistic regression had an AUROC (95% CI) of 0.67 (0.65-0.68), and existing tools in the literature demonstrate AUROCs ranging from 0.58 to 0.74. For secondary outcomes, XGBoost achieved AUROCs between 0.86 and 0.97. The calibration plot showed good agreement between predicted and observed event probabilities with a Brier score of 0.02. The top three predictive features in our algorithm were (1) symptomatic carotid stenosis, (2) age, and (3) American Society of Anesthesiologists classification. Model performance remained robust on all subgroup analyses of specific demographic and clinical populations.</p><p><strong>Conclusions: </strong>Our ML models accurately predict 30-day outcomes following transfemoral CAS using preoperative data. They have the potential for important utility in guiding risk-mitigation strategies for patients being considered for CAS to improve outcomes.Clinical ImpactTransfemoral carotid artery stenting (CAS) carries important perioperative risks. Outcome prediction tools may help guide clinical decision-making but remain limited. Using data from the National Surgical Quality Improvement Program (NSQIP) targeted vascular database, we developed machine learning (ML) models that accurately predict 30-day outcomes following transfemoral CAS using preoperative data, outperforming logistic regression and existing tools in the literature. The models were well-calibrated and remained robust across demographic and clinical subpopulations. These ML algorithms have the potential for important utility in guiding risk-mitigation strategies for patients being considered for transfemoral CAS to improve outcomes.</p>","PeriodicalId":50210,"journal":{"name":"Journal of Endovascular Therapy","volume":" ","pages":"15266028251333670"},"PeriodicalIF":1.7000,"publicationDate":"2025-04-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Endovascular Therapy","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1177/15266028251333670","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"PERIPHERAL VASCULAR DISEASE","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Carotid artery stenting (CAS) carries important perioperative risks. Outcome prediction tools may help guide clinical decision-making but remain limited. We developed machine learning (ML) algorithms that predict 30-day outcomes following transfemoral CAS.

Methods: The National Surgical Quality Improvement Program (NSQIP) targeted vascular database was used to identify patients who underwent transfemoral CAS between 2011 and 2021. Input features included 36 preoperative demographic/clinical variables. The primary outcome was a 30-day major adverse cardiovascular event (MACE; composite of stroke, myocardial infarction [MI], or death). The secondary outcomes were 30-day stroke, MI, death, carotid-related morbidity, other morbidity, non-home discharge, and unplanned readmission. Our data were split into training (70%) and test (30%) sets. Using 10-fold cross-validation, we trained six ML models using preoperative features with logistic regression as the baseline comparator. The primary model evaluation metric was area under the receiver operating characteristic curve (AUROC). Model robustness was evaluated with calibration plot and Brier score. Variable importance scores were calculated to determine the top 10 predictive features. Performance was assessed on subgroups based on age, sex, race, ethnicity, symptom status, stent type, and urgency.

Results: Overall, 2093 patients underwent CAS during the study period. Thirty-day MACE occurred in 130 (6.2%) patients. The best-performing prediction model for 30-day MACE was XGBoost, achieving an AUROC (95% CI) of 0.93 (0.92-0.94). In comparison, logistic regression had an AUROC (95% CI) of 0.67 (0.65-0.68), and existing tools in the literature demonstrate AUROCs ranging from 0.58 to 0.74. For secondary outcomes, XGBoost achieved AUROCs between 0.86 and 0.97. The calibration plot showed good agreement between predicted and observed event probabilities with a Brier score of 0.02. The top three predictive features in our algorithm were (1) symptomatic carotid stenosis, (2) age, and (3) American Society of Anesthesiologists classification. Model performance remained robust on all subgroup analyses of specific demographic and clinical populations.

Conclusions: Our ML models accurately predict 30-day outcomes following transfemoral CAS using preoperative data. They have the potential for important utility in guiding risk-mitigation strategies for patients being considered for CAS to improve outcomes.Clinical ImpactTransfemoral carotid artery stenting (CAS) carries important perioperative risks. Outcome prediction tools may help guide clinical decision-making but remain limited. Using data from the National Surgical Quality Improvement Program (NSQIP) targeted vascular database, we developed machine learning (ML) models that accurately predict 30-day outcomes following transfemoral CAS using preoperative data, outperforming logistic regression and existing tools in the literature. The models were well-calibrated and remained robust across demographic and clinical subpopulations. These ML algorithms have the potential for important utility in guiding risk-mitigation strategies for patients being considered for transfemoral CAS to improve outcomes.

使用机器学习预测颈动脉支架植入术后的预后。
背景:颈动脉支架植入术(CAS)具有重要的围手术期风险。结果预测工具可能有助于指导临床决策,但仍然有限。我们开发了机器学习(ML)算法来预测经股动脉栓塞后30天的预后。方法:使用国家外科质量改进计划(NSQIP)靶向血管数据库识别2011年至2021年期间接受经股动脉栓塞治疗的患者。输入特征包括36个术前人口学/临床变量。主要终点是30天主要不良心血管事件(MACE;中风、心肌梗塞[MI]或死亡的组合)。次要结局为30天卒中、心肌梗死、死亡、颈动脉相关发病率、其他发病率、非居家出院和计划外再入院。我们的数据分为训练集(70%)和测试集(30%)。使用10倍交叉验证,我们使用术前特征和逻辑回归作为基线比较器训练了6个ML模型。主要模型评价指标为受试者工作特征曲线下面积(AUROC)。用校正图和Brier评分评价模型的稳健性。计算变量重要性分数以确定前10个预测特征。根据年龄、性别、种族、民族、症状状态、支架类型和紧急程度进行亚组评估。结果:总体而言,2093例患者在研究期间接受了CAS。130例(6.2%)患者发生30天MACE。对30天MACE表现最好的预测模型是XGBoost, AUROC (95% CI)为0.93(0.92-0.94)。相比之下,逻辑回归的AUROC (95% CI)为0.67(0.65-0.68),文献中现有工具显示的AUROC范围为0.58至0.74。对于次要结果,XGBoost的auroc在0.86至0.97之间。校正图显示预测事件概率与观测事件概率吻合良好,Brier评分为0.02。在我们的算法中,前三个预测特征是:(1)症状性颈动脉狭窄,(2)年龄,(3)美国麻醉医师协会分类。在特定人口统计学和临床人群的所有亚组分析中,模型的表现仍然稳健。结论:我们的ML模型使用术前数据准确预测经股骨CAS术后30天的预后。它们在指导正在考虑进行CAS的患者的风险缓解策略以改善结果方面具有重要的效用。临床影响经股颈动脉支架植入术(CAS)具有重要的围手术期风险。结果预测工具可能有助于指导临床决策,但仍然有限。使用来自国家外科质量改进计划(NSQIP)靶向血管数据库的数据,我们开发了机器学习(ML)模型,该模型使用术前数据准确预测经股动脉CAS术后30天的预后,优于逻辑回归和文献中的现有工具。这些模型经过了很好的校准,并且在人口统计学和临床亚群中保持稳健。这些ML算法在指导考虑经股动脉CAS患者的风险缓解策略以改善预后方面具有重要的应用潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
5.30
自引率
15.40%
发文量
203
审稿时长
6-12 weeks
期刊介绍: The Journal of Endovascular Therapy (formerly the Journal of Endovascular Surgery) was established in 1994 as a forum for all physicians, scientists, and allied healthcare professionals who are engaged or interested in peripheral endovascular techniques and technology. An official publication of the International Society of Endovascular Specialists (ISEVS), the Journal of Endovascular Therapy publishes peer-reviewed articles of interest to clinicians and researchers in the field of peripheral endovascular interventions.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信