Explainable machine learning model for predicting functional outcomes in posterior circulation stroke after thrombectomy.

IF 4.5 1区 医学 Q1 NEUROIMAGING
Zhelv Yao, Qiuhong Ji, Xuefeng Zang, Wenwei Yun, Yun Luo, Jie Cao, Jingxian Xu, Zhihong Ke, Ziyi Xie, Chenglu Mao, Qiaochu Guan, Weiping Lv, Zhengyang Zhu, Yanan Huang, Ya Peng, Yun Xu
{"title":"Explainable machine learning model for predicting functional outcomes in posterior circulation stroke after thrombectomy.","authors":"Zhelv Yao, Qiuhong Ji, Xuefeng Zang, Wenwei Yun, Yun Luo, Jie Cao, Jingxian Xu, Zhihong Ke, Ziyi Xie, Chenglu Mao, Qiaochu Guan, Weiping Lv, Zhengyang Zhu, Yanan Huang, Ya Peng, Yun Xu","doi":"10.1136/jnis-2025-023624","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The early prediction of functional outcomes in patients with posterior circulation stroke (PCS) is crucial for timely interventions and optimizing treatment plans. We have developed and validated a machine learning (ML) model for predicting 3-month functional outcomes in patients with PCS undergoing endovascular thrombectomy (EVT).</p><p><strong>Methods: </strong>The derivation cohort, consisting of 202 patients with PCS who underwent EVT at four medical centers from January 2020 to December 2023, was separated for training and internal validation, and an external dataset of 54 patients admitted from January 2020 to July 2023 was used for external validation. The target outcome was a good functional outcome, defined as a modified Rankin Scale score of 0-3 at 3 months. Seven ML models were trained using preoperative features, with the primary evaluation metric being the area under the receiver operating characteristic curve (AUC). The top performing model was further trained using intraoperative and postoperative features. Model interpretations were generated using the Shapley additive explanations (SHAP) method.</p><p><strong>Results: </strong>The Random Forest model demonstrated the best discriminative ability among the models considered. After feature selection, the final preoperative model used seven features, achieving an AUC of 0.83 in the test set and 0.81 in the external validation cohort. The inclusion of intraoperative and postoperative features further enhanced the model's performance, resulting in an AUC of 0.84 and 0.90 in the test set and 0.83 and 0.90 in the external validation cohort, respectively. These models have been incorporated into a publicly accessible web-based calculator (https://zhelvyao-123-60-basilarz.streamlit.app).</p><p><strong>Conclusion: </strong>The interpretable ML models provide dynamic accurate predictions of functional outcomes in patients with PCS after EVT, offering valuable insights for personalized risk stratification and optimizing perioperative management, with potential for integration into clinical workflows.</p>","PeriodicalId":16411,"journal":{"name":"Journal of NeuroInterventional Surgery","volume":" ","pages":""},"PeriodicalIF":4.5000,"publicationDate":"2025-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of NeuroInterventional Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1136/jnis-2025-023624","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"NEUROIMAGING","Score":null,"Total":0}
引用次数: 0

Abstract

Background: The early prediction of functional outcomes in patients with posterior circulation stroke (PCS) is crucial for timely interventions and optimizing treatment plans. We have developed and validated a machine learning (ML) model for predicting 3-month functional outcomes in patients with PCS undergoing endovascular thrombectomy (EVT).

Methods: The derivation cohort, consisting of 202 patients with PCS who underwent EVT at four medical centers from January 2020 to December 2023, was separated for training and internal validation, and an external dataset of 54 patients admitted from January 2020 to July 2023 was used for external validation. The target outcome was a good functional outcome, defined as a modified Rankin Scale score of 0-3 at 3 months. Seven ML models were trained using preoperative features, with the primary evaluation metric being the area under the receiver operating characteristic curve (AUC). The top performing model was further trained using intraoperative and postoperative features. Model interpretations were generated using the Shapley additive explanations (SHAP) method.

Results: The Random Forest model demonstrated the best discriminative ability among the models considered. After feature selection, the final preoperative model used seven features, achieving an AUC of 0.83 in the test set and 0.81 in the external validation cohort. The inclusion of intraoperative and postoperative features further enhanced the model's performance, resulting in an AUC of 0.84 and 0.90 in the test set and 0.83 and 0.90 in the external validation cohort, respectively. These models have been incorporated into a publicly accessible web-based calculator (https://zhelvyao-123-60-basilarz.streamlit.app).

Conclusion: The interpretable ML models provide dynamic accurate predictions of functional outcomes in patients with PCS after EVT, offering valuable insights for personalized risk stratification and optimizing perioperative management, with potential for integration into clinical workflows.

可解释的机器学习模型用于预测血栓切除术后后循环卒中的功能结局。
背景:早期预测后循环卒中(PCS)患者的功能结局对于及时干预和优化治疗方案至关重要。我们开发并验证了一种机器学习(ML)模型,用于预测接受血管内血栓切除术(EVT)的PCS患者3个月的功能结局。方法:衍生队列包括2020年1月至2023年12月在4个医疗中心接受EVT的202例PCS患者,分离进行训练和内部验证,并使用2020年1月至2023年7月入院的54例患者的外部数据集进行外部验证。目标结果是良好的功能结果,定义为3个月时修改的Rankin量表评分0-3分。使用术前特征训练7个ML模型,主要评价指标是受试者工作特征曲线下的面积(AUC)。利用术中和术后特征对表现最好的模型进行进一步训练。使用Shapley加性解释(SHAP)方法生成模型解释。结果:随机森林模型在所有模型中表现出最好的判别能力。特征选择后,最终的术前模型使用了7个特征,测试集的AUC为0.83,外部验证队列的AUC为0.81。纳入术中和术后特征进一步增强了模型的性能,测试集的AUC分别为0.84和0.90,外部验证队列的AUC分别为0.83和0.90。这些模型已被纳入一个可公开访问的基于web的计算器(https://zhelvyao-123-60-basilarz.streamlit.app)。结论:可解释的ML模型提供了EVT后PCS患者功能结局的动态准确预测,为个性化风险分层和优化围手术期管理提供了有价值的见解,具有整合临床工作流程的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
9.50
自引率
14.60%
发文量
291
审稿时长
4-8 weeks
期刊介绍: The Journal of NeuroInterventional Surgery (JNIS) is a leading peer review journal for scientific research and literature pertaining to the field of neurointerventional surgery. The journal launch follows growing professional interest in neurointerventional techniques for the treatment of a range of neurological and vascular problems including stroke, aneurysms, brain tumors, and spinal compression.The journal is owned by SNIS and is also the official journal of the Interventional Chapter of the Australian and New Zealand Society of Neuroradiology (ANZSNR), the Canadian Interventional Neuro Group, the Hong Kong Neurological Society (HKNS) and the Neuroradiological Society of Taiwan.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信