开发和验证一个可解释的机器学习模型,用于预测缺血性卒中患者取栓后临床无效再灌注的风险。

IF 2.8 3区 医学 Q1 Pharmacology, Toxicology and Pharmaceutics
Therapeutics and Clinical Risk Management Pub Date : 2025-05-03 eCollection Date: 2025-01-01 DOI:10.2147/TCRM.S520362
Xiaolong Hu, Dayong Qi, Suya Li, Shifei Ye, Yue Chen, Wei Cao, Meng Du, Tianheng Zheng, Peng Li, Yibin Fang
{"title":"开发和验证一个可解释的机器学习模型,用于预测缺血性卒中患者取栓后临床无效再灌注的风险。","authors":"Xiaolong Hu, Dayong Qi, Suya Li, Shifei Ye, Yue Chen, Wei Cao, Meng Du, Tianheng Zheng, Peng Li, Yibin Fang","doi":"10.2147/TCRM.S520362","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Despite successful recanalization after thrombectomy in patients with acute ischemic stroke, poor prognosis often persists. This study aimed to investigate the factors contributing to clinically ineffective reperfusion (CIR), develop and validate a machine-learning model to predict CIR, and provide guidance for future clinical treatments.</p><p><strong>Methods: </strong>We collected data from patients undergoing thrombectomy at Shanghai Fourth People's Hospital between December 2021 and June 2024. The clinical variables were compared between the clinically ineffective and effective recanalization groups using univariate analysis. Four machine learning models were developed: random forest (RF), support vector machine (SVM), decision tree (DT), and k-nearest neighbor (KNN). Model performance was evaluated using receiver operating characteristic (ROC) curves and heatmap visualization. The SHAP method rank the feature importance and provided interpretability for the final model.</p><p><strong>Results: </strong>Among the four machine learning models, the RF model showed the best performance, with an area under the curve (AUC) of 0.96 (95% CI: 0.91-1.0), accuracy of 0.93, and specificity of 0.97 on the test dataset. The SHAP algorithm identified the number of endovascular thrombectomy (EVT) attempts as the key factor influencing CIR. Based on the RF model, a web-based calculator for CIR prediction is available at https://ineffectivereperfusion.shinyapps.io/calculate/. The final model included ten parameters: EVT attempts, diabetes mellitus, previous ischemic stroke, National Institutes of Health Stroke Scale (NIHSS score), preoperative infarction in the basal ganglia, baseline diastolic blood pressure, clot burden score (CBS)/basilar artery on computed tomography angiography (BATMAN) score, stroke cause, collateral grade, and MLS.</p><p><strong>Conclusion: </strong>We developed and validated the first interpretable machine learning model for CIR prediction after EVT, surpassing traditional methods. Our CIR risk prediction platform enables early intervention and personalized treatment. The number of EVT attempts has emerged as a key determinant, underscoring the need for optimized procedural timing to improve outcomes.</p>","PeriodicalId":22977,"journal":{"name":"Therapeutics and Clinical Risk Management","volume":"21 ","pages":"621-631"},"PeriodicalIF":2.8000,"publicationDate":"2025-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12057630/pdf/","citationCount":"0","resultStr":"{\"title\":\"Development and Validation of an Interpretable Machine Learning Model for Prediction of the Risk of Clinically Ineffective Reperfusion in Patients Following Thrombectomy for Ischemic Stroke.\",\"authors\":\"Xiaolong Hu, Dayong Qi, Suya Li, Shifei Ye, Yue Chen, Wei Cao, Meng Du, Tianheng Zheng, Peng Li, Yibin Fang\",\"doi\":\"10.2147/TCRM.S520362\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Despite successful recanalization after thrombectomy in patients with acute ischemic stroke, poor prognosis often persists. This study aimed to investigate the factors contributing to clinically ineffective reperfusion (CIR), develop and validate a machine-learning model to predict CIR, and provide guidance for future clinical treatments.</p><p><strong>Methods: </strong>We collected data from patients undergoing thrombectomy at Shanghai Fourth People's Hospital between December 2021 and June 2024. The clinical variables were compared between the clinically ineffective and effective recanalization groups using univariate analysis. Four machine learning models were developed: random forest (RF), support vector machine (SVM), decision tree (DT), and k-nearest neighbor (KNN). Model performance was evaluated using receiver operating characteristic (ROC) curves and heatmap visualization. The SHAP method rank the feature importance and provided interpretability for the final model.</p><p><strong>Results: </strong>Among the four machine learning models, the RF model showed the best performance, with an area under the curve (AUC) of 0.96 (95% CI: 0.91-1.0), accuracy of 0.93, and specificity of 0.97 on the test dataset. The SHAP algorithm identified the number of endovascular thrombectomy (EVT) attempts as the key factor influencing CIR. Based on the RF model, a web-based calculator for CIR prediction is available at https://ineffectivereperfusion.shinyapps.io/calculate/. The final model included ten parameters: EVT attempts, diabetes mellitus, previous ischemic stroke, National Institutes of Health Stroke Scale (NIHSS score), preoperative infarction in the basal ganglia, baseline diastolic blood pressure, clot burden score (CBS)/basilar artery on computed tomography angiography (BATMAN) score, stroke cause, collateral grade, and MLS.</p><p><strong>Conclusion: </strong>We developed and validated the first interpretable machine learning model for CIR prediction after EVT, surpassing traditional methods. Our CIR risk prediction platform enables early intervention and personalized treatment. The number of EVT attempts has emerged as a key determinant, underscoring the need for optimized procedural timing to improve outcomes.</p>\",\"PeriodicalId\":22977,\"journal\":{\"name\":\"Therapeutics and Clinical Risk Management\",\"volume\":\"21 \",\"pages\":\"621-631\"},\"PeriodicalIF\":2.8000,\"publicationDate\":\"2025-05-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12057630/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Therapeutics and Clinical Risk Management\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.2147/TCRM.S520362\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/1/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q1\",\"JCRName\":\"Pharmacology, Toxicology and Pharmaceutics\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Therapeutics and Clinical Risk Management","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.2147/TCRM.S520362","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"Pharmacology, Toxicology and Pharmaceutics","Score":null,"Total":0}
引用次数: 0

摘要

背景:急性缺血性脑卒中患者在取栓后,尽管能成功地再通,但预后往往不佳。本研究旨在探讨临床无效再灌注(CIR)的影响因素,开发并验证预测CIR的机器学习模型,为今后的临床治疗提供指导。方法:我们收集了2021年12月至2024年6月在上海第四人民医院接受血栓切除术的患者的数据。采用单因素分析比较临床无效再通组和有效再通组的临床变量。开发了四种机器学习模型:随机森林(RF)、支持向量机(SVM)、决策树(DT)和k近邻(KNN)。采用受试者工作特征(ROC)曲线和可视化热图对模型性能进行评价。SHAP方法对特征重要性进行排序,并为最终模型提供可解释性。结果:在四种机器学习模型中,RF模型表现最好,在测试数据集上的曲线下面积(AUC)为0.96 (95% CI: 0.91-1.0),准确率为0.93,特异性为0.97。SHAP算法将血管内取栓次数确定为影响CIR的关键因素。基于RF模型,基于web的CIR预测计算器可在https://ineffectivereperfusion.shinyapps.io/calculate/上获得。最终模型包括10个参数:EVT尝试次数、糖尿病、既往缺血性卒中、美国国立卫生研究院卒中量表(NIHSS评分)、术前基底神经节梗死、基线舒张压、凝块负担评分(CBS)/基底动脉ct血管造影(BATMAN)评分、卒中原因、侧支分级和MLS。结论:我们开发并验证了第一个用于EVT后CIR预测的可解释机器学习模型,超越了传统方法。我们的CIR风险预测平台能够实现早期干预和个性化治疗。EVT尝试的次数已成为一个关键的决定因素,强调了优化程序时间以改善结果的必要性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Development and Validation of an Interpretable Machine Learning Model for Prediction of the Risk of Clinically Ineffective Reperfusion in Patients Following Thrombectomy for Ischemic Stroke.

Background: Despite successful recanalization after thrombectomy in patients with acute ischemic stroke, poor prognosis often persists. This study aimed to investigate the factors contributing to clinically ineffective reperfusion (CIR), develop and validate a machine-learning model to predict CIR, and provide guidance for future clinical treatments.

Methods: We collected data from patients undergoing thrombectomy at Shanghai Fourth People's Hospital between December 2021 and June 2024. The clinical variables were compared between the clinically ineffective and effective recanalization groups using univariate analysis. Four machine learning models were developed: random forest (RF), support vector machine (SVM), decision tree (DT), and k-nearest neighbor (KNN). Model performance was evaluated using receiver operating characteristic (ROC) curves and heatmap visualization. The SHAP method rank the feature importance and provided interpretability for the final model.

Results: Among the four machine learning models, the RF model showed the best performance, with an area under the curve (AUC) of 0.96 (95% CI: 0.91-1.0), accuracy of 0.93, and specificity of 0.97 on the test dataset. The SHAP algorithm identified the number of endovascular thrombectomy (EVT) attempts as the key factor influencing CIR. Based on the RF model, a web-based calculator for CIR prediction is available at https://ineffectivereperfusion.shinyapps.io/calculate/. The final model included ten parameters: EVT attempts, diabetes mellitus, previous ischemic stroke, National Institutes of Health Stroke Scale (NIHSS score), preoperative infarction in the basal ganglia, baseline diastolic blood pressure, clot burden score (CBS)/basilar artery on computed tomography angiography (BATMAN) score, stroke cause, collateral grade, and MLS.

Conclusion: We developed and validated the first interpretable machine learning model for CIR prediction after EVT, surpassing traditional methods. Our CIR risk prediction platform enables early intervention and personalized treatment. The number of EVT attempts has emerged as a key determinant, underscoring the need for optimized procedural timing to improve outcomes.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Therapeutics and Clinical Risk Management
Therapeutics and Clinical Risk Management HEALTH CARE SCIENCES & SERVICES-
CiteScore
5.30
自引率
3.60%
发文量
139
审稿时长
16 weeks
期刊介绍: Therapeutics and Clinical Risk Management is an international, peer-reviewed journal of clinical therapeutics and risk management, focusing on concise rapid reporting of clinical studies in all therapeutic areas, outcomes, safety, and programs for the effective, safe, and sustained use of medicines, therapeutic and surgical interventions in all clinical areas. The journal welcomes submissions covering original research, clinical and epidemiological studies, reviews, guidelines, expert opinion and commentary. The journal will consider case reports but only if they make a valuable and original contribution to the literature. As of 18th March 2019, Therapeutics and Clinical Risk Management will no longer consider meta-analyses for publication. The journal does not accept study protocols, animal-based or cell line-based studies.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信