Prognostic estimation for acute ischemic stroke patients undergoing mechanical thrombectomy within an extended therapeutic window using an interpretable machine learning model.

IF 2.5 4区 医学 Q2 MATHEMATICAL & COMPUTATIONAL BIOLOGY
Frontiers in Neuroinformatics Pub Date : 2023-10-13 eCollection Date: 2023-01-01 DOI:10.3389/fninf.2023.1273827
Lin Tong, Yun Sun, Yueqi Zhu, Hui Luo, Wan Wan, Ying Wu
{"title":"Prognostic estimation for acute ischemic stroke patients undergoing mechanical thrombectomy within an extended therapeutic window using an interpretable machine learning model.","authors":"Lin Tong,&nbsp;Yun Sun,&nbsp;Yueqi Zhu,&nbsp;Hui Luo,&nbsp;Wan Wan,&nbsp;Ying Wu","doi":"10.3389/fninf.2023.1273827","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Mechanical thrombectomy (MT) is effective for acute ischemic stroke with large vessel occlusion (AIS-LVO) within an extended therapeutic window. However, successful reperfusion does not guarantee positive prognosis, with around 40-50% of cases yielding favorable outcomes. Preoperative prediction of patient outcomes is essential to identify those who may benefit from MT. Although machine learning (ML) has shown promise in handling variables with non-linear relationships in prediction models, its \"black box\" nature and the absence of ML models for extended-window MT prognosis remain limitations.</p><p><strong>Objective: </strong>This study aimed to establish and select the optimal model for predicting extended-window MT outcomes, with the Shapley additive explanation (SHAP) approach used to enhance the interpretability of the selected model.</p><p><strong>Methods: </strong>A retrospective analysis was conducted on 260 AIS-LVO patients undergoing extended-window MT. Selected patients were allocated into training and test sets at a 3:1 ratio following inclusion and exclusion criteria. Four ML classifiers and one logistic regression (Logit) model were constructed using pre-treatment variables from the training set. The optimal model was selected through comparative validation, with key features interpreted using the SHAP approach. The effectiveness of the chosen model was further evaluated using the test set.</p><p><strong>Results: </strong>Of the 212 selected patients, 159 comprised the training and 53 the test sets. Extreme gradient boosting (XGBoost) showed the highest discrimination with an area under the curve (AUC) of 0.93 during validation, and maintained an AUC of 0.77 during testing. SHAP analysis identified ischemic core volume, baseline NHISS score, ischemic penumbra volume, ASPECTS, and patient age as the top five determinants of outcome prediction.</p><p><strong>Conclusion: </strong>XGBoost emerged as the most effective for predicting the prognosis of AIS-LVO patients undergoing MT within the extended therapeutic window. SHAP interpretation improved its clinical confidence, paving the way for ML in clinical decision-making.</p>","PeriodicalId":12462,"journal":{"name":"Frontiers in Neuroinformatics","volume":"17 ","pages":"1273827"},"PeriodicalIF":2.5000,"publicationDate":"2023-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10603294/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in Neuroinformatics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3389/fninf.2023.1273827","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"MATHEMATICAL & COMPUTATIONAL BIOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Mechanical thrombectomy (MT) is effective for acute ischemic stroke with large vessel occlusion (AIS-LVO) within an extended therapeutic window. However, successful reperfusion does not guarantee positive prognosis, with around 40-50% of cases yielding favorable outcomes. Preoperative prediction of patient outcomes is essential to identify those who may benefit from MT. Although machine learning (ML) has shown promise in handling variables with non-linear relationships in prediction models, its "black box" nature and the absence of ML models for extended-window MT prognosis remain limitations.

Objective: This study aimed to establish and select the optimal model for predicting extended-window MT outcomes, with the Shapley additive explanation (SHAP) approach used to enhance the interpretability of the selected model.

Methods: A retrospective analysis was conducted on 260 AIS-LVO patients undergoing extended-window MT. Selected patients were allocated into training and test sets at a 3:1 ratio following inclusion and exclusion criteria. Four ML classifiers and one logistic regression (Logit) model were constructed using pre-treatment variables from the training set. The optimal model was selected through comparative validation, with key features interpreted using the SHAP approach. The effectiveness of the chosen model was further evaluated using the test set.

Results: Of the 212 selected patients, 159 comprised the training and 53 the test sets. Extreme gradient boosting (XGBoost) showed the highest discrimination with an area under the curve (AUC) of 0.93 during validation, and maintained an AUC of 0.77 during testing. SHAP analysis identified ischemic core volume, baseline NHISS score, ischemic penumbra volume, ASPECTS, and patient age as the top five determinants of outcome prediction.

Conclusion: XGBoost emerged as the most effective for predicting the prognosis of AIS-LVO patients undergoing MT within the extended therapeutic window. SHAP interpretation improved its clinical confidence, paving the way for ML in clinical decision-making.

Abstract Image

Abstract Image

Abstract Image

使用可解释的机器学习模型在延长的治疗窗口内对接受机械血栓切除术的急性缺血性卒中患者的预后进行评估。
背景:机械血栓切除术(MT)在延长的治疗窗口内对大血管闭塞的急性缺血性卒中(AIS-LVO)有效。然而,成功的再灌注并不能保证积极的预后,大约40-50%的病例产生了良好的结果。术前对患者预后的预测对于识别可能受益于MT的患者至关重要。尽管机器学习(ML)在处理预测模型中具有非线性关系的变量方面显示出了前景,但其“黑匣子”性质和缺乏用于扩展窗口MT预后的ML模型仍然存在局限性。目的:本研究旨在建立和选择预测扩展窗口MT结果的最佳模型,使用Shapley加性解释(SHAP)方法来提高所选模型的可解释性。方法:对260例接受延长窗口MT的AIS-LVO患者进行回顾性分析。根据纳入和排除标准,将选定的患者按3:1的比例分配到训练集和测试集。使用训练集中的预处理变量构建了四个ML分类器和一个逻辑回归(Logit)模型。通过比较验证选择了最佳模型,并使用SHAP方法解释了关键特征。使用测试集进一步评估了所选模型的有效性。结果:在212名入选患者中,159名为训练组,53名为测试组。极限梯度增强(XGBoost)在验证期间显示出最高的辨别力,曲线下面积(AUC)为0.93,在测试期间保持AUC为0.77。SHAP分析确定缺血核心体积、基线NHISS评分、缺血半影体积、ASPECTS和患者年龄是预测结果的前五大决定因素。结论:XGBoost是在延长治疗窗口内预测AIS-LVO患者MT预后的最有效方法。SHAP解释提高了其临床信心,为ML在临床决策中铺平了道路。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Frontiers in Neuroinformatics
Frontiers in Neuroinformatics MATHEMATICAL & COMPUTATIONAL BIOLOGY-NEUROSCIENCES
CiteScore
4.80
自引率
5.70%
发文量
132
审稿时长
14 weeks
期刊介绍: Frontiers in Neuroinformatics publishes rigorously peer-reviewed research on the development and implementation of numerical/computational models and analytical tools used to share, integrate and analyze experimental data and advance theories of the nervous system functions. Specialty Chief Editors Jan G. Bjaalie at the University of Oslo and Sean L. Hill at the École Polytechnique Fédérale de Lausanne are supported by an outstanding Editorial Board of international experts. This multidisciplinary open-access journal is at the forefront of disseminating and communicating scientific knowledge and impactful discoveries to researchers, academics and the public worldwide. Neuroscience is being propelled into the information age as the volume of information explodes, demanding organization and synthesis. Novel synthesis approaches are opening up a new dimension for the exploration of the components of brain elements and systems and the vast number of variables that underlie their functions. Neural data is highly heterogeneous with complex inter-relations across multiple levels, driving the need for innovative organizing and synthesizing approaches from genes to cognition, and covering a range of species and disease states. Frontiers in Neuroinformatics therefore welcomes submissions on existing neuroscience databases, development of data and knowledge bases for all levels of neuroscience, applications and technologies that can facilitate data sharing (interoperability, formats, terminologies, and ontologies), and novel tools for data acquisition, analyses, visualization, and dissemination of nervous system data. Our journal welcomes submissions on new tools (software and hardware) that support brain modeling, and the merging of neuroscience databases with brain models used for simulation and visualization.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信