{"title":"Explainable machine learning model for predicting functional outcomes in posterior circulation stroke after thrombectomy.","authors":"Zhelv Yao, Qiuhong Ji, Xuefeng Zang, Wenwei Yun, Yun Luo, Jie Cao, Jingxian Xu, Zhihong Ke, Ziyi Xie, Chenglu Mao, Qiaochu Guan, Weiping Lv, Zhengyang Zhu, Yanan Huang, Ya Peng, Yun Xu","doi":"10.1136/jnis-2025-023624","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The early prediction of functional outcomes in patients with posterior circulation stroke (PCS) is crucial for timely interventions and optimizing treatment plans. We have developed and validated a machine learning (ML) model for predicting 3-month functional outcomes in patients with PCS undergoing endovascular thrombectomy (EVT).</p><p><strong>Methods: </strong>The derivation cohort, consisting of 202 patients with PCS who underwent EVT at four medical centers from January 2020 to December 2023, was separated for training and internal validation, and an external dataset of 54 patients admitted from January 2020 to July 2023 was used for external validation. The target outcome was a good functional outcome, defined as a modified Rankin Scale score of 0-3 at 3 months. Seven ML models were trained using preoperative features, with the primary evaluation metric being the area under the receiver operating characteristic curve (AUC). The top performing model was further trained using intraoperative and postoperative features. Model interpretations were generated using the Shapley additive explanations (SHAP) method.</p><p><strong>Results: </strong>The Random Forest model demonstrated the best discriminative ability among the models considered. After feature selection, the final preoperative model used seven features, achieving an AUC of 0.83 in the test set and 0.81 in the external validation cohort. The inclusion of intraoperative and postoperative features further enhanced the model's performance, resulting in an AUC of 0.84 and 0.90 in the test set and 0.83 and 0.90 in the external validation cohort, respectively. These models have been incorporated into a publicly accessible web-based calculator (https://zhelvyao-123-60-basilarz.streamlit.app).</p><p><strong>Conclusion: </strong>The interpretable ML models provide dynamic accurate predictions of functional outcomes in patients with PCS after EVT, offering valuable insights for personalized risk stratification and optimizing perioperative management, with potential for integration into clinical workflows.</p>","PeriodicalId":16411,"journal":{"name":"Journal of NeuroInterventional Surgery","volume":" ","pages":""},"PeriodicalIF":4.5000,"publicationDate":"2025-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of NeuroInterventional Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1136/jnis-2025-023624","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"NEUROIMAGING","Score":null,"Total":0}
引用次数: 0
Abstract
Background: The early prediction of functional outcomes in patients with posterior circulation stroke (PCS) is crucial for timely interventions and optimizing treatment plans. We have developed and validated a machine learning (ML) model for predicting 3-month functional outcomes in patients with PCS undergoing endovascular thrombectomy (EVT).
Methods: The derivation cohort, consisting of 202 patients with PCS who underwent EVT at four medical centers from January 2020 to December 2023, was separated for training and internal validation, and an external dataset of 54 patients admitted from January 2020 to July 2023 was used for external validation. The target outcome was a good functional outcome, defined as a modified Rankin Scale score of 0-3 at 3 months. Seven ML models were trained using preoperative features, with the primary evaluation metric being the area under the receiver operating characteristic curve (AUC). The top performing model was further trained using intraoperative and postoperative features. Model interpretations were generated using the Shapley additive explanations (SHAP) method.
Results: The Random Forest model demonstrated the best discriminative ability among the models considered. After feature selection, the final preoperative model used seven features, achieving an AUC of 0.83 in the test set and 0.81 in the external validation cohort. The inclusion of intraoperative and postoperative features further enhanced the model's performance, resulting in an AUC of 0.84 and 0.90 in the test set and 0.83 and 0.90 in the external validation cohort, respectively. These models have been incorporated into a publicly accessible web-based calculator (https://zhelvyao-123-60-basilarz.streamlit.app).
Conclusion: The interpretable ML models provide dynamic accurate predictions of functional outcomes in patients with PCS after EVT, offering valuable insights for personalized risk stratification and optimizing perioperative management, with potential for integration into clinical workflows.
期刊介绍:
The Journal of NeuroInterventional Surgery (JNIS) is a leading peer review journal for scientific research and literature pertaining to the field of neurointerventional surgery. The journal launch follows growing professional interest in neurointerventional techniques for the treatment of a range of neurological and vascular problems including stroke, aneurysms, brain tumors, and spinal compression.The journal is owned by SNIS and is also the official journal of the Interventional Chapter of the Australian and New Zealand Society of Neuroradiology (ANZSNR), the Canadian Interventional Neuro Group, the Hong Kong Neurological Society (HKNS) and the Neuroradiological Society of Taiwan.