Xiaolong Hu, Dayong Qi, Suya Li, Shifei Ye, Yue Chen, Wei Cao, Meng Du, Tianheng Zheng, Peng Li, Yibin Fang
{"title":"开发和验证一个可解释的机器学习模型,用于预测缺血性卒中患者取栓后临床无效再灌注的风险。","authors":"Xiaolong Hu, Dayong Qi, Suya Li, Shifei Ye, Yue Chen, Wei Cao, Meng Du, Tianheng Zheng, Peng Li, Yibin Fang","doi":"10.2147/TCRM.S520362","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Despite successful recanalization after thrombectomy in patients with acute ischemic stroke, poor prognosis often persists. This study aimed to investigate the factors contributing to clinically ineffective reperfusion (CIR), develop and validate a machine-learning model to predict CIR, and provide guidance for future clinical treatments.</p><p><strong>Methods: </strong>We collected data from patients undergoing thrombectomy at Shanghai Fourth People's Hospital between December 2021 and June 2024. The clinical variables were compared between the clinically ineffective and effective recanalization groups using univariate analysis. Four machine learning models were developed: random forest (RF), support vector machine (SVM), decision tree (DT), and k-nearest neighbor (KNN). Model performance was evaluated using receiver operating characteristic (ROC) curves and heatmap visualization. The SHAP method rank the feature importance and provided interpretability for the final model.</p><p><strong>Results: </strong>Among the four machine learning models, the RF model showed the best performance, with an area under the curve (AUC) of 0.96 (95% CI: 0.91-1.0), accuracy of 0.93, and specificity of 0.97 on the test dataset. The SHAP algorithm identified the number of endovascular thrombectomy (EVT) attempts as the key factor influencing CIR. Based on the RF model, a web-based calculator for CIR prediction is available at https://ineffectivereperfusion.shinyapps.io/calculate/. The final model included ten parameters: EVT attempts, diabetes mellitus, previous ischemic stroke, National Institutes of Health Stroke Scale (NIHSS score), preoperative infarction in the basal ganglia, baseline diastolic blood pressure, clot burden score (CBS)/basilar artery on computed tomography angiography (BATMAN) score, stroke cause, collateral grade, and MLS.</p><p><strong>Conclusion: </strong>We developed and validated the first interpretable machine learning model for CIR prediction after EVT, surpassing traditional methods. Our CIR risk prediction platform enables early intervention and personalized treatment. The number of EVT attempts has emerged as a key determinant, underscoring the need for optimized procedural timing to improve outcomes.</p>","PeriodicalId":22977,"journal":{"name":"Therapeutics and Clinical Risk Management","volume":"21 ","pages":"621-631"},"PeriodicalIF":2.8000,"publicationDate":"2025-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12057630/pdf/","citationCount":"0","resultStr":"{\"title\":\"Development and Validation of an Interpretable Machine Learning Model for Prediction of the Risk of Clinically Ineffective Reperfusion in Patients Following Thrombectomy for Ischemic Stroke.\",\"authors\":\"Xiaolong Hu, Dayong Qi, Suya Li, Shifei Ye, Yue Chen, Wei Cao, Meng Du, Tianheng Zheng, Peng Li, Yibin Fang\",\"doi\":\"10.2147/TCRM.S520362\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Despite successful recanalization after thrombectomy in patients with acute ischemic stroke, poor prognosis often persists. This study aimed to investigate the factors contributing to clinically ineffective reperfusion (CIR), develop and validate a machine-learning model to predict CIR, and provide guidance for future clinical treatments.</p><p><strong>Methods: </strong>We collected data from patients undergoing thrombectomy at Shanghai Fourth People's Hospital between December 2021 and June 2024. The clinical variables were compared between the clinically ineffective and effective recanalization groups using univariate analysis. Four machine learning models were developed: random forest (RF), support vector machine (SVM), decision tree (DT), and k-nearest neighbor (KNN). Model performance was evaluated using receiver operating characteristic (ROC) curves and heatmap visualization. The SHAP method rank the feature importance and provided interpretability for the final model.</p><p><strong>Results: </strong>Among the four machine learning models, the RF model showed the best performance, with an area under the curve (AUC) of 0.96 (95% CI: 0.91-1.0), accuracy of 0.93, and specificity of 0.97 on the test dataset. The SHAP algorithm identified the number of endovascular thrombectomy (EVT) attempts as the key factor influencing CIR. Based on the RF model, a web-based calculator for CIR prediction is available at https://ineffectivereperfusion.shinyapps.io/calculate/. The final model included ten parameters: EVT attempts, diabetes mellitus, previous ischemic stroke, National Institutes of Health Stroke Scale (NIHSS score), preoperative infarction in the basal ganglia, baseline diastolic blood pressure, clot burden score (CBS)/basilar artery on computed tomography angiography (BATMAN) score, stroke cause, collateral grade, and MLS.</p><p><strong>Conclusion: </strong>We developed and validated the first interpretable machine learning model for CIR prediction after EVT, surpassing traditional methods. Our CIR risk prediction platform enables early intervention and personalized treatment. The number of EVT attempts has emerged as a key determinant, underscoring the need for optimized procedural timing to improve outcomes.</p>\",\"PeriodicalId\":22977,\"journal\":{\"name\":\"Therapeutics and Clinical Risk Management\",\"volume\":\"21 \",\"pages\":\"621-631\"},\"PeriodicalIF\":2.8000,\"publicationDate\":\"2025-05-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12057630/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Therapeutics and Clinical Risk Management\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.2147/TCRM.S520362\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/1/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q1\",\"JCRName\":\"Pharmacology, Toxicology and Pharmaceutics\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Therapeutics and Clinical Risk Management","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.2147/TCRM.S520362","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"Pharmacology, Toxicology and Pharmaceutics","Score":null,"Total":0}
Development and Validation of an Interpretable Machine Learning Model for Prediction of the Risk of Clinically Ineffective Reperfusion in Patients Following Thrombectomy for Ischemic Stroke.
Background: Despite successful recanalization after thrombectomy in patients with acute ischemic stroke, poor prognosis often persists. This study aimed to investigate the factors contributing to clinically ineffective reperfusion (CIR), develop and validate a machine-learning model to predict CIR, and provide guidance for future clinical treatments.
Methods: We collected data from patients undergoing thrombectomy at Shanghai Fourth People's Hospital between December 2021 and June 2024. The clinical variables were compared between the clinically ineffective and effective recanalization groups using univariate analysis. Four machine learning models were developed: random forest (RF), support vector machine (SVM), decision tree (DT), and k-nearest neighbor (KNN). Model performance was evaluated using receiver operating characteristic (ROC) curves and heatmap visualization. The SHAP method rank the feature importance and provided interpretability for the final model.
Results: Among the four machine learning models, the RF model showed the best performance, with an area under the curve (AUC) of 0.96 (95% CI: 0.91-1.0), accuracy of 0.93, and specificity of 0.97 on the test dataset. The SHAP algorithm identified the number of endovascular thrombectomy (EVT) attempts as the key factor influencing CIR. Based on the RF model, a web-based calculator for CIR prediction is available at https://ineffectivereperfusion.shinyapps.io/calculate/. The final model included ten parameters: EVT attempts, diabetes mellitus, previous ischemic stroke, National Institutes of Health Stroke Scale (NIHSS score), preoperative infarction in the basal ganglia, baseline diastolic blood pressure, clot burden score (CBS)/basilar artery on computed tomography angiography (BATMAN) score, stroke cause, collateral grade, and MLS.
Conclusion: We developed and validated the first interpretable machine learning model for CIR prediction after EVT, surpassing traditional methods. Our CIR risk prediction platform enables early intervention and personalized treatment. The number of EVT attempts has emerged as a key determinant, underscoring the need for optimized procedural timing to improve outcomes.
期刊介绍:
Therapeutics and Clinical Risk Management is an international, peer-reviewed journal of clinical therapeutics and risk management, focusing on concise rapid reporting of clinical studies in all therapeutic areas, outcomes, safety, and programs for the effective, safe, and sustained use of medicines, therapeutic and surgical interventions in all clinical areas.
The journal welcomes submissions covering original research, clinical and epidemiological studies, reviews, guidelines, expert opinion and commentary. The journal will consider case reports but only if they make a valuable and original contribution to the literature.
As of 18th March 2019, Therapeutics and Clinical Risk Management will no longer consider meta-analyses for publication.
The journal does not accept study protocols, animal-based or cell line-based studies.