开发和验证机器学习模型用于预测血管内治疗后低级别动脉瘤性蛛网膜下腔出血患者的预后。

IF 2.8 3区 医学 Q1 Pharmacology, Toxicology and Pharmaceutics
Therapeutics and Clinical Risk Management Pub Date : 2025-03-07 eCollection Date: 2025-01-01 DOI:10.2147/TCRM.S504745
Senlin Du, Yanze Wu, Jiarong Tao, Lei Shu, Tengfeng Yan, Bing Xiao, Shigang Lv, Minhua Ye, Yanyan Gong, Xingen Zhu, Ping Hu, Miaojing Wu
{"title":"开发和验证机器学习模型用于预测血管内治疗后低级别动脉瘤性蛛网膜下腔出血患者的预后。","authors":"Senlin Du, Yanze Wu, Jiarong Tao, Lei Shu, Tengfeng Yan, Bing Xiao, Shigang Lv, Minhua Ye, Yanyan Gong, Xingen Zhu, Ping Hu, Miaojing Wu","doi":"10.2147/TCRM.S504745","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Endovascular treatment (EVT) has been recommended as a superior modality for the treatment of intracranial aneurysm. However, there still exists a worse percentage of poor functional outcome in patients with poor-grade aneurysmal subarachnoid hemorrhage (aSAH) undergoing EVT. Therefore, it is urgently needed to investigate the risk factors and develop a critical decision model in the subtype of such patients.</p><p><strong>Methods: </strong>We extracted the target variables from an ongoing registry cohort study, PROSAH-MPC, which was conducted in multiple centers in China. We randomly assigned these patients to training and validation cohorts with a ratio of 7:3. Univariate and multivariate logistic regressions were performed to find the potential factors, and then nine machine learning models and a stack ensemble model were developed with optimized variables. The performance of these models was evaluated through several indicators, including area under the receiver operating characteristic curve (AUC-ROC). We further use Shapley Additive Explanations (SHAP) methods for the distribution of feature visualization based on the optimal models.</p><p><strong>Results: </strong>A total of 226 eligible patients with poor-grade aSAH undergoing EVT were enrolled, while 89 (39.4%) has a poor 12-month outcome. Age (Adjusted OR [aOR], 1.08; 95% CI: 1.03-1.13; p = 0.002), subarachnoid hemorrhage volume (aOR, 1.02; 95% CI: 1.00-1.05; p = 0.033), World Federation of Neurosurgical Societies grade (WFNS) (aOR, 2.03; 95% CI: 1.05-3.93; p = 0.035), and Hunt-Hess grade (aOR, 2.36; 95% CI: 1.13-4.93; p = 0.022) were identified as the independent risk factors of the poor outcome. Then, the prediction models developed have revealed that LightGBM algorithm has a superior performance with an AUC-ROC value of 0.842 in the validation cohort, while the SHAP results showed that age is the most important risk factor affecting functional outcomes.</p><p><strong>Conclusion: </strong>The LightGBM model holds immense potential in facilitating risk stratification for poor-grade aSAH patients undergoing endovascular treatment who are at risk of adverse outcomes, thereby enhancing clinical decision-making processes.</p><p><strong>Trial registration: </strong>PROSAH-MPC. NCT05738083. Registered 16 November 2022 - Retrospectively registered, https://clinicaltrials.gov/study/NCT05738083.</p>","PeriodicalId":22977,"journal":{"name":"Therapeutics and Clinical Risk Management","volume":"21 ","pages":"293-307"},"PeriodicalIF":2.8000,"publicationDate":"2025-03-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11895686/pdf/","citationCount":"0","resultStr":"{\"title\":\"Development and Validation of Machine Learning Models for Outcome Prediction in Patients with Poor-Grade Aneurysmal Subarachnoid Hemorrhage Following Endovascular Treatment.\",\"authors\":\"Senlin Du, Yanze Wu, Jiarong Tao, Lei Shu, Tengfeng Yan, Bing Xiao, Shigang Lv, Minhua Ye, Yanyan Gong, Xingen Zhu, Ping Hu, Miaojing Wu\",\"doi\":\"10.2147/TCRM.S504745\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Endovascular treatment (EVT) has been recommended as a superior modality for the treatment of intracranial aneurysm. However, there still exists a worse percentage of poor functional outcome in patients with poor-grade aneurysmal subarachnoid hemorrhage (aSAH) undergoing EVT. Therefore, it is urgently needed to investigate the risk factors and develop a critical decision model in the subtype of such patients.</p><p><strong>Methods: </strong>We extracted the target variables from an ongoing registry cohort study, PROSAH-MPC, which was conducted in multiple centers in China. We randomly assigned these patients to training and validation cohorts with a ratio of 7:3. Univariate and multivariate logistic regressions were performed to find the potential factors, and then nine machine learning models and a stack ensemble model were developed with optimized variables. The performance of these models was evaluated through several indicators, including area under the receiver operating characteristic curve (AUC-ROC). We further use Shapley Additive Explanations (SHAP) methods for the distribution of feature visualization based on the optimal models.</p><p><strong>Results: </strong>A total of 226 eligible patients with poor-grade aSAH undergoing EVT were enrolled, while 89 (39.4%) has a poor 12-month outcome. Age (Adjusted OR [aOR], 1.08; 95% CI: 1.03-1.13; p = 0.002), subarachnoid hemorrhage volume (aOR, 1.02; 95% CI: 1.00-1.05; p = 0.033), World Federation of Neurosurgical Societies grade (WFNS) (aOR, 2.03; 95% CI: 1.05-3.93; p = 0.035), and Hunt-Hess grade (aOR, 2.36; 95% CI: 1.13-4.93; p = 0.022) were identified as the independent risk factors of the poor outcome. Then, the prediction models developed have revealed that LightGBM algorithm has a superior performance with an AUC-ROC value of 0.842 in the validation cohort, while the SHAP results showed that age is the most important risk factor affecting functional outcomes.</p><p><strong>Conclusion: </strong>The LightGBM model holds immense potential in facilitating risk stratification for poor-grade aSAH patients undergoing endovascular treatment who are at risk of adverse outcomes, thereby enhancing clinical decision-making processes.</p><p><strong>Trial registration: </strong>PROSAH-MPC. NCT05738083. Registered 16 November 2022 - Retrospectively registered, https://clinicaltrials.gov/study/NCT05738083.</p>\",\"PeriodicalId\":22977,\"journal\":{\"name\":\"Therapeutics and Clinical Risk Management\",\"volume\":\"21 \",\"pages\":\"293-307\"},\"PeriodicalIF\":2.8000,\"publicationDate\":\"2025-03-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11895686/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Therapeutics and Clinical Risk Management\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.2147/TCRM.S504745\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/1/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q1\",\"JCRName\":\"Pharmacology, Toxicology and Pharmaceutics\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Therapeutics and Clinical Risk Management","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.2147/TCRM.S504745","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"Pharmacology, Toxicology and Pharmaceutics","Score":null,"Total":0}
引用次数: 0

摘要

背景:血管内治疗(EVT)已被推荐为治疗颅内动脉瘤的一种优越方式。然而,严重程度较差的动脉瘤性蛛网膜下腔出血(aSAH)患者行EVT的功能预后不良的比例仍然较高。因此,迫切需要研究此类患者亚型的危险因素并建立关键决策模型。方法:我们从正在进行的注册队列研究PROSAH-MPC中提取目标变量,该研究在中国多个中心进行。我们将这些患者随机分配到训练组和验证组,比例为7:3。通过单因素和多因素logistic回归分析发现潜在影响因素,并利用优化后的变量建立了9个机器学习模型和1个堆栈集成模型。通过包括受试者工作特征曲线下面积(AUC-ROC)在内的几个指标来评估这些模型的性能。我们进一步使用Shapley加性解释(SHAP)方法在最优模型的基础上进行特征可视化分布。结果:共有226例接受EVT治疗的低级别aSAH患者入组,其中89例(39.4%)12个月预后不佳。年龄(调整后OR [aOR], 1.08;95% ci: 1.03-1.13;p = 0.002),蛛网膜下腔出血量(aOR, 1.02;95% ci: 1.00-1.05;p = 0.033),世界神经外科学会联合会评分(WFNS) (aOR, 2.03;95% ci: 1.05-3.93;p = 0.035), Hunt-Hess分级(aOR, 2.36;95% ci: 1.13-4.93;P = 0.022)为预后不良的独立危险因素。然后,建立的预测模型显示,LightGBM算法在验证队列中具有优越的性能,AUC-ROC值为0.842,而SHAP结果显示年龄是影响功能结局的最重要危险因素。结论:LightGBM模型在对接受血管内治疗的有不良结局风险的低级别aSAH患者进行风险分层方面具有巨大的潜力,从而提高了临床决策过程。试验注册:prosha - mpc。NCT05738083。注册于2022年11月16日-追溯注册,https://clinicaltrials.gov/study/NCT05738083。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Development and Validation of Machine Learning Models for Outcome Prediction in Patients with Poor-Grade Aneurysmal Subarachnoid Hemorrhage Following Endovascular Treatment.

Background: Endovascular treatment (EVT) has been recommended as a superior modality for the treatment of intracranial aneurysm. However, there still exists a worse percentage of poor functional outcome in patients with poor-grade aneurysmal subarachnoid hemorrhage (aSAH) undergoing EVT. Therefore, it is urgently needed to investigate the risk factors and develop a critical decision model in the subtype of such patients.

Methods: We extracted the target variables from an ongoing registry cohort study, PROSAH-MPC, which was conducted in multiple centers in China. We randomly assigned these patients to training and validation cohorts with a ratio of 7:3. Univariate and multivariate logistic regressions were performed to find the potential factors, and then nine machine learning models and a stack ensemble model were developed with optimized variables. The performance of these models was evaluated through several indicators, including area under the receiver operating characteristic curve (AUC-ROC). We further use Shapley Additive Explanations (SHAP) methods for the distribution of feature visualization based on the optimal models.

Results: A total of 226 eligible patients with poor-grade aSAH undergoing EVT were enrolled, while 89 (39.4%) has a poor 12-month outcome. Age (Adjusted OR [aOR], 1.08; 95% CI: 1.03-1.13; p = 0.002), subarachnoid hemorrhage volume (aOR, 1.02; 95% CI: 1.00-1.05; p = 0.033), World Federation of Neurosurgical Societies grade (WFNS) (aOR, 2.03; 95% CI: 1.05-3.93; p = 0.035), and Hunt-Hess grade (aOR, 2.36; 95% CI: 1.13-4.93; p = 0.022) were identified as the independent risk factors of the poor outcome. Then, the prediction models developed have revealed that LightGBM algorithm has a superior performance with an AUC-ROC value of 0.842 in the validation cohort, while the SHAP results showed that age is the most important risk factor affecting functional outcomes.

Conclusion: The LightGBM model holds immense potential in facilitating risk stratification for poor-grade aSAH patients undergoing endovascular treatment who are at risk of adverse outcomes, thereby enhancing clinical decision-making processes.

Trial registration: PROSAH-MPC. NCT05738083. Registered 16 November 2022 - Retrospectively registered, https://clinicaltrials.gov/study/NCT05738083.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Therapeutics and Clinical Risk Management
Therapeutics and Clinical Risk Management HEALTH CARE SCIENCES & SERVICES-
CiteScore
5.30
自引率
3.60%
发文量
139
审稿时长
16 weeks
期刊介绍: Therapeutics and Clinical Risk Management is an international, peer-reviewed journal of clinical therapeutics and risk management, focusing on concise rapid reporting of clinical studies in all therapeutic areas, outcomes, safety, and programs for the effective, safe, and sustained use of medicines, therapeutic and surgical interventions in all clinical areas. The journal welcomes submissions covering original research, clinical and epidemiological studies, reviews, guidelines, expert opinion and commentary. The journal will consider case reports but only if they make a valuable and original contribution to the literature. As of 18th March 2019, Therapeutics and Clinical Risk Management will no longer consider meta-analyses for publication. The journal does not accept study protocols, animal-based or cell line-based studies.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信