预测缺血性卒中出血转化的传统和机器学习模型:系统回顾和荟萃分析。

IF 6.3 4区 医学 Q1 MEDICINE, GENERAL & INTERNAL
Yanan Wang, Zengyi Zhang, Zhimeng Zhang, Xiaoying Chen, Junfeng Liu, Ming Liu
{"title":"预测缺血性卒中出血转化的传统和机器学习模型:系统回顾和荟萃分析。","authors":"Yanan Wang, Zengyi Zhang, Zhimeng Zhang, Xiaoying Chen, Junfeng Liu, Ming Liu","doi":"10.1186/s13643-025-02771-w","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Haemorrhagic transformation (HT) is a severe complication after ischaemic stroke, but identifying patients at high risks remains challenging. Although numerous prediction models have been developed for HT following thrombolysis, thrombectomy, or spontaneous occurrence, a comprehensive summary is lacking. This study aimed to review and compare traditional and machine learning-based HT prediction models, focusing on their development, validation, and diagnostic accuracy.</p><p><strong>Methods: </strong>PubMed and Ovid-Embase were searched for observational studies or randomised controlled trials related to traditional or machine learning-based models. Data were extracted according to Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies (CHARMS) checklist and risk of bias was assessed using the Prediction model Risk Of Bias ASsessment Tool (PROBAST). Performance data for prediction models that were externally validated at least twice and showed low risk of bias were meta-analysed.</p><p><strong>Results: </strong>A total of 100 studies were included, with 67 focusing on model development and 33 on model validation. Among 67 model development studies, 44 were traditional model studies involving 47 prediction models (with National Institutes of Health Stroke Scale score being the most frequently used predictor in 35 models), and 23 studies focused on machine learning prediction models (with support vector machines being the most common algorithm, used in 10 models). The 33 validation studies externally validated 34 traditional prediction models. Regarding study quality, 26 studies were assessed as having a low risk of bias, 11 as unclear, and 63 as high risk of bias. Meta-analysis of 15 studies validating eight models showed a pooled area under the receiver operating characteristic curve of approximately 0.70 for predicting HT.</p><p><strong>Conclusion: </strong>While significant progress has been made in developing HT prediction models, both traditional and machine learning-based models still have limitations in methodological rigour, predictive accuracy, and clinical applicability. Future models should undergo more rigorous validation, adhere to standardised reporting frameworks, and prioritise predictors that are both statistically significant and clinically meaningful. Collaborative efforts across research groups are essential for validating these models in diverse populations and improving their broader applicability in clinical practice.</p><p><strong>Systematic review registration: </strong>International Prospective Register of Systematic Reviews (CRD42022332816).</p>","PeriodicalId":22162,"journal":{"name":"Systematic Reviews","volume":"14 1","pages":"46"},"PeriodicalIF":6.3000,"publicationDate":"2025-02-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11846323/pdf/","citationCount":"0","resultStr":"{\"title\":\"Traditional and machine learning models for predicting haemorrhagic transformation in ischaemic stroke: a systematic review and meta-analysis.\",\"authors\":\"Yanan Wang, Zengyi Zhang, Zhimeng Zhang, Xiaoying Chen, Junfeng Liu, Ming Liu\",\"doi\":\"10.1186/s13643-025-02771-w\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Haemorrhagic transformation (HT) is a severe complication after ischaemic stroke, but identifying patients at high risks remains challenging. Although numerous prediction models have been developed for HT following thrombolysis, thrombectomy, or spontaneous occurrence, a comprehensive summary is lacking. This study aimed to review and compare traditional and machine learning-based HT prediction models, focusing on their development, validation, and diagnostic accuracy.</p><p><strong>Methods: </strong>PubMed and Ovid-Embase were searched for observational studies or randomised controlled trials related to traditional or machine learning-based models. Data were extracted according to Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies (CHARMS) checklist and risk of bias was assessed using the Prediction model Risk Of Bias ASsessment Tool (PROBAST). Performance data for prediction models that were externally validated at least twice and showed low risk of bias were meta-analysed.</p><p><strong>Results: </strong>A total of 100 studies were included, with 67 focusing on model development and 33 on model validation. Among 67 model development studies, 44 were traditional model studies involving 47 prediction models (with National Institutes of Health Stroke Scale score being the most frequently used predictor in 35 models), and 23 studies focused on machine learning prediction models (with support vector machines being the most common algorithm, used in 10 models). The 33 validation studies externally validated 34 traditional prediction models. Regarding study quality, 26 studies were assessed as having a low risk of bias, 11 as unclear, and 63 as high risk of bias. Meta-analysis of 15 studies validating eight models showed a pooled area under the receiver operating characteristic curve of approximately 0.70 for predicting HT.</p><p><strong>Conclusion: </strong>While significant progress has been made in developing HT prediction models, both traditional and machine learning-based models still have limitations in methodological rigour, predictive accuracy, and clinical applicability. Future models should undergo more rigorous validation, adhere to standardised reporting frameworks, and prioritise predictors that are both statistically significant and clinically meaningful. Collaborative efforts across research groups are essential for validating these models in diverse populations and improving their broader applicability in clinical practice.</p><p><strong>Systematic review registration: </strong>International Prospective Register of Systematic Reviews (CRD42022332816).</p>\",\"PeriodicalId\":22162,\"journal\":{\"name\":\"Systematic Reviews\",\"volume\":\"14 1\",\"pages\":\"46\"},\"PeriodicalIF\":6.3000,\"publicationDate\":\"2025-02-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11846323/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Systematic Reviews\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1186/s13643-025-02771-w\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MEDICINE, GENERAL & INTERNAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Systematic Reviews","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s13643-025-02771-w","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}
引用次数: 0

摘要

背景:出血性转化(HT)是缺血性卒中后的严重并发症,但识别高危患者仍然具有挑战性。虽然已经开发了许多预测模型,用于溶栓、取栓或自发发生后的HT,但缺乏全面的总结。本研究旨在回顾和比较传统的和基于机器学习的高温天气预测模型,重点关注它们的发展、验证和诊断准确性。方法:检索PubMed和Ovid-Embase中与传统模型或基于机器学习的模型相关的观察性研究或随机对照试验。根据预测模型研究系统评价的关键评价和数据提取(CHARMS)检查表提取数据,使用预测模型偏倚风险评估工具(PROBAST)评估偏倚风险。通过至少两次外部验证并显示低偏倚风险的预测模型的性能数据进行meta分析。结果:共纳入100项研究,其中67项研究关注模型开发,33项研究关注模型验证。67项模型开发研究中,44项是传统模型研究,涉及47个预测模型(在35个模型中,美国国立卫生研究院卒中量表评分是最常用的预测因子),23项研究侧重于机器学习预测模型(支持向量机是最常用的算法,在10个模型中使用)。33个验证研究从外部验证了34个传统预测模型。在研究质量方面,26项研究被评估为低偏倚风险,11项为不明确,63项为高偏倚风险。对验证8个模型的15项研究的荟萃分析显示,预测HT的受试者工作特征曲线下的汇总面积约为0.70。结论:虽然在开发HT预测模型方面取得了重大进展,但传统模型和基于机器学习的模型在方法严谨性、预测准确性和临床适用性方面仍然存在局限性。未来的模型应该经过更严格的验证,坚持标准化的报告框架,并优先考虑具有统计意义和临床意义的预测因子。跨研究小组的合作努力对于在不同人群中验证这些模型并提高其在临床实践中的广泛适用性至关重要。系统评价注册:国际前瞻性系统评价注册(CRD42022332816)。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Traditional and machine learning models for predicting haemorrhagic transformation in ischaemic stroke: a systematic review and meta-analysis.

Background: Haemorrhagic transformation (HT) is a severe complication after ischaemic stroke, but identifying patients at high risks remains challenging. Although numerous prediction models have been developed for HT following thrombolysis, thrombectomy, or spontaneous occurrence, a comprehensive summary is lacking. This study aimed to review and compare traditional and machine learning-based HT prediction models, focusing on their development, validation, and diagnostic accuracy.

Methods: PubMed and Ovid-Embase were searched for observational studies or randomised controlled trials related to traditional or machine learning-based models. Data were extracted according to Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies (CHARMS) checklist and risk of bias was assessed using the Prediction model Risk Of Bias ASsessment Tool (PROBAST). Performance data for prediction models that were externally validated at least twice and showed low risk of bias were meta-analysed.

Results: A total of 100 studies were included, with 67 focusing on model development and 33 on model validation. Among 67 model development studies, 44 were traditional model studies involving 47 prediction models (with National Institutes of Health Stroke Scale score being the most frequently used predictor in 35 models), and 23 studies focused on machine learning prediction models (with support vector machines being the most common algorithm, used in 10 models). The 33 validation studies externally validated 34 traditional prediction models. Regarding study quality, 26 studies were assessed as having a low risk of bias, 11 as unclear, and 63 as high risk of bias. Meta-analysis of 15 studies validating eight models showed a pooled area under the receiver operating characteristic curve of approximately 0.70 for predicting HT.

Conclusion: While significant progress has been made in developing HT prediction models, both traditional and machine learning-based models still have limitations in methodological rigour, predictive accuracy, and clinical applicability. Future models should undergo more rigorous validation, adhere to standardised reporting frameworks, and prioritise predictors that are both statistically significant and clinically meaningful. Collaborative efforts across research groups are essential for validating these models in diverse populations and improving their broader applicability in clinical practice.

Systematic review registration: International Prospective Register of Systematic Reviews (CRD42022332816).

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Systematic Reviews
Systematic Reviews Medicine-Medicine (miscellaneous)
CiteScore
8.30
自引率
0.00%
发文量
241
审稿时长
11 weeks
期刊介绍: Systematic Reviews encompasses all aspects of the design, conduct and reporting of systematic reviews. The journal publishes high quality systematic review products including systematic review protocols, systematic reviews related to a very broad definition of health, rapid reviews, updates of already completed systematic reviews, and methods research related to the science of systematic reviews, such as decision modelling. At this time Systematic Reviews does not accept reviews of in vitro studies. The journal also aims to ensure that the results of all well-conducted systematic reviews are published, regardless of their outcome.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信