Haydn Hoffman, Jason J Sims, Violiza Inoa-Acosta, Daniel Hoit, Adam S Arthur, Dan Y Draytsel, YeonSoo Kim, Nitin Goyal
{"title":"Machine learning for clinical outcome prediction in cerebrovascular and endovascular neurosurgery: systematic review and meta-analysis.","authors":"Haydn Hoffman, Jason J Sims, Violiza Inoa-Acosta, Daniel Hoit, Adam S Arthur, Dan Y Draytsel, YeonSoo Kim, Nitin Goyal","doi":"10.1136/jnis-2024-021759","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Machine learning (ML) may be superior to traditional methods for clinical outcome prediction. We sought to systematically review the literature on ML for clinical outcome prediction in cerebrovascular and endovascular neurosurgery.</p><p><strong>Methods: </strong>A comprehensive literature search was performed, and original studies of patients undergoing cerebrovascular surgeries or endovascular procedures that developed a supervised ML model to predict a postoperative outcome or complication were included.</p><p><strong>Results: </strong>A total of 60 studies predicting 71 outcomes were included. Most cohorts were derived from single institutions (66.7%). The studies included stroke (32), subarachnoid hemorrhage ((SAH) 16), unruptured aneurysm (7), arteriovenous malformation (4), and cavernous malformation (1). Random forest was the best performing model in 12 studies (20%) followed by XGBoost (13.3%). Among 42 studies in which the ML model was compared with a standard statistical model, ML was superior in 33 (78.6%). Of 10 studies in which the ML model was compared with a non-ML clinical prediction model, ML was superior in nine (90%). External validation was performed in 10 studies (16.7%). In studies predicting functional outcome after mechanical thrombectomy the pooled area under the receiver operator characteristics curve (AUROC) of the test set performances was 0.84 (95% CI 0.79 to 0.88). For studies predicting outcomes after SAH, the pooled AUROCs for functional outcomes and delayed cerebral ischemia were 0.89 (95% CI 0.76 to 0.95) and 0.90 (95% CI 0.66 to 0.98), respectively.</p><p><strong>Conclusion: </strong>ML performs favorably for clinical outcome prediction in cerebrovascular and endovascular neurosurgery. However, multicenter studies with external validation are needed to ensure the generalizability of these findings.</p>","PeriodicalId":16411,"journal":{"name":"Journal of NeuroInterventional Surgery","volume":" ","pages":""},"PeriodicalIF":4.5000,"publicationDate":"2025-02-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of NeuroInterventional Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1136/jnis-2024-021759","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"NEUROIMAGING","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Machine learning (ML) may be superior to traditional methods for clinical outcome prediction. We sought to systematically review the literature on ML for clinical outcome prediction in cerebrovascular and endovascular neurosurgery.
Methods: A comprehensive literature search was performed, and original studies of patients undergoing cerebrovascular surgeries or endovascular procedures that developed a supervised ML model to predict a postoperative outcome or complication were included.
Results: A total of 60 studies predicting 71 outcomes were included. Most cohorts were derived from single institutions (66.7%). The studies included stroke (32), subarachnoid hemorrhage ((SAH) 16), unruptured aneurysm (7), arteriovenous malformation (4), and cavernous malformation (1). Random forest was the best performing model in 12 studies (20%) followed by XGBoost (13.3%). Among 42 studies in which the ML model was compared with a standard statistical model, ML was superior in 33 (78.6%). Of 10 studies in which the ML model was compared with a non-ML clinical prediction model, ML was superior in nine (90%). External validation was performed in 10 studies (16.7%). In studies predicting functional outcome after mechanical thrombectomy the pooled area under the receiver operator characteristics curve (AUROC) of the test set performances was 0.84 (95% CI 0.79 to 0.88). For studies predicting outcomes after SAH, the pooled AUROCs for functional outcomes and delayed cerebral ischemia were 0.89 (95% CI 0.76 to 0.95) and 0.90 (95% CI 0.66 to 0.98), respectively.
Conclusion: ML performs favorably for clinical outcome prediction in cerebrovascular and endovascular neurosurgery. However, multicenter studies with external validation are needed to ensure the generalizability of these findings.
期刊介绍:
The Journal of NeuroInterventional Surgery (JNIS) is a leading peer review journal for scientific research and literature pertaining to the field of neurointerventional surgery. The journal launch follows growing professional interest in neurointerventional techniques for the treatment of a range of neurological and vascular problems including stroke, aneurysms, brain tumors, and spinal compression.The journal is owned by SNIS and is also the official journal of the Interventional Chapter of the Australian and New Zealand Society of Neuroradiology (ANZSNR), the Canadian Interventional Neuro Group, the Hong Kong Neurological Society (HKNS) and the Neuroradiological Society of Taiwan.