Mert Karabacak, Burak Berksu Ozkara, Tobias D Faizy, Trevor Hardigan, Jeremy J Heit, Dhairya A Lakhani, Konstantinos Margetis, J Mocco, Kambiz Nael, Max Wintermark, Vivek S Yedavalli
{"title":"利用可解释的机器学习对远端中脉闭塞进行数据驱动预诊","authors":"Mert Karabacak, Burak Berksu Ozkara, Tobias D Faizy, Trevor Hardigan, Jeremy J Heit, Dhairya A Lakhani, Konstantinos Margetis, J Mocco, Kambiz Nael, Max Wintermark, Vivek S Yedavalli","doi":"10.3174/ajnr.A8547","DOIUrl":null,"url":null,"abstract":"<p><strong>Background and purpose: </strong>Distal medium vessel occlusions (DMVOs) are estimated to cause acute ischemic stroke (AIS) in 25-40% of cases. Prognostic models can inform patient counseling and research by enabling outcome predictions. However, models designed specifically for DMVOs are lacking.</p><p><strong>Materials and methods: </strong>This retrospective study developed a machine learning model to predict 90-day unfavorable outcome [defined as a modified Rankin Scale (mRS) score of 3-6] in 164 primary DMVO patients. A model developed with the TabPFN algorithm utilized selected clinical, laboratory, imaging, and treatment data with the Least Absolute Shrinkage and Selection Operator feature selection. Performance was evaluated via 5-repeat 5-fold cross-validation. Model discrimination and calibration were evaluated. SHapley Additive Explanations (SHAP) identified influential features. A web application deployed the model for individualized predictions.</p><p><strong>Results: </strong>The model achieved an area under the receiver operating characteristic curve of 0.815 (95% CI: 0.79-0.841) for predicting unfavorable outcome, demonstrating good discrimination, and a Brier score of 0.19 (95% CI: 0.177-0.202), demonstrating good calibration. SHAP analysis ranked admission National Institutes of Health Stroke Scale (NIHSS) score, premorbid mRS, type of thrombectomy, modified thrombolysis in cerebral infarction score, and history of malignancy as top predictors. The web application enables individualized prognostication.</p><p><strong>Conclusions: </strong>Our machine learning model demonstrated good discrimination and calibration for predicting 90-day unfavorable outcomes in primary DMVO strokes. This study demonstrates the potential for personalized prognostic counseling and research to support precision medicine in stroke care and recovery.</p><p><strong>Abbreviations: </strong>DMVO = Distal medium vessel occlusion; AIS = acute ischemic stroke; mRS = modified Rankin Scale; SHAP = SHapley Additive Explanations; NIHSS = National Institutes of Health Stroke Scale; ST = stroke thrombectomy; TRIPOD = Transparent Reporting of Multivariable Prediction Models for Individual Prognosis or Diagnosis; CT = computed tomography; CTP = CT perfusion; MRI = magnetic resonance imaging; CTA = CT angiography; DVT = deep vein thrombosis; PE = pulmonary emboli; TIA = transient ischemic attack; BMI = body mass index; ALP = alkaline phosphatase; ALT = alanine transaminase; AST = aspartate aminotransferase; NCCT-ASPECTS = Alberta Stroke Program Early CT Score; IVT = intravenous thrombolysis; mTICI = modified thrombolysis in cerebral infarction; ER = emergency room; kNN = k-nearest neighbor; LASSO = Least Absolute Shrinkage and Selection Operator; PDPs = partial dependence plots; ROC = receiver operating characteristic; PRC = precision-recall curve; AUROC = area under the ROC curve; AUPRC = area under the PRC; CI = confidence interval.</p>","PeriodicalId":93863,"journal":{"name":"AJNR. American journal of neuroradiology","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Data-Driven Prognostication in Distal Medium Vessel Occlusions Using Explainable Machine Learning.\",\"authors\":\"Mert Karabacak, Burak Berksu Ozkara, Tobias D Faizy, Trevor Hardigan, Jeremy J Heit, Dhairya A Lakhani, Konstantinos Margetis, J Mocco, Kambiz Nael, Max Wintermark, Vivek S Yedavalli\",\"doi\":\"10.3174/ajnr.A8547\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background and purpose: </strong>Distal medium vessel occlusions (DMVOs) are estimated to cause acute ischemic stroke (AIS) in 25-40% of cases. Prognostic models can inform patient counseling and research by enabling outcome predictions. However, models designed specifically for DMVOs are lacking.</p><p><strong>Materials and methods: </strong>This retrospective study developed a machine learning model to predict 90-day unfavorable outcome [defined as a modified Rankin Scale (mRS) score of 3-6] in 164 primary DMVO patients. A model developed with the TabPFN algorithm utilized selected clinical, laboratory, imaging, and treatment data with the Least Absolute Shrinkage and Selection Operator feature selection. Performance was evaluated via 5-repeat 5-fold cross-validation. Model discrimination and calibration were evaluated. SHapley Additive Explanations (SHAP) identified influential features. A web application deployed the model for individualized predictions.</p><p><strong>Results: </strong>The model achieved an area under the receiver operating characteristic curve of 0.815 (95% CI: 0.79-0.841) for predicting unfavorable outcome, demonstrating good discrimination, and a Brier score of 0.19 (95% CI: 0.177-0.202), demonstrating good calibration. SHAP analysis ranked admission National Institutes of Health Stroke Scale (NIHSS) score, premorbid mRS, type of thrombectomy, modified thrombolysis in cerebral infarction score, and history of malignancy as top predictors. The web application enables individualized prognostication.</p><p><strong>Conclusions: </strong>Our machine learning model demonstrated good discrimination and calibration for predicting 90-day unfavorable outcomes in primary DMVO strokes. This study demonstrates the potential for personalized prognostic counseling and research to support precision medicine in stroke care and recovery.</p><p><strong>Abbreviations: </strong>DMVO = Distal medium vessel occlusion; AIS = acute ischemic stroke; mRS = modified Rankin Scale; SHAP = SHapley Additive Explanations; NIHSS = National Institutes of Health Stroke Scale; ST = stroke thrombectomy; TRIPOD = Transparent Reporting of Multivariable Prediction Models for Individual Prognosis or Diagnosis; CT = computed tomography; CTP = CT perfusion; MRI = magnetic resonance imaging; CTA = CT angiography; DVT = deep vein thrombosis; PE = pulmonary emboli; TIA = transient ischemic attack; BMI = body mass index; ALP = alkaline phosphatase; ALT = alanine transaminase; AST = aspartate aminotransferase; NCCT-ASPECTS = Alberta Stroke Program Early CT Score; IVT = intravenous thrombolysis; mTICI = modified thrombolysis in cerebral infarction; ER = emergency room; kNN = k-nearest neighbor; LASSO = Least Absolute Shrinkage and Selection Operator; PDPs = partial dependence plots; ROC = receiver operating characteristic; PRC = precision-recall curve; AUROC = area under the ROC curve; AUPRC = area under the PRC; CI = confidence interval.</p>\",\"PeriodicalId\":93863,\"journal\":{\"name\":\"AJNR. American journal of neuroradiology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-10-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"AJNR. American journal of neuroradiology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3174/ajnr.A8547\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"AJNR. American journal of neuroradiology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3174/ajnr.A8547","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Data-Driven Prognostication in Distal Medium Vessel Occlusions Using Explainable Machine Learning.
Background and purpose: Distal medium vessel occlusions (DMVOs) are estimated to cause acute ischemic stroke (AIS) in 25-40% of cases. Prognostic models can inform patient counseling and research by enabling outcome predictions. However, models designed specifically for DMVOs are lacking.
Materials and methods: This retrospective study developed a machine learning model to predict 90-day unfavorable outcome [defined as a modified Rankin Scale (mRS) score of 3-6] in 164 primary DMVO patients. A model developed with the TabPFN algorithm utilized selected clinical, laboratory, imaging, and treatment data with the Least Absolute Shrinkage and Selection Operator feature selection. Performance was evaluated via 5-repeat 5-fold cross-validation. Model discrimination and calibration were evaluated. SHapley Additive Explanations (SHAP) identified influential features. A web application deployed the model for individualized predictions.
Results: The model achieved an area under the receiver operating characteristic curve of 0.815 (95% CI: 0.79-0.841) for predicting unfavorable outcome, demonstrating good discrimination, and a Brier score of 0.19 (95% CI: 0.177-0.202), demonstrating good calibration. SHAP analysis ranked admission National Institutes of Health Stroke Scale (NIHSS) score, premorbid mRS, type of thrombectomy, modified thrombolysis in cerebral infarction score, and history of malignancy as top predictors. The web application enables individualized prognostication.
Conclusions: Our machine learning model demonstrated good discrimination and calibration for predicting 90-day unfavorable outcomes in primary DMVO strokes. This study demonstrates the potential for personalized prognostic counseling and research to support precision medicine in stroke care and recovery.
Abbreviations: DMVO = Distal medium vessel occlusion; AIS = acute ischemic stroke; mRS = modified Rankin Scale; SHAP = SHapley Additive Explanations; NIHSS = National Institutes of Health Stroke Scale; ST = stroke thrombectomy; TRIPOD = Transparent Reporting of Multivariable Prediction Models for Individual Prognosis or Diagnosis; CT = computed tomography; CTP = CT perfusion; MRI = magnetic resonance imaging; CTA = CT angiography; DVT = deep vein thrombosis; PE = pulmonary emboli; TIA = transient ischemic attack; BMI = body mass index; ALP = alkaline phosphatase; ALT = alanine transaminase; AST = aspartate aminotransferase; NCCT-ASPECTS = Alberta Stroke Program Early CT Score; IVT = intravenous thrombolysis; mTICI = modified thrombolysis in cerebral infarction; ER = emergency room; kNN = k-nearest neighbor; LASSO = Least Absolute Shrinkage and Selection Operator; PDPs = partial dependence plots; ROC = receiver operating characteristic; PRC = precision-recall curve; AUROC = area under the ROC curve; AUPRC = area under the PRC; CI = confidence interval.