Ben Li MD , Naomi Eisenberg PT, MEd, CCRP , Derek Beaton PhD , Douglas S. Lee MD, PhD , Leen Al-Omran MD(c) , Duminda N. Wijeysundera MD, PhD , Mohamad A. Hussain MD, PhD , Ori D. Rotstein MD, MSc , Charles de Mestral MD, PhD , Muhammad Mamdani PharmD, MA, MPH , Graham Roche-Nagle MD, MBA , Mohammed Al-Omran MD, MSc
{"title":"利用机器学习预测下腔静脉过滤器并发症。","authors":"Ben Li MD , Naomi Eisenberg PT, MEd, CCRP , Derek Beaton PhD , Douglas S. Lee MD, PhD , Leen Al-Omran MD(c) , Duminda N. Wijeysundera MD, PhD , Mohamad A. Hussain MD, PhD , Ori D. Rotstein MD, MSc , Charles de Mestral MD, PhD , Muhammad Mamdani PharmD, MA, MPH , Graham Roche-Nagle MD, MBA , Mohammed Al-Omran MD, MSc","doi":"10.1016/j.jvsv.2024.101943","DOIUrl":null,"url":null,"abstract":"<div><h3>Objective</h3><div>Inferior vena cava (<em>IVC</em>) filter placement is associated with important long-term complications. Predictive models for filter-related complications may help guide clinical decision-making but remain limited. We developed machine learning (<em>ML</em>) algorithms that predict 1-year IVC filter complications using preoperative data.</div></div><div><h3>Methods</h3><div>The Vascular Quality Initiative database was used to identify patients who underwent IVC filter placement between 2013 and 2024. We identified 77 preoperative demographic and clinical features from the index hospitalization when the filter was placed. The primary outcome was 1-year filter-related complications (composite of filter thrombosis, migration, angulation, fracture, and embolization or fragmentation, vein perforation, new caval or iliac vein thrombosis, new pulmonary embolism, access site thrombosis, or failed retrieval). The data were divided into training (70%) and test (30%) sets. Six ML models were trained using preoperative features with 10-fold cross-validation (Extreme Gradient Boosting, random forest, Naïve Bayes classifier, support vector machine, artificial neural network, and logistic regression). The primary model evaluation metric was area under the receiver operating characteristic curve (<em>AUROC</em>). Model robustness was assessed using calibration plot and Brier score. Performance was evaluated across subgroups based on age, sex, race, ethnicity, rurality, median Area Deprivation Index, planned duration of filter, landing site of filter, and presence of prior IVC filter placement.</div></div><div><h3>Results</h3><div>Overall, 14,476 patients underwent IVC filter placement and 584 (4.0%) experienced 1-year filter-related complications. Patients with a primary outcome were younger (59.3 ± 16.7 years vs 63.8 ± 16.0 years; <em>P</em> < .001) and more likely to have thrombotic risk factors including thrombophilia, prior venous thromboembolism (<em>VTE</em>), and family history of VTE. The best prediction model was Extreme Gradient Boosting, achieving an AUROC of 0.93 (95% confidence interval, 0.92-0.94). In comparison, logistic regression had an AUROC of 0.63 (95% confidence interval, 0.61-0.65). Calibration plot showed good agreement between predicted/observed event probabilities with a Brier score of 0.07. The top 10 predictors of 1-year filter-related complications were (1) thrombophilia, (2) prior VTE, (3) antiphospholipid antibodies, (4) factor V Leiden mutation, (5) family history of VTE, (6) planned duration of IVC filter (temporary), (7) unable to maintain therapeutic anticoagulation, (8) malignancy, (9) recent or active bleeding, and (10) age. Model performance remained robust across all subgroups.</div></div><div><h3>Conclusions</h3><div>We developed ML models that can accurately predict 1-year IVC filter complications, performing better than logistic regression. These algorithms have potential to guide patient selection for filter placement, counselling, perioperative management, and follow-up to mitigate filter-related complications and improve outcomes.</div></div>","PeriodicalId":17537,"journal":{"name":"Journal of vascular surgery. Venous and lymphatic disorders","volume":null,"pages":null},"PeriodicalIF":2.8000,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Predicting inferior vena cava filter complications using machine learning\",\"authors\":\"Ben Li MD , Naomi Eisenberg PT, MEd, CCRP , Derek Beaton PhD , Douglas S. Lee MD, PhD , Leen Al-Omran MD(c) , Duminda N. Wijeysundera MD, PhD , Mohamad A. Hussain MD, PhD , Ori D. Rotstein MD, MSc , Charles de Mestral MD, PhD , Muhammad Mamdani PharmD, MA, MPH , Graham Roche-Nagle MD, MBA , Mohammed Al-Omran MD, MSc\",\"doi\":\"10.1016/j.jvsv.2024.101943\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Objective</h3><div>Inferior vena cava (<em>IVC</em>) filter placement is associated with important long-term complications. Predictive models for filter-related complications may help guide clinical decision-making but remain limited. We developed machine learning (<em>ML</em>) algorithms that predict 1-year IVC filter complications using preoperative data.</div></div><div><h3>Methods</h3><div>The Vascular Quality Initiative database was used to identify patients who underwent IVC filter placement between 2013 and 2024. We identified 77 preoperative demographic and clinical features from the index hospitalization when the filter was placed. The primary outcome was 1-year filter-related complications (composite of filter thrombosis, migration, angulation, fracture, and embolization or fragmentation, vein perforation, new caval or iliac vein thrombosis, new pulmonary embolism, access site thrombosis, or failed retrieval). The data were divided into training (70%) and test (30%) sets. Six ML models were trained using preoperative features with 10-fold cross-validation (Extreme Gradient Boosting, random forest, Naïve Bayes classifier, support vector machine, artificial neural network, and logistic regression). The primary model evaluation metric was area under the receiver operating characteristic curve (<em>AUROC</em>). Model robustness was assessed using calibration plot and Brier score. Performance was evaluated across subgroups based on age, sex, race, ethnicity, rurality, median Area Deprivation Index, planned duration of filter, landing site of filter, and presence of prior IVC filter placement.</div></div><div><h3>Results</h3><div>Overall, 14,476 patients underwent IVC filter placement and 584 (4.0%) experienced 1-year filter-related complications. Patients with a primary outcome were younger (59.3 ± 16.7 years vs 63.8 ± 16.0 years; <em>P</em> < .001) and more likely to have thrombotic risk factors including thrombophilia, prior venous thromboembolism (<em>VTE</em>), and family history of VTE. The best prediction model was Extreme Gradient Boosting, achieving an AUROC of 0.93 (95% confidence interval, 0.92-0.94). In comparison, logistic regression had an AUROC of 0.63 (95% confidence interval, 0.61-0.65). Calibration plot showed good agreement between predicted/observed event probabilities with a Brier score of 0.07. The top 10 predictors of 1-year filter-related complications were (1) thrombophilia, (2) prior VTE, (3) antiphospholipid antibodies, (4) factor V Leiden mutation, (5) family history of VTE, (6) planned duration of IVC filter (temporary), (7) unable to maintain therapeutic anticoagulation, (8) malignancy, (9) recent or active bleeding, and (10) age. Model performance remained robust across all subgroups.</div></div><div><h3>Conclusions</h3><div>We developed ML models that can accurately predict 1-year IVC filter complications, performing better than logistic regression. These algorithms have potential to guide patient selection for filter placement, counselling, perioperative management, and follow-up to mitigate filter-related complications and improve outcomes.</div></div>\",\"PeriodicalId\":17537,\"journal\":{\"name\":\"Journal of vascular surgery. Venous and lymphatic disorders\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.8000,\"publicationDate\":\"2024-07-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of vascular surgery. Venous and lymphatic disorders\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2213333X24003056\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"PERIPHERAL VASCULAR DISEASE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of vascular surgery. Venous and lymphatic disorders","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2213333X24003056","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PERIPHERAL VASCULAR DISEASE","Score":null,"Total":0}
Predicting inferior vena cava filter complications using machine learning
Objective
Inferior vena cava (IVC) filter placement is associated with important long-term complications. Predictive models for filter-related complications may help guide clinical decision-making but remain limited. We developed machine learning (ML) algorithms that predict 1-year IVC filter complications using preoperative data.
Methods
The Vascular Quality Initiative database was used to identify patients who underwent IVC filter placement between 2013 and 2024. We identified 77 preoperative demographic and clinical features from the index hospitalization when the filter was placed. The primary outcome was 1-year filter-related complications (composite of filter thrombosis, migration, angulation, fracture, and embolization or fragmentation, vein perforation, new caval or iliac vein thrombosis, new pulmonary embolism, access site thrombosis, or failed retrieval). The data were divided into training (70%) and test (30%) sets. Six ML models were trained using preoperative features with 10-fold cross-validation (Extreme Gradient Boosting, random forest, Naïve Bayes classifier, support vector machine, artificial neural network, and logistic regression). The primary model evaluation metric was area under the receiver operating characteristic curve (AUROC). Model robustness was assessed using calibration plot and Brier score. Performance was evaluated across subgroups based on age, sex, race, ethnicity, rurality, median Area Deprivation Index, planned duration of filter, landing site of filter, and presence of prior IVC filter placement.
Results
Overall, 14,476 patients underwent IVC filter placement and 584 (4.0%) experienced 1-year filter-related complications. Patients with a primary outcome were younger (59.3 ± 16.7 years vs 63.8 ± 16.0 years; P < .001) and more likely to have thrombotic risk factors including thrombophilia, prior venous thromboembolism (VTE), and family history of VTE. The best prediction model was Extreme Gradient Boosting, achieving an AUROC of 0.93 (95% confidence interval, 0.92-0.94). In comparison, logistic regression had an AUROC of 0.63 (95% confidence interval, 0.61-0.65). Calibration plot showed good agreement between predicted/observed event probabilities with a Brier score of 0.07. The top 10 predictors of 1-year filter-related complications were (1) thrombophilia, (2) prior VTE, (3) antiphospholipid antibodies, (4) factor V Leiden mutation, (5) family history of VTE, (6) planned duration of IVC filter (temporary), (7) unable to maintain therapeutic anticoagulation, (8) malignancy, (9) recent or active bleeding, and (10) age. Model performance remained robust across all subgroups.
Conclusions
We developed ML models that can accurately predict 1-year IVC filter complications, performing better than logistic regression. These algorithms have potential to guide patient selection for filter placement, counselling, perioperative management, and follow-up to mitigate filter-related complications and improve outcomes.
期刊介绍:
Journal of Vascular Surgery: Venous and Lymphatic Disorders is one of a series of specialist journals launched by the Journal of Vascular Surgery. It aims to be the premier international Journal of medical, endovascular and surgical management of venous and lymphatic disorders. It publishes high quality clinical, research, case reports, techniques, and practice manuscripts related to all aspects of venous and lymphatic disorders, including malformations and wound care, with an emphasis on the practicing clinician. The journal seeks to provide novel and timely information to vascular surgeons, interventionalists, phlebologists, wound care specialists, and allied health professionals who treat patients presenting with vascular and lymphatic disorders. As the official publication of The Society for Vascular Surgery and the American Venous Forum, the Journal will publish, after peer review, selected papers presented at the annual meeting of these organizations and affiliated vascular societies, as well as original articles from members and non-members.