Predicting future occlusion or stenosis of lower extremity bypass grafts using artificial intelligence to simultaneously analyze all flow velocities collected in current and previous ultrasound examinations
Xiao Luo PhD , Fattah Muhammad Tahabi BS , Dave M. Rollins RVT , Alan P. Sawchuk MD
{"title":"Predicting future occlusion or stenosis of lower extremity bypass grafts using artificial intelligence to simultaneously analyze all flow velocities collected in current and previous ultrasound examinations","authors":"Xiao Luo PhD , Fattah Muhammad Tahabi BS , Dave M. Rollins RVT , Alan P. Sawchuk MD","doi":"10.1016/j.jvssci.2024.100192","DOIUrl":null,"url":null,"abstract":"<div><h3>Objective</h3><p>Routine surveillance with duplex ultrasound (DUS) examination is recommended after femoral-popliteal and femoral-tibial-pedal vein bypass grafts with various intervals postoperatively. The presently used methodology to analyze bypass graft DUS examination does not use all the available data and has been shown to have a significant rate for missing impending bypass graft failure. The objective of this research is to investigate recurrent neural networks (RNNs) to predict future bypass graft occlusion or stenosis.</p></div><div><h3>Methods</h3><p>This study includes DUS examinations of 663 patients who had bypass graft operations done between January 2009 and June 2022. Only examinations without missing values were included. We developed two RNNs (a bidirectional long short-term memory unit and a bidirectional gated recurrent unit) to predict bypass graft occlusion and stenosis based on peak systolic velocities collected in the 2 to 5 previous DUS examinations. We excluded the examinations with missing values and split our data into training and test sets. Then, we applied 10-fold cross-validation on training to optimize the hyperparameters and compared models using the test data.</p></div><div><h3>Results</h3><p>The bidirectional long short-term memory unit model can gain an overall sensitivity of 0.939, specificity of 0.963, and area under the curve of 0.950 on the prediction of bypass graft occlusion, and an overall sensitivity of 0.915, specificity of 0.909, and area under the curve of 0.912 predicting the development of a future critical stenosis. The results on different bypass types show that the system performs differently on different types. The results on subcohorts based on gender, smoking status, and comorbidities show that the performance on current smokers is lower than the never smoker.</p></div><div><h3>Conclusions</h3><p>We found that RNNs can gain good sensitivity, specificity, and accuracy for the detection of impending bypass graft occlusion or the future development of a critical bypass graft stenosis using all the available peak systolic velocity data in the present and previous bypass graft DUS examinations. Integrating clinical data, including demographics, social determinants, medication, and other risk factors, together with the DUS examination may result in further improvements.</p></div><div><h3>Clinical Relevance</h3><p>Detecting bypass graft failure before it occurs is important clinically to prevent amputations, salvage limbs, and save lives. Current methods evaluating screening duplex ultrasound examinations have a significant failure rate for detecting a bypass graft at risk for failure. Artificial intelligence using recurrent neural networks has the potential to improve the detection of at-risk bypass graft before they fail. Additionally, artificial intelligence is in the news and is being applied to many fields. Vascular surgeons need to know its potential to improve vascular outcomes.</p></div>","PeriodicalId":74035,"journal":{"name":"JVS-vascular science","volume":"5 ","pages":"Article 100192"},"PeriodicalIF":0.0000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666350324000038/pdfft?md5=e64b464b16fd4434244d34e5952f1fb4&pid=1-s2.0-S2666350324000038-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JVS-vascular science","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666350324000038","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0
Abstract
Objective
Routine surveillance with duplex ultrasound (DUS) examination is recommended after femoral-popliteal and femoral-tibial-pedal vein bypass grafts with various intervals postoperatively. The presently used methodology to analyze bypass graft DUS examination does not use all the available data and has been shown to have a significant rate for missing impending bypass graft failure. The objective of this research is to investigate recurrent neural networks (RNNs) to predict future bypass graft occlusion or stenosis.
Methods
This study includes DUS examinations of 663 patients who had bypass graft operations done between January 2009 and June 2022. Only examinations without missing values were included. We developed two RNNs (a bidirectional long short-term memory unit and a bidirectional gated recurrent unit) to predict bypass graft occlusion and stenosis based on peak systolic velocities collected in the 2 to 5 previous DUS examinations. We excluded the examinations with missing values and split our data into training and test sets. Then, we applied 10-fold cross-validation on training to optimize the hyperparameters and compared models using the test data.
Results
The bidirectional long short-term memory unit model can gain an overall sensitivity of 0.939, specificity of 0.963, and area under the curve of 0.950 on the prediction of bypass graft occlusion, and an overall sensitivity of 0.915, specificity of 0.909, and area under the curve of 0.912 predicting the development of a future critical stenosis. The results on different bypass types show that the system performs differently on different types. The results on subcohorts based on gender, smoking status, and comorbidities show that the performance on current smokers is lower than the never smoker.
Conclusions
We found that RNNs can gain good sensitivity, specificity, and accuracy for the detection of impending bypass graft occlusion or the future development of a critical bypass graft stenosis using all the available peak systolic velocity data in the present and previous bypass graft DUS examinations. Integrating clinical data, including demographics, social determinants, medication, and other risk factors, together with the DUS examination may result in further improvements.
Clinical Relevance
Detecting bypass graft failure before it occurs is important clinically to prevent amputations, salvage limbs, and save lives. Current methods evaluating screening duplex ultrasound examinations have a significant failure rate for detecting a bypass graft at risk for failure. Artificial intelligence using recurrent neural networks has the potential to improve the detection of at-risk bypass graft before they fail. Additionally, artificial intelligence is in the news and is being applied to many fields. Vascular surgeons need to know its potential to improve vascular outcomes.