Andrew S Warren, Jake F Hemingway, Elina Quiroga, Thomas F X O'Donnell, Marc L Schermerhorn, Sara L Zettervall, Kirsten Dansey
{"title":"Comparative Assessment of Risk Score Performance in Ruptured Abdominal Aortic Aneurysm Repair Risk Stratification.","authors":"Andrew S Warren, Jake F Hemingway, Elina Quiroga, Thomas F X O'Donnell, Marc L Schermerhorn, Sara L Zettervall, Kirsten Dansey","doi":"10.1016/j.ejvs.2025.04.002","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>Several risk scores are available to stratify mortality risk for ruptured abdominal aortic aneurysm (rAAA) repair. This study compared the performance of seven risk scores found in the literature using the National Surgical Quality Improvement Program (NSQIP) and Vascular Quality Initiative (VQI) registries.</p><p><strong>Methods: </strong>All patients who underwent open or endovascular rAAA repair in NSQIP (2011 - 2018) and VQI (2003 - 2021) were included. The following risk scores were calculated: Dutch Aneurysm Score (DAS); Glasgow Aneurysm Score (GAS); modified Harborview Risk Score (mHRS); Hardman index (HI); Leiden score; Medicare risk score; and Vascular Surgery Group of New England (VSGNE) risk score. Discrimination was assessed for all patients (combined open and endovascular) using receiver operating characteristic (ROC) curves, with area under the curve (AUC) values compared within datasets using the DeLong test. Calibration was evaluated using graphical calibration curves and was quantified via the integrated calibration index (ICI).</p><p><strong>Results: </strong>A total of 2 134 NSQIP patients and 6 458 VQI patients were included. In NSQIP, the GAS had the highest discrimination ability (AUC 0.687; p < .010 vs. all); while in VQI, the DAS performed best (AUC 0.688; p < .050 vs. all). The Medicare risk score exhibited the best calibration with an ICI of 0.007 in NSQIP and 0.003 in VQI. The DAS tended to underestimate risk, while all other scores overestimated mortality.</p><p><strong>Conclusion: </strong>Risk scores serve as valuable tools to augment, but not replace, clinical decision making in patients with rAAA. The GAS and DAS demonstrated superior discrimination, rendering them best for distinguishing between low and high risk patients. Meanwhile, the Medicare risk score offers the most accurate risk prediction. The mHRS and HI offered a balance of adequate discrimination and calibration while remaining simple and easily calculable, making them practical for urgent clinical settings.</p>","PeriodicalId":55160,"journal":{"name":"European Journal of Vascular and Endovascular Surgery","volume":" ","pages":""},"PeriodicalIF":5.7000,"publicationDate":"2025-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"European Journal of Vascular and Endovascular Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.ejvs.2025.04.002","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PERIPHERAL VASCULAR DISEASE","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: Several risk scores are available to stratify mortality risk for ruptured abdominal aortic aneurysm (rAAA) repair. This study compared the performance of seven risk scores found in the literature using the National Surgical Quality Improvement Program (NSQIP) and Vascular Quality Initiative (VQI) registries.
Methods: All patients who underwent open or endovascular rAAA repair in NSQIP (2011 - 2018) and VQI (2003 - 2021) were included. The following risk scores were calculated: Dutch Aneurysm Score (DAS); Glasgow Aneurysm Score (GAS); modified Harborview Risk Score (mHRS); Hardman index (HI); Leiden score; Medicare risk score; and Vascular Surgery Group of New England (VSGNE) risk score. Discrimination was assessed for all patients (combined open and endovascular) using receiver operating characteristic (ROC) curves, with area under the curve (AUC) values compared within datasets using the DeLong test. Calibration was evaluated using graphical calibration curves and was quantified via the integrated calibration index (ICI).
Results: A total of 2 134 NSQIP patients and 6 458 VQI patients were included. In NSQIP, the GAS had the highest discrimination ability (AUC 0.687; p < .010 vs. all); while in VQI, the DAS performed best (AUC 0.688; p < .050 vs. all). The Medicare risk score exhibited the best calibration with an ICI of 0.007 in NSQIP and 0.003 in VQI. The DAS tended to underestimate risk, while all other scores overestimated mortality.
Conclusion: Risk scores serve as valuable tools to augment, but not replace, clinical decision making in patients with rAAA. The GAS and DAS demonstrated superior discrimination, rendering them best for distinguishing between low and high risk patients. Meanwhile, the Medicare risk score offers the most accurate risk prediction. The mHRS and HI offered a balance of adequate discrimination and calibration while remaining simple and easily calculable, making them practical for urgent clinical settings.
期刊介绍:
The European Journal of Vascular and Endovascular Surgery is aimed primarily at vascular surgeons dealing with patients with arterial, venous and lymphatic diseases. Contributions are included on the diagnosis, investigation and management of these vascular disorders. Papers that consider the technical aspects of vascular surgery are encouraged, and the journal includes invited state-of-the-art articles.
Reflecting the increasing importance of endovascular techniques in the management of vascular diseases and the value of closer collaboration between the vascular surgeon and the vascular radiologist, the journal has now extended its scope to encompass the growing number of contributions from this exciting field. Articles describing endovascular method and their critical evaluation are included, as well as reports on the emerging technology associated with this field.