Marie-Louise Meng, Yuqi Li, Matthew Fuller, Quinn Lanners, Ashraf S Habib, Jerome J Federspiel, Johanna Quist-Nelson, Svati H Shah, Michael Pencina, Kim Boggess, Vijay Krishnamoorthy, Matthew Engelhard
{"title":"Development and Validation of a Predictive Model for Maternal Cardiovascular Morbidity Events in Patients With Hypertensive Disorders of Pregnancy.","authors":"Marie-Louise Meng, Yuqi Li, Matthew Fuller, Quinn Lanners, Ashraf S Habib, Jerome J Federspiel, Johanna Quist-Nelson, Svati H Shah, Michael Pencina, Kim Boggess, Vijay Krishnamoorthy, Matthew Engelhard","doi":"10.1213/ANE.0000000000007278","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Hypertensive disorders of pregnancy (HDP) are a major contributor to maternal morbidity, mortality, and accelerated cardiovascular (CV) disease. Comorbid conditions are likely important predictors of CV risk in pregnant people. Currently, there is no way to predict which people with HDP are at risk of acute CV complications. We developed and validated a predictive model for all CV events and for heart failure, renal failure, and cerebrovascular events specifically after HDP.</p><p><strong>Methods: </strong>Models were created using the Premier Healthcare Database. The inclusion criteria for the model dataset were delivery with an HDP with discharge from October 1, 2015 to December 31, 2020. Machine learning methods were used to derive predictive models of CV events occurring during delivery hospitalization (Index Model) or during readmission (Readmission Model) using a training set (60%) to estimate model parameters, a validation set (20%) to tune model hyperparameters and select a final model, and a test set (20%) to evaluate final model performance.</p><p><strong>Results: </strong>The total model cohort consisted of 553,658 deliveries with an HDP. A CV event occurred in 6501 (1.2%) of the delivery hospitalizations. Multilabel neural networks were selected for the Index Model and Readmission Model due to favorable performance compared to alternatives. This approach is designed for prediction of multiple events that share risk factors and may cooccur. The Index Model predicted all CV events with area under the receiver operating curve (AUROC) 0.878 and average precision (AP) 0.239 (cerebrovascular events: AUROC 0.941, heart failure: AUROC 0.898, and renal failure: AUROC 0.885). With a positivity threshold set to achieve ≥90% sensitivity, model specificity was 65.0%, 83.5%, 68.6%, and 65.6% for predicting all CV events, cerebrovascular events, heart failure, and renal failure, respectively. CV events within 1 year of delivery occurred in 3018 (0.6%) individuals. The Readmission Model predicted all CV events with AUROC 0.717 and AP 0.022 (renal failure: AUROC 0.748, heart failure: AUROC 0.734, and cerebrovascular events AUROC 0.698). Feature importance analysis indicated that the presence of chronic renal disease, cardiac disease, pulmonary hypertension, and preeclampsia with severe features had the greatest effect on the prediction of CV events.</p><p><strong>Conclusions: </strong>Among individuals with HDP, our multilabel neural network model predicted CV events at delivery admission with good classification and events within 1 year of delivery with fair classification.</p>","PeriodicalId":7784,"journal":{"name":"Anesthesia and analgesia","volume":" ","pages":""},"PeriodicalIF":4.6000,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Anesthesia and analgesia","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1213/ANE.0000000000007278","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ANESTHESIOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Hypertensive disorders of pregnancy (HDP) are a major contributor to maternal morbidity, mortality, and accelerated cardiovascular (CV) disease. Comorbid conditions are likely important predictors of CV risk in pregnant people. Currently, there is no way to predict which people with HDP are at risk of acute CV complications. We developed and validated a predictive model for all CV events and for heart failure, renal failure, and cerebrovascular events specifically after HDP.
Methods: Models were created using the Premier Healthcare Database. The inclusion criteria for the model dataset were delivery with an HDP with discharge from October 1, 2015 to December 31, 2020. Machine learning methods were used to derive predictive models of CV events occurring during delivery hospitalization (Index Model) or during readmission (Readmission Model) using a training set (60%) to estimate model parameters, a validation set (20%) to tune model hyperparameters and select a final model, and a test set (20%) to evaluate final model performance.
Results: The total model cohort consisted of 553,658 deliveries with an HDP. A CV event occurred in 6501 (1.2%) of the delivery hospitalizations. Multilabel neural networks were selected for the Index Model and Readmission Model due to favorable performance compared to alternatives. This approach is designed for prediction of multiple events that share risk factors and may cooccur. The Index Model predicted all CV events with area under the receiver operating curve (AUROC) 0.878 and average precision (AP) 0.239 (cerebrovascular events: AUROC 0.941, heart failure: AUROC 0.898, and renal failure: AUROC 0.885). With a positivity threshold set to achieve ≥90% sensitivity, model specificity was 65.0%, 83.5%, 68.6%, and 65.6% for predicting all CV events, cerebrovascular events, heart failure, and renal failure, respectively. CV events within 1 year of delivery occurred in 3018 (0.6%) individuals. The Readmission Model predicted all CV events with AUROC 0.717 and AP 0.022 (renal failure: AUROC 0.748, heart failure: AUROC 0.734, and cerebrovascular events AUROC 0.698). Feature importance analysis indicated that the presence of chronic renal disease, cardiac disease, pulmonary hypertension, and preeclampsia with severe features had the greatest effect on the prediction of CV events.
Conclusions: Among individuals with HDP, our multilabel neural network model predicted CV events at delivery admission with good classification and events within 1 year of delivery with fair classification.
期刊介绍:
Anesthesia & Analgesia exists for the benefit of patients under the care of health care professionals engaged in the disciplines broadly related to anesthesiology, perioperative medicine, critical care medicine, and pain medicine. The Journal furthers the care of these patients by reporting the fundamental advances in the science of these clinical disciplines and by documenting the clinical, laboratory, and administrative advances that guide therapy. Anesthesia & Analgesia seeks a balance between definitive clinical and management investigations and outstanding basic scientific reports. The Journal welcomes original manuscripts containing rigorous design and analysis, even if unusual in their approach.