{"title":"External Validation of the fullPIERS Risk Prediction Model in a U.S. Cohort of Individuals with Preeclampsia.","authors":"Danielle Long, Kari Flicker, Maya Vishnia, Madeleine Wright, Matilda Francis, Kenyone S King, Lauren Gilgannon, Aref Rastegar, Neha Gupta, Rohini Kousalya Siva, Lea Nehme, Tetsuya Kawakita","doi":"10.1055/a-2452-8220","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong> This study aimed to externally validate the Preeclampsia Integrated Estimate of Risk (fullPIERS) risk prediction model in a cohort of pregnant individuals with preeclampsia in the United States.</p><p><strong>Study design: </strong> This was a retrospective study of individuals with preeclampsia who delivered at 22 weeks or greater from January 1, 2010, to December 31, 2020. The primary outcome was a composite of maternal mortality or other serious complications of preeclampsia occurring within 48 hours of admission. We calculated the probability of the composite outcome using the fullPIERS prediction model based on data available within 12 hours of admission, including gestational age, chest pain or dyspnea, serum creatinine levels, platelet count, aspartate transaminase levels, and oxygen saturation. We assessed the model performance using the area under the curve (AUC) of the receiver operating characteristic curve. The optimal cutoff point was determined using Liu's method. A calibration plot was used to evaluate the model's goodness-of-fit.</p><p><strong>Results: </strong> Among 1,510 individuals with preeclampsia, 82 (5.4%) experienced the composite outcome within 48 hours. The fullPIERS model achieved an AUC of 0.80 (95% confidence interval [CI]: 0.75-0.86). The predicted probability for individuals with the composite outcome (median: 18.8%; interquartile range: 2.9-59.1) was significantly higher than those without the outcome (median: 0.9%; interquartile range: 0.4-2.7). The optimal cutoff point of 5.5% yielded a sensitivity of 70.7% (95% CI: 59.6-80.3), a specificity of 85% (95% CI: 82.7-86.5), a positive likelihood ratio of 4.6 (95% CI: 3.8-5.5), and an odds ratio of 13.3 (95% CI: 8.1-21.8). The calibration plot indicated that the model underestimated risk when the predicted probability was below 1% and overestimated risk when the predicted probability exceeded 5%.</p><p><strong>Conclusion: </strong> The fullPIERS model demonstrated good discrimination in this U.S. cohort of individuals with preeclampsia, suggesting it may be a useful tool for health care providers to identify individuals at risk for severe complications.</p><p><strong>Key points: </strong>· The fullPIERS risk prediction model has not been validated in a U.S.</p><p><strong>Cohort: </strong>. · The model showed good predictive accuracy (AUC: 0.80) for severe maternal complications but had calibration issues at extreme-risk levels.. · This study confirms the fullPIERS model's applicability in the United States..</p>","PeriodicalId":7584,"journal":{"name":"American journal of perinatology","volume":" ","pages":""},"PeriodicalIF":1.5000,"publicationDate":"2024-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"American journal of perinatology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1055/a-2452-8220","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"OBSTETRICS & GYNECOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: This study aimed to externally validate the Preeclampsia Integrated Estimate of Risk (fullPIERS) risk prediction model in a cohort of pregnant individuals with preeclampsia in the United States.
Study design: This was a retrospective study of individuals with preeclampsia who delivered at 22 weeks or greater from January 1, 2010, to December 31, 2020. The primary outcome was a composite of maternal mortality or other serious complications of preeclampsia occurring within 48 hours of admission. We calculated the probability of the composite outcome using the fullPIERS prediction model based on data available within 12 hours of admission, including gestational age, chest pain or dyspnea, serum creatinine levels, platelet count, aspartate transaminase levels, and oxygen saturation. We assessed the model performance using the area under the curve (AUC) of the receiver operating characteristic curve. The optimal cutoff point was determined using Liu's method. A calibration plot was used to evaluate the model's goodness-of-fit.
Results: Among 1,510 individuals with preeclampsia, 82 (5.4%) experienced the composite outcome within 48 hours. The fullPIERS model achieved an AUC of 0.80 (95% confidence interval [CI]: 0.75-0.86). The predicted probability for individuals with the composite outcome (median: 18.8%; interquartile range: 2.9-59.1) was significantly higher than those without the outcome (median: 0.9%; interquartile range: 0.4-2.7). The optimal cutoff point of 5.5% yielded a sensitivity of 70.7% (95% CI: 59.6-80.3), a specificity of 85% (95% CI: 82.7-86.5), a positive likelihood ratio of 4.6 (95% CI: 3.8-5.5), and an odds ratio of 13.3 (95% CI: 8.1-21.8). The calibration plot indicated that the model underestimated risk when the predicted probability was below 1% and overestimated risk when the predicted probability exceeded 5%.
Conclusion: The fullPIERS model demonstrated good discrimination in this U.S. cohort of individuals with preeclampsia, suggesting it may be a useful tool for health care providers to identify individuals at risk for severe complications.
Key points: · The fullPIERS risk prediction model has not been validated in a U.S.
Cohort: . · The model showed good predictive accuracy (AUC: 0.80) for severe maternal complications but had calibration issues at extreme-risk levels.. · This study confirms the fullPIERS model's applicability in the United States..
期刊介绍:
The American Journal of Perinatology is an international, peer-reviewed, and indexed journal publishing 14 issues a year dealing with original research and topical reviews. It is the definitive forum for specialists in obstetrics, neonatology, perinatology, and maternal/fetal medicine, with emphasis on bridging the different fields.
The focus is primarily on clinical and translational research, clinical and technical advances in diagnosis, monitoring, and treatment as well as evidence-based reviews. Topics of interest include epidemiology, diagnosis, prevention, and management of maternal, fetal, and neonatal diseases. Manuscripts on new technology, NICU set-ups, and nursing topics are published to provide a broad survey of important issues in this field.
All articles undergo rigorous peer review, with web-based submission, expedited turn-around, and availability of electronic publication.
The American Journal of Perinatology is accompanied by AJP Reports - an Open Access journal for case reports in neonatology and maternal/fetal medicine.