Louis A Perkins, Zongyang Mou, Jessica Masch, Brandon Harris, Amy E Liepert, Todd W Costantini, Laura N Haines, Allison Berndtson, Laura Adams, Jay J Doucet, Jarrett E Santorelli
{"title":"Automating excellence: A breakthrough in emergency general surgery quality benchmarking.","authors":"Louis A Perkins, Zongyang Mou, Jessica Masch, Brandon Harris, Amy E Liepert, Todd W Costantini, Laura N Haines, Allison Berndtson, Laura Adams, Jay J Doucet, Jarrett E Santorelli","doi":"10.1097/TA.0000000000004532","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Given the high mortality and morbidity of emergency general surgery (EGS), designing and implementing effective quality assessment tools is imperative. Currently accepted EGS risk scores are limited by the need for manual extraction, which is time-intensive and costly. We developed an automated institutional electronic health record (EHR)-linked EGS registry that calculates a modified Emergency Surgery Score (mESS) and a modified Predictive OpTimal Trees in Emergency Surgery Risk (POTTER) score and demonstrated their use in benchmarking outcomes.</p><p><strong>Methods: </strong>The EHR-linked EGS registry was queried for patients undergoing emergent laparotomies from 2018 to 2023. Data captured included demographics, admission and discharge data, diagnoses, procedures, vitals, and laboratories. The mESS and modified POTTER (mPOTTER) were calculated based off previously defined variables, with estimation of subjective variables using diagnosis codes and other abstracted treatment variables. This was validated against ESS and the POTTER risk calculators by chart review. Observed versus expected (O:E) 30-day mortality and complication ratios were generated.</p><p><strong>Results: </strong>The EGS registry captured 177 emergent laparotomies. There were 32 deaths (18%) and 79 complications (45%) within 30 days of surgery. For mortality, the mean difference between the mESS and ESS risk predictions for mortality was 3% (SD, 10%) with 86% of mESS predictions within 10% of ESS. The mean difference between the mPOTTER and POTTER was -2% (SD, 11%) with 76% of mPOTTER predictions within 10% of POTTER. Observed versus expected ratios by mESS and ESS were 1.45 and 1.86, respectively, and for mPOTTER and POTTER, they were 1.45 and 1.30, respectively. There was similarly good agreement between automated and manual risk scores in predicting complications.</p><p><strong>Conclusion: </strong>Our study highlights the effective implementation of an institutional EHR-linked EGS registry equipped to generate automated quality metrics. This demonstrates potential in enhancing the standardization and assessment of EGS care while mitigating the need for extensive human resources investment.</p><p><strong>Level of evidence: </strong>Prognostic and Epidemiologic Study; Level III.</p>","PeriodicalId":17453,"journal":{"name":"Journal of Trauma and Acute Care Surgery","volume":" ","pages":""},"PeriodicalIF":2.9000,"publicationDate":"2025-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Trauma and Acute Care Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/TA.0000000000004532","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CRITICAL CARE MEDICINE","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Given the high mortality and morbidity of emergency general surgery (EGS), designing and implementing effective quality assessment tools is imperative. Currently accepted EGS risk scores are limited by the need for manual extraction, which is time-intensive and costly. We developed an automated institutional electronic health record (EHR)-linked EGS registry that calculates a modified Emergency Surgery Score (mESS) and a modified Predictive OpTimal Trees in Emergency Surgery Risk (POTTER) score and demonstrated their use in benchmarking outcomes.
Methods: The EHR-linked EGS registry was queried for patients undergoing emergent laparotomies from 2018 to 2023. Data captured included demographics, admission and discharge data, diagnoses, procedures, vitals, and laboratories. The mESS and modified POTTER (mPOTTER) were calculated based off previously defined variables, with estimation of subjective variables using diagnosis codes and other abstracted treatment variables. This was validated against ESS and the POTTER risk calculators by chart review. Observed versus expected (O:E) 30-day mortality and complication ratios were generated.
Results: The EGS registry captured 177 emergent laparotomies. There were 32 deaths (18%) and 79 complications (45%) within 30 days of surgery. For mortality, the mean difference between the mESS and ESS risk predictions for mortality was 3% (SD, 10%) with 86% of mESS predictions within 10% of ESS. The mean difference between the mPOTTER and POTTER was -2% (SD, 11%) with 76% of mPOTTER predictions within 10% of POTTER. Observed versus expected ratios by mESS and ESS were 1.45 and 1.86, respectively, and for mPOTTER and POTTER, they were 1.45 and 1.30, respectively. There was similarly good agreement between automated and manual risk scores in predicting complications.
Conclusion: Our study highlights the effective implementation of an institutional EHR-linked EGS registry equipped to generate automated quality metrics. This demonstrates potential in enhancing the standardization and assessment of EGS care while mitigating the need for extensive human resources investment.
Level of evidence: Prognostic and Epidemiologic Study; Level III.
期刊介绍:
The Journal of Trauma and Acute Care Surgery® is designed to provide the scientific basis to optimize care of the severely injured and critically ill surgical patient. Thus, the Journal has a high priority for basic and translation research to fulfill this objectives. Additionally, the Journal is enthusiastic to publish randomized prospective clinical studies to establish care predicated on a mechanistic foundation. Finally, the Journal is seeking systematic reviews, guidelines and algorithms that incorporate the best evidence available.