Diagnostic Identification of Acute Brain Dysfunction in Pediatric Sepsis and Septic Shock in the Electronic Health Record: A Comparison of Four Definitions in a Reference Dataset.
Alicia M Alcamo, Andrew E Becker, Gregory J Barren, Katie Hayes, Jeffrey W Pennington, Martha A Q Curley, Robert C Tasker, Fran Balamuth, Scott L Weiss, Julie C Fitzgerald, Alexis A Topjian
{"title":"Diagnostic Identification of Acute Brain Dysfunction in Pediatric Sepsis and Septic Shock in the Electronic Health Record: A Comparison of Four Definitions in a Reference Dataset.","authors":"Alicia M Alcamo, Andrew E Becker, Gregory J Barren, Katie Hayes, Jeffrey W Pennington, Martha A Q Curley, Robert C Tasker, Fran Balamuth, Scott L Weiss, Julie C Fitzgerald, Alexis A Topjian","doi":"10.1097/PCC.0000000000003529","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>Acute brain dysfunction (ABD) in pediatric sepsis has a prevalence of 20%, but can be difficult to identify. Our previously validated ABD computational phenotype (CP ABD ) used variables obtained from the electronic health record indicative of clinician concern for acute neurologic or behavioral change. We tested whether the CP ABD has better diagnostic performance to identify confirmed ABD than other definitions using the Glasgow Coma Scale or delirium scores.</p><p><strong>Design: </strong>Diagnostic testing in a curated cohort of pediatric sepsis/septic shock patients.</p><p><strong>Setting: </strong>Quaternary freestanding children's hospital.</p><p><strong>Subjects: </strong>The test dataset comprised 527 children with sepsis/septic shock managed between 2011 and 2021 with a prevalence (pretest probability) of confirmed ABD of 30% (159/527).</p><p><strong>Measurements and main results: </strong>CP ABD was based on use of neuroimaging, electroencephalogram, and/or administration of new antipsychotic medication. We compared the performance of the CP ABD with three GCS/delirium-based definitions of ABD-Proulx et al, International Pediatric Sepsis Consensus Conference, and Pediatric Organ Dysfunction Information Update Mandate. The posttest probability of identifying ABD was highest in CP ABD (0.84) compared with other definitions. CP ABD also had the highest sensitivity (83%; 95% CI, 76-89%) and specificity (93%; 95% CI, 90-96%). The false discovery rate was lowest in CP ABD (1-in-6) as was the false omission rate (1-in-14). Finally, the prevalence threshold for the definitions varied, with the CP ABD being the definition closest to 20%.</p><p><strong>Conclusions: </strong>In our curated dataset of pediatric sepsis/septic shock, CP ABD had favorable characteristics to identify confirmed ABD compared with GCS/delirium-based definitions. The CP ABD can be used to further study the impact of ABD in studies using large electronic health datasets.</p>","PeriodicalId":19760,"journal":{"name":"Pediatric Critical Care Medicine","volume":" ","pages":"740-747"},"PeriodicalIF":4.0000,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11300159/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pediatric Critical Care Medicine","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/PCC.0000000000003529","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/5/13 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"CRITICAL CARE MEDICINE","Score":null,"Total":0}
引用次数: 0
Abstract
Objectives: Acute brain dysfunction (ABD) in pediatric sepsis has a prevalence of 20%, but can be difficult to identify. Our previously validated ABD computational phenotype (CP ABD ) used variables obtained from the electronic health record indicative of clinician concern for acute neurologic or behavioral change. We tested whether the CP ABD has better diagnostic performance to identify confirmed ABD than other definitions using the Glasgow Coma Scale or delirium scores.
Design: Diagnostic testing in a curated cohort of pediatric sepsis/septic shock patients.
Subjects: The test dataset comprised 527 children with sepsis/septic shock managed between 2011 and 2021 with a prevalence (pretest probability) of confirmed ABD of 30% (159/527).
Measurements and main results: CP ABD was based on use of neuroimaging, electroencephalogram, and/or administration of new antipsychotic medication. We compared the performance of the CP ABD with three GCS/delirium-based definitions of ABD-Proulx et al, International Pediatric Sepsis Consensus Conference, and Pediatric Organ Dysfunction Information Update Mandate. The posttest probability of identifying ABD was highest in CP ABD (0.84) compared with other definitions. CP ABD also had the highest sensitivity (83%; 95% CI, 76-89%) and specificity (93%; 95% CI, 90-96%). The false discovery rate was lowest in CP ABD (1-in-6) as was the false omission rate (1-in-14). Finally, the prevalence threshold for the definitions varied, with the CP ABD being the definition closest to 20%.
Conclusions: In our curated dataset of pediatric sepsis/septic shock, CP ABD had favorable characteristics to identify confirmed ABD compared with GCS/delirium-based definitions. The CP ABD can be used to further study the impact of ABD in studies using large electronic health datasets.
期刊介绍:
Pediatric Critical Care Medicine is written for the entire critical care team: pediatricians, neonatologists, respiratory therapists, nurses, and others who deal with pediatric patients who are critically ill or injured. International in scope, with editorial board members and contributors from around the world, the Journal includes a full range of scientific content, including clinical articles, scientific investigations, solicited reviews, and abstracts from pediatric critical care meetings. Additionally, the Journal includes abstracts of selected articles published in Chinese, French, Italian, Japanese, Portuguese, and Spanish translations - making news of advances in the field available to pediatric and neonatal intensive care practitioners worldwide.