Sebastián Quintero Montealegre, Andrés Felipe Flórez Monroy, Javier Ricardo Garzón Herazo, Wilfran Perez Mendez, Natalia María Piraquive, Gloria Cortes Fraile, Oscar Mauricio Muñoz Velandia
{"title":"External validation of ID-BactER and Shapiro scores for predicting bacteraemia in the emergency department.","authors":"Sebastián Quintero Montealegre, Andrés Felipe Flórez Monroy, Javier Ricardo Garzón Herazo, Wilfran Perez Mendez, Natalia María Piraquive, Gloria Cortes Fraile, Oscar Mauricio Muñoz Velandia","doi":"10.1177/20499361241304508","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>The blood culture positivity rate in the emergency department (ED) is <20%; however, the mortality associated with Community-acquired bacteraemia (CAB) is as high as 37.8%. For this reason, several models have been developed to predict blood culture positivity for the diagnosis of CAB.</p><p><strong>Objective: </strong>To validate two bacteraemia prediction models in a high-complexity hospital in Colombia.</p><p><strong>Design: </strong>External validation study of the ID-BactER and Shapiro scores based on a consecutive cohort of patients who underwent blood culture within 48 h of ED admission.</p><p><strong>Methods: </strong>Scale calibration was assessed by comparing expected and observed events (calibration belt). Discriminatory ability was assessed by area under the ROC curve (AUC-ROC).</p><p><strong>Results: </strong>We included 1347 patients, of whom 18.85% were diagnosed with CAB. The most common focus of infection was the respiratory tract (36.23%), and the most common microorganism was <i>Escherichia coli</i> (52.15%). The Shapiro score underestimated the risk in all categories and its discriminatory ability was poor (AUC 0.68 CI 95% 0.64-0.73). In contrast, the ID-BactER score showed an adequate observed/expected event ratio of 1.07 (CI 0.85-1.36; <i>p</i> = 0.018) and adequate calibration when expected events were greater than 20%, in addition to good discriminatory ability (AUC 0.74 95% CI 0.70-0.78).</p><p><strong>Conclusion: </strong>The Shapiro score is not calibrated, and its discriminatory ability is poor. ID-BactER has an adequate calibration when the expected events are higher than 20%. Limiting blood culture collection to patients with an ID-BactER score ⩾4 could reduce unnecessary blood culture collection and thus health care costs.</p>","PeriodicalId":46154,"journal":{"name":"Therapeutic Advances in Infectious Disease","volume":"11 ","pages":"20499361241304508"},"PeriodicalIF":3.8000,"publicationDate":"2024-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11624545/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Therapeutic Advances in Infectious Disease","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/20499361241304508","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"INFECTIOUS DISEASES","Score":null,"Total":0}
引用次数: 0
Abstract
Introduction: The blood culture positivity rate in the emergency department (ED) is <20%; however, the mortality associated with Community-acquired bacteraemia (CAB) is as high as 37.8%. For this reason, several models have been developed to predict blood culture positivity for the diagnosis of CAB.
Objective: To validate two bacteraemia prediction models in a high-complexity hospital in Colombia.
Design: External validation study of the ID-BactER and Shapiro scores based on a consecutive cohort of patients who underwent blood culture within 48 h of ED admission.
Methods: Scale calibration was assessed by comparing expected and observed events (calibration belt). Discriminatory ability was assessed by area under the ROC curve (AUC-ROC).
Results: We included 1347 patients, of whom 18.85% were diagnosed with CAB. The most common focus of infection was the respiratory tract (36.23%), and the most common microorganism was Escherichia coli (52.15%). The Shapiro score underestimated the risk in all categories and its discriminatory ability was poor (AUC 0.68 CI 95% 0.64-0.73). In contrast, the ID-BactER score showed an adequate observed/expected event ratio of 1.07 (CI 0.85-1.36; p = 0.018) and adequate calibration when expected events were greater than 20%, in addition to good discriminatory ability (AUC 0.74 95% CI 0.70-0.78).
Conclusion: The Shapiro score is not calibrated, and its discriminatory ability is poor. ID-BactER has an adequate calibration when the expected events are higher than 20%. Limiting blood culture collection to patients with an ID-BactER score ⩾4 could reduce unnecessary blood culture collection and thus health care costs.