Jeff Choi, Joshua A Villarreal, Rachel Handelsman, Jacob Kirkorowciz, Ariel Knight, Arathi Kumar, Emily McNabb, Jon Perlstein, Ronald B Tesoriero, Elaina Y Tsui, Cheri White, Joseph D Forrester
{"title":"Prospective multicenter external validation of the rib fracture frailty index.","authors":"Jeff Choi, Joshua A Villarreal, Rachel Handelsman, Jacob Kirkorowciz, Ariel Knight, Arathi Kumar, Emily McNabb, Jon Perlstein, Ronald B Tesoriero, Elaina Y Tsui, Cheri White, Joseph D Forrester","doi":"10.1097/TA.0000000000004624","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The Rib Fracture Frailty (RFF) Index is an internally validated machine learning-based risk assessment tool for adult patients with rib fractures that requires minimal provider entry. Existing frailty risk scores have yet to undergo head-to-head performance comparison with age, a widely used proxy for frailty in clinical practice. Our aim was to externally validate the RFF Index in a small-scale implementation feasibility study.</p><p><strong>Methods: </strong>Prospective observational cohort study conducted across five ACS COT-verified trauma centers. Participants included ≥18-year-old adults presenting January 1, 2021, to December 31, 2021, with traumatic rib fractures. The primary outcome was a composite outcome score comprised of three clinical factors: hospitalization ≥5 days, discharge disposition, and inpatient mortality. Proportional odds logistic regression evaluated associations of age model or RFF Index score model with composite outcome scores. Models were compared using standard discrimination and calibration metrics. Secondary analysis delineated predictive performance among patients with lower (Injury Severity Score < 15) and higher Injury Severity Score ≥ 15) injury burden.</p><p><strong>Results: </strong>Of 849 participants, 546 (64%) were male and median age was 62 years (interquartile range, 46-76 years). A one-point increase in RFF score was associated with 6% increased odds of higher composite outcome score (odds ratio [OR], 1.06; 95% confidence interval [95% CI], 1.04-1.08), while a 1-year increase in age did not show statistically significant association (OR, 1.10; 95% CI, 0.75-1.61). The RFF score had higher discrimination (OR, 0.09; 95% CI, 0.08-0.11 vs. OR, 0.06; 95% CI, 0.04-0.08; p = 0.04) and calibration performance compared with age, but on secondary analysis, higher predictive performance was limited to patients with lower injury burden. Both RFF Index and age had poor calibration for predicting patients discharged to home after hospitalization ≥5 days.</p><p><strong>Conclusion: </strong>This prospective external validation study found RFF Index may be a better alternative to age for predicting adverse outcomes among patients with traumatic rib fractures and lower overall injury burden. Staged implementation studies in accordance with clinical prediction model implementation guidelines are required to evaluate the RFF Index's clinical efficacy and guide potential adoption.</p><p><strong>Level of evidence: </strong>Prognostic and Epidemiological; Level II.</p>","PeriodicalId":17453,"journal":{"name":"Journal of Trauma and Acute Care Surgery","volume":" ","pages":"204-211"},"PeriodicalIF":3.7000,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Trauma and Acute Care Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/TA.0000000000004624","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/4/14 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"CRITICAL CARE MEDICINE","Score":null,"Total":0}
引用次数: 0
Abstract
Background: The Rib Fracture Frailty (RFF) Index is an internally validated machine learning-based risk assessment tool for adult patients with rib fractures that requires minimal provider entry. Existing frailty risk scores have yet to undergo head-to-head performance comparison with age, a widely used proxy for frailty in clinical practice. Our aim was to externally validate the RFF Index in a small-scale implementation feasibility study.
Methods: Prospective observational cohort study conducted across five ACS COT-verified trauma centers. Participants included ≥18-year-old adults presenting January 1, 2021, to December 31, 2021, with traumatic rib fractures. The primary outcome was a composite outcome score comprised of three clinical factors: hospitalization ≥5 days, discharge disposition, and inpatient mortality. Proportional odds logistic regression evaluated associations of age model or RFF Index score model with composite outcome scores. Models were compared using standard discrimination and calibration metrics. Secondary analysis delineated predictive performance among patients with lower (Injury Severity Score < 15) and higher Injury Severity Score ≥ 15) injury burden.
Results: Of 849 participants, 546 (64%) were male and median age was 62 years (interquartile range, 46-76 years). A one-point increase in RFF score was associated with 6% increased odds of higher composite outcome score (odds ratio [OR], 1.06; 95% confidence interval [95% CI], 1.04-1.08), while a 1-year increase in age did not show statistically significant association (OR, 1.10; 95% CI, 0.75-1.61). The RFF score had higher discrimination (OR, 0.09; 95% CI, 0.08-0.11 vs. OR, 0.06; 95% CI, 0.04-0.08; p = 0.04) and calibration performance compared with age, but on secondary analysis, higher predictive performance was limited to patients with lower injury burden. Both RFF Index and age had poor calibration for predicting patients discharged to home after hospitalization ≥5 days.
Conclusion: This prospective external validation study found RFF Index may be a better alternative to age for predicting adverse outcomes among patients with traumatic rib fractures and lower overall injury burden. Staged implementation studies in accordance with clinical prediction model implementation guidelines are required to evaluate the RFF Index's clinical efficacy and guide potential adoption.
Level of evidence: Prognostic and Epidemiological; Level II.
期刊介绍:
The Journal of Trauma and Acute Care Surgery® is designed to provide the scientific basis to optimize care of the severely injured and critically ill surgical patient. Thus, the Journal has a high priority for basic and translation research to fulfill this objectives. Additionally, the Journal is enthusiastic to publish randomized prospective clinical studies to establish care predicated on a mechanistic foundation. Finally, the Journal is seeking systematic reviews, guidelines and algorithms that incorporate the best evidence available.