Benjamin R. Griffin , Avinash Mudireddy , Benjamin D. Horne , Michel Chonchol , Stuart L. Goldstein , Michihiko Goto , Michael E. Matheny , W. Nick Street , Mary Vaughan-Sarrazin , Diana I. Jalal , Jason Misurac
{"title":"Predicting Nephrotoxic Acute Kidney Injury in Hospitalized Adults: A Machine Learning Algorithm","authors":"Benjamin R. Griffin , Avinash Mudireddy , Benjamin D. Horne , Michel Chonchol , Stuart L. Goldstein , Michihiko Goto , Michael E. Matheny , W. Nick Street , Mary Vaughan-Sarrazin , Diana I. Jalal , Jason Misurac","doi":"10.1016/j.xkme.2024.100918","DOIUrl":null,"url":null,"abstract":"<div><h3>Rationale and Objective</h3><div>Acute kidney injury (AKI) is a common complication among hospitalized adults, but AKI prediction and prevention among adults has proved challenging. We used machine learning to update the nephrotoxic injury negated by just-in time action (NINJA), a pediatric program that predicts nephrotoxic AKI, to improve accuracy among adults.</div></div><div><h3>Study Design</h3><div>A retrospective cohort study.</div></div><div><h3>Setting and Population</h3><div>Adults admitted for<!--> <!-->><!--> <!-->48 hours to the University of Iowa Hospital from 2017 to 2022.</div></div><div><h3>Exposure</h3><div>A NINJA high-nephrotoxin exposure (≥3 nephrotoxins on 1<!--> <!-->day or intravenous aminoglycoside or vancomycin for<!--> <!-->≥3 days).</div></div><div><h3>Outcomes</h3><div>AKI within 48 hours of high-nephrotoxin exposure.</div></div><div><h3>Analytical Approach</h3><div>We collected 85 variables, including demographics, laboratory tests, vital signs, and medications. AKI was defined as a serum creatinine increase of<!--> <!-->≥0.3<!--> <!-->mg/dL. A gated recurrent unit (GRU)-based recurrent neural network (RNN) was trained on 85% of the data, and then tested on the remaining 15%. Model performance was evaluated with precision, recall, negative predictive value, and area under the curve. We used an artificial neural network to determine risk factor importance.</div></div><div><h3>Results</h3><div>There were 14,480 patients, 18,180 admissions, and 37,300 high-nephrotoxin exposure events meeting inclusion criteria. In the testing cohort, 29% of exposures developed AKI within 48 hours. The RNN-GRU model predicted AKI with a precision of 0.60, reducing the number of false alerts from 2.5 to 0.7 per AKI case. Lowest hemoglobin, lowest blood pressure, and highest white blood cell count were the most important variables in the artificial neural network model. Acyclovir, piperacillin-tazobactam, calcineurin inhibitors, and angiotensin-converting enzyme inhibitor/angiotensin receptor blockers were the most important medications.</div></div><div><h3>Limitations</h3><div>Clinical variables and medications were not exhaustive, drug levels or dosing were not incorporated, and Iowa’s racial makeup may limit generalizability.</div></div><div><h3>Conclusions</h3><div>Our RNN-GRU model substantially reduced the number of false alerts for nephrotoxic AKI, which may facilitate NINJA translation to adult hospitals by providing more targeted intervention.</div></div><div><h3>Plain-Language Summary</h3><div>Nephrotoxic acute kidney injury (AKI) is common and can potentially be prevented through preemptive adjustments of medications, as demonstrated by the success of the nephrotoxic injury negated by just-in time action (NINJA) program in pediatric populations. Translation of NINJA to the adult population has been challenging, and major barriers include high alert volume in adults that can lead to high resource utilization and alert fatigue. To address this issue, we developed a machine learning model for nephrotoxic AKI in adults that reduced the number of false alerts per AKI event from 2.5 to 0.7, which can enhance future NINJA implementation in adults by allowing for a more targeted intervention with fewer alerts and more efficient resource utilization.</div></div>","PeriodicalId":17885,"journal":{"name":"Kidney Medicine","volume":"6 12","pages":"Article 100918"},"PeriodicalIF":3.2000,"publicationDate":"2024-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Kidney Medicine","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2590059524001298","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"UROLOGY & NEPHROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Rationale and Objective
Acute kidney injury (AKI) is a common complication among hospitalized adults, but AKI prediction and prevention among adults has proved challenging. We used machine learning to update the nephrotoxic injury negated by just-in time action (NINJA), a pediatric program that predicts nephrotoxic AKI, to improve accuracy among adults.
Study Design
A retrospective cohort study.
Setting and Population
Adults admitted for > 48 hours to the University of Iowa Hospital from 2017 to 2022.
Exposure
A NINJA high-nephrotoxin exposure (≥3 nephrotoxins on 1 day or intravenous aminoglycoside or vancomycin for ≥3 days).
Outcomes
AKI within 48 hours of high-nephrotoxin exposure.
Analytical Approach
We collected 85 variables, including demographics, laboratory tests, vital signs, and medications. AKI was defined as a serum creatinine increase of ≥0.3 mg/dL. A gated recurrent unit (GRU)-based recurrent neural network (RNN) was trained on 85% of the data, and then tested on the remaining 15%. Model performance was evaluated with precision, recall, negative predictive value, and area under the curve. We used an artificial neural network to determine risk factor importance.
Results
There were 14,480 patients, 18,180 admissions, and 37,300 high-nephrotoxin exposure events meeting inclusion criteria. In the testing cohort, 29% of exposures developed AKI within 48 hours. The RNN-GRU model predicted AKI with a precision of 0.60, reducing the number of false alerts from 2.5 to 0.7 per AKI case. Lowest hemoglobin, lowest blood pressure, and highest white blood cell count were the most important variables in the artificial neural network model. Acyclovir, piperacillin-tazobactam, calcineurin inhibitors, and angiotensin-converting enzyme inhibitor/angiotensin receptor blockers were the most important medications.
Limitations
Clinical variables and medications were not exhaustive, drug levels or dosing were not incorporated, and Iowa’s racial makeup may limit generalizability.
Conclusions
Our RNN-GRU model substantially reduced the number of false alerts for nephrotoxic AKI, which may facilitate NINJA translation to adult hospitals by providing more targeted intervention.
Plain-Language Summary
Nephrotoxic acute kidney injury (AKI) is common and can potentially be prevented through preemptive adjustments of medications, as demonstrated by the success of the nephrotoxic injury negated by just-in time action (NINJA) program in pediatric populations. Translation of NINJA to the adult population has been challenging, and major barriers include high alert volume in adults that can lead to high resource utilization and alert fatigue. To address this issue, we developed a machine learning model for nephrotoxic AKI in adults that reduced the number of false alerts per AKI event from 2.5 to 0.7, which can enhance future NINJA implementation in adults by allowing for a more targeted intervention with fewer alerts and more efficient resource utilization.