Benjamin R. Griffin , Avinash Mudireddy , Benjamin D. Horne , Michel Chonchol , Stuart L. Goldstein , Michihiko Goto , Michael E. Matheny , W. Nick Street , Mary Vaughan-Sarrazin , Diana I. Jalal , Jason Misurac
{"title":"预测住院成人肾毒性急性肾损伤:机器学习算法","authors":"Benjamin R. Griffin , Avinash Mudireddy , Benjamin D. Horne , Michel Chonchol , Stuart L. Goldstein , Michihiko Goto , Michael E. Matheny , W. Nick Street , Mary Vaughan-Sarrazin , Diana I. Jalal , Jason Misurac","doi":"10.1016/j.xkme.2024.100918","DOIUrl":null,"url":null,"abstract":"<div><h3>Rationale and Objective</h3><div>Acute kidney injury (AKI) is a common complication among hospitalized adults, but AKI prediction and prevention among adults has proved challenging. We used machine learning to update the nephrotoxic injury negated by just-in time action (NINJA), a pediatric program that predicts nephrotoxic AKI, to improve accuracy among adults.</div></div><div><h3>Study Design</h3><div>A retrospective cohort study.</div></div><div><h3>Setting and Population</h3><div>Adults admitted for<!--> <!-->><!--> <!-->48 hours to the University of Iowa Hospital from 2017 to 2022.</div></div><div><h3>Exposure</h3><div>A NINJA high-nephrotoxin exposure (≥3 nephrotoxins on 1<!--> <!-->day or intravenous aminoglycoside or vancomycin for<!--> <!-->≥3 days).</div></div><div><h3>Outcomes</h3><div>AKI within 48 hours of high-nephrotoxin exposure.</div></div><div><h3>Analytical Approach</h3><div>We collected 85 variables, including demographics, laboratory tests, vital signs, and medications. AKI was defined as a serum creatinine increase of<!--> <!-->≥0.3<!--> <!-->mg/dL. A gated recurrent unit (GRU)-based recurrent neural network (RNN) was trained on 85% of the data, and then tested on the remaining 15%. Model performance was evaluated with precision, recall, negative predictive value, and area under the curve. We used an artificial neural network to determine risk factor importance.</div></div><div><h3>Results</h3><div>There were 14,480 patients, 18,180 admissions, and 37,300 high-nephrotoxin exposure events meeting inclusion criteria. In the testing cohort, 29% of exposures developed AKI within 48 hours. The RNN-GRU model predicted AKI with a precision of 0.60, reducing the number of false alerts from 2.5 to 0.7 per AKI case. Lowest hemoglobin, lowest blood pressure, and highest white blood cell count were the most important variables in the artificial neural network model. Acyclovir, piperacillin-tazobactam, calcineurin inhibitors, and angiotensin-converting enzyme inhibitor/angiotensin receptor blockers were the most important medications.</div></div><div><h3>Limitations</h3><div>Clinical variables and medications were not exhaustive, drug levels or dosing were not incorporated, and Iowa’s racial makeup may limit generalizability.</div></div><div><h3>Conclusions</h3><div>Our RNN-GRU model substantially reduced the number of false alerts for nephrotoxic AKI, which may facilitate NINJA translation to adult hospitals by providing more targeted intervention.</div></div><div><h3>Plain-Language Summary</h3><div>Nephrotoxic acute kidney injury (AKI) is common and can potentially be prevented through preemptive adjustments of medications, as demonstrated by the success of the nephrotoxic injury negated by just-in time action (NINJA) program in pediatric populations. Translation of NINJA to the adult population has been challenging, and major barriers include high alert volume in adults that can lead to high resource utilization and alert fatigue. To address this issue, we developed a machine learning model for nephrotoxic AKI in adults that reduced the number of false alerts per AKI event from 2.5 to 0.7, which can enhance future NINJA implementation in adults by allowing for a more targeted intervention with fewer alerts and more efficient resource utilization.</div></div>","PeriodicalId":17885,"journal":{"name":"Kidney Medicine","volume":"6 12","pages":"Article 100918"},"PeriodicalIF":3.2000,"publicationDate":"2024-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Predicting Nephrotoxic Acute Kidney Injury in Hospitalized Adults: A Machine Learning Algorithm\",\"authors\":\"Benjamin R. Griffin , Avinash Mudireddy , Benjamin D. Horne , Michel Chonchol , Stuart L. Goldstein , Michihiko Goto , Michael E. Matheny , W. Nick Street , Mary Vaughan-Sarrazin , Diana I. Jalal , Jason Misurac\",\"doi\":\"10.1016/j.xkme.2024.100918\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Rationale and Objective</h3><div>Acute kidney injury (AKI) is a common complication among hospitalized adults, but AKI prediction and prevention among adults has proved challenging. We used machine learning to update the nephrotoxic injury negated by just-in time action (NINJA), a pediatric program that predicts nephrotoxic AKI, to improve accuracy among adults.</div></div><div><h3>Study Design</h3><div>A retrospective cohort study.</div></div><div><h3>Setting and Population</h3><div>Adults admitted for<!--> <!-->><!--> <!-->48 hours to the University of Iowa Hospital from 2017 to 2022.</div></div><div><h3>Exposure</h3><div>A NINJA high-nephrotoxin exposure (≥3 nephrotoxins on 1<!--> <!-->day or intravenous aminoglycoside or vancomycin for<!--> <!-->≥3 days).</div></div><div><h3>Outcomes</h3><div>AKI within 48 hours of high-nephrotoxin exposure.</div></div><div><h3>Analytical Approach</h3><div>We collected 85 variables, including demographics, laboratory tests, vital signs, and medications. AKI was defined as a serum creatinine increase of<!--> <!-->≥0.3<!--> <!-->mg/dL. A gated recurrent unit (GRU)-based recurrent neural network (RNN) was trained on 85% of the data, and then tested on the remaining 15%. Model performance was evaluated with precision, recall, negative predictive value, and area under the curve. We used an artificial neural network to determine risk factor importance.</div></div><div><h3>Results</h3><div>There were 14,480 patients, 18,180 admissions, and 37,300 high-nephrotoxin exposure events meeting inclusion criteria. In the testing cohort, 29% of exposures developed AKI within 48 hours. The RNN-GRU model predicted AKI with a precision of 0.60, reducing the number of false alerts from 2.5 to 0.7 per AKI case. Lowest hemoglobin, lowest blood pressure, and highest white blood cell count were the most important variables in the artificial neural network model. Acyclovir, piperacillin-tazobactam, calcineurin inhibitors, and angiotensin-converting enzyme inhibitor/angiotensin receptor blockers were the most important medications.</div></div><div><h3>Limitations</h3><div>Clinical variables and medications were not exhaustive, drug levels or dosing were not incorporated, and Iowa’s racial makeup may limit generalizability.</div></div><div><h3>Conclusions</h3><div>Our RNN-GRU model substantially reduced the number of false alerts for nephrotoxic AKI, which may facilitate NINJA translation to adult hospitals by providing more targeted intervention.</div></div><div><h3>Plain-Language Summary</h3><div>Nephrotoxic acute kidney injury (AKI) is common and can potentially be prevented through preemptive adjustments of medications, as demonstrated by the success of the nephrotoxic injury negated by just-in time action (NINJA) program in pediatric populations. Translation of NINJA to the adult population has been challenging, and major barriers include high alert volume in adults that can lead to high resource utilization and alert fatigue. To address this issue, we developed a machine learning model for nephrotoxic AKI in adults that reduced the number of false alerts per AKI event from 2.5 to 0.7, which can enhance future NINJA implementation in adults by allowing for a more targeted intervention with fewer alerts and more efficient resource utilization.</div></div>\",\"PeriodicalId\":17885,\"journal\":{\"name\":\"Kidney Medicine\",\"volume\":\"6 12\",\"pages\":\"Article 100918\"},\"PeriodicalIF\":3.2000,\"publicationDate\":\"2024-10-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Kidney Medicine\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2590059524001298\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"UROLOGY & NEPHROLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Kidney Medicine","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2590059524001298","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"UROLOGY & NEPHROLOGY","Score":null,"Total":0}
引用次数: 0
摘要
理论依据和目标急性肾损伤(AKI)是成人住院患者中常见的并发症,但事实证明,成人AKI的预测和预防具有挑战性。我们利用机器学习更新了及时行动(NINJA)(一种预测肾毒性 AKI 的儿科程序)所否定的肾毒性损伤,以提高成人中的准确性。研究设计回顾性队列研究设置和人群2017 年至 2022 年期间,爱荷华大学医院收治了 > 48 小时的成人。暴露A NINJA高肾毒素暴露(1天内≥3种肾毒素或静脉注射氨基糖苷类或万古霉素≥3天).结果高肾毒素暴露48小时内AKI.分析方法我们收集了85个变量,包括人口统计学、实验室检查、生命体征和药物。AKI 的定义是血清肌酐升高≥0.3 mg/dL。基于门控递归单元(GRU)的递归神经网络(RNN)在 85% 的数据上进行了训练,然后在剩余 15% 的数据上进行了测试。模型性能通过精确度、召回率、负预测值和曲线下面积进行评估。我们使用人工神经网络来确定风险因素的重要性。结果符合纳入标准的患者有 14,480 人,入院人数有 18,180 人,高肾毒素暴露事件有 37,300 起。在测试队列中,29%的接触者在 48 小时内发生了 AKI。RNN-GRU 模型预测 AKI 的精确度为 0.60,将每例 AKI 的误报数量从 2.5 降至 0.7。最低血红蛋白、最低血压和最高白细胞计数是人工神经网络模型中最重要的变量。局限性临床变量和药物未穷尽,药物水平或剂量未纳入其中,爱荷华州的种族构成可能会限制其普遍性。结论我们的 RNN-GRU 模型大大降低了肾毒性 AKI 的错误警报数量,通过提供更有针对性的干预措施,这可能有助于将 NINJA 移植到成人医院。将 NINJA 移植到成人中一直是个挑战,主要障碍包括成人的高警报量会导致资源利用率高和警报疲劳。为了解决这一问题,我们开发了一种针对成人肾毒性 AKI 的机器学习模型,该模型可将每次 AKI 事件的错误警报次数从 2.5 次减少到 0.7 次,这可以通过减少警报次数和提高资源利用效率来进行更有针对性的干预,从而加强未来 NINJA 在成人中的实施。
Predicting Nephrotoxic Acute Kidney Injury in Hospitalized Adults: A Machine Learning Algorithm
Rationale and Objective
Acute kidney injury (AKI) is a common complication among hospitalized adults, but AKI prediction and prevention among adults has proved challenging. We used machine learning to update the nephrotoxic injury negated by just-in time action (NINJA), a pediatric program that predicts nephrotoxic AKI, to improve accuracy among adults.
Study Design
A retrospective cohort study.
Setting and Population
Adults admitted for > 48 hours to the University of Iowa Hospital from 2017 to 2022.
Exposure
A NINJA high-nephrotoxin exposure (≥3 nephrotoxins on 1 day or intravenous aminoglycoside or vancomycin for ≥3 days).
Outcomes
AKI within 48 hours of high-nephrotoxin exposure.
Analytical Approach
We collected 85 variables, including demographics, laboratory tests, vital signs, and medications. AKI was defined as a serum creatinine increase of ≥0.3 mg/dL. A gated recurrent unit (GRU)-based recurrent neural network (RNN) was trained on 85% of the data, and then tested on the remaining 15%. Model performance was evaluated with precision, recall, negative predictive value, and area under the curve. We used an artificial neural network to determine risk factor importance.
Results
There were 14,480 patients, 18,180 admissions, and 37,300 high-nephrotoxin exposure events meeting inclusion criteria. In the testing cohort, 29% of exposures developed AKI within 48 hours. The RNN-GRU model predicted AKI with a precision of 0.60, reducing the number of false alerts from 2.5 to 0.7 per AKI case. Lowest hemoglobin, lowest blood pressure, and highest white blood cell count were the most important variables in the artificial neural network model. Acyclovir, piperacillin-tazobactam, calcineurin inhibitors, and angiotensin-converting enzyme inhibitor/angiotensin receptor blockers were the most important medications.
Limitations
Clinical variables and medications were not exhaustive, drug levels or dosing were not incorporated, and Iowa’s racial makeup may limit generalizability.
Conclusions
Our RNN-GRU model substantially reduced the number of false alerts for nephrotoxic AKI, which may facilitate NINJA translation to adult hospitals by providing more targeted intervention.
Plain-Language Summary
Nephrotoxic acute kidney injury (AKI) is common and can potentially be prevented through preemptive adjustments of medications, as demonstrated by the success of the nephrotoxic injury negated by just-in time action (NINJA) program in pediatric populations. Translation of NINJA to the adult population has been challenging, and major barriers include high alert volume in adults that can lead to high resource utilization and alert fatigue. To address this issue, we developed a machine learning model for nephrotoxic AKI in adults that reduced the number of false alerts per AKI event from 2.5 to 0.7, which can enhance future NINJA implementation in adults by allowing for a more targeted intervention with fewer alerts and more efficient resource utilization.