Comparative Analysis of Logistic Regression, Gradient Boosted Trees, SVM, and Random Forest Algorithms for Prediction of Acute Kidney Injury Requiring Dialysis After Cardiac Surgery.
Evi Diana Omar, Hasnah Mat, Ainil Zafirah Abd Karim, Ridwan Sanaudi, Fairol H Ibrahim, Mohd Azahadi Omar, Muhd Zulfadli Hafiz Ismail, Vivek Jason Jayaraj, Bak Leong Goh
{"title":"Comparative Analysis of Logistic Regression, Gradient Boosted Trees, SVM, and Random Forest Algorithms for Prediction of Acute Kidney Injury Requiring Dialysis After Cardiac Surgery.","authors":"Evi Diana Omar, Hasnah Mat, Ainil Zafirah Abd Karim, Ridwan Sanaudi, Fairol H Ibrahim, Mohd Azahadi Omar, Muhd Zulfadli Hafiz Ismail, Vivek Jason Jayaraj, Bak Leong Goh","doi":"10.2147/IJNRD.S461028","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>This study aimed to identify the best-performing algorithm for predicting Acute Kidney Injury (AKI) necessitating dialysis following cardiac surgery.</p><p><strong>Patients and methods: </strong>The dataset encompassed patient data from a tertiary cardiothoracic center in Malaysia between 2011 and 2015, sourced from electronic health records. Extensive preprocessing and feature selection ensured data quality and relevance. Four machine learning algorithms were applied: Logistic Regression, Gradient Boosted Trees, Support Vector Machine, and Random Forest. The dataset was split into training and validation sets and the hyperparameters were tuned. Accuracy, Area Under the ROC Curve (AUC), precision, F-measure, sensitivity, and specificity were some of the evaluation criteria. Ethical guidelines for data use and patient privacy were rigorously followed throughout the study.</p><p><strong>Results: </strong>With the highest accuracy (88.66%), AUC (94.61%), and sensitivity (91.30%), Gradient Boosted Trees emerged as the top performance. Random Forest displayed strong AUC (94.78%) and accuracy (87.39%). In contrast, the Support Vector Machine showed higher sensitivity (98.57%) with lower specificity (59.55%), but lower accuracy (79.02%) and precision (70.81%). Sensitivity (87.70%) and specificity (87.05%) were maintained in balance via Logistic Regression.</p><p><strong>Conclusion: </strong>These findings imply that Gradient Boosted Trees and Random Forest might be an effective method for identifying patients who would develop AKI following heart surgery. However specific goals, sensitivity/specificity trade-offs, and consideration of the practical ramifications should all be considered when choosing an algorithm.</p>","PeriodicalId":14181,"journal":{"name":"International Journal of Nephrology and Renovascular Disease","volume":"17 ","pages":"197-204"},"PeriodicalIF":2.1000,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11283789/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Nephrology and Renovascular Disease","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2147/IJNRD.S461028","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"UROLOGY & NEPHROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: This study aimed to identify the best-performing algorithm for predicting Acute Kidney Injury (AKI) necessitating dialysis following cardiac surgery.
Patients and methods: The dataset encompassed patient data from a tertiary cardiothoracic center in Malaysia between 2011 and 2015, sourced from electronic health records. Extensive preprocessing and feature selection ensured data quality and relevance. Four machine learning algorithms were applied: Logistic Regression, Gradient Boosted Trees, Support Vector Machine, and Random Forest. The dataset was split into training and validation sets and the hyperparameters were tuned. Accuracy, Area Under the ROC Curve (AUC), precision, F-measure, sensitivity, and specificity were some of the evaluation criteria. Ethical guidelines for data use and patient privacy were rigorously followed throughout the study.
Results: With the highest accuracy (88.66%), AUC (94.61%), and sensitivity (91.30%), Gradient Boosted Trees emerged as the top performance. Random Forest displayed strong AUC (94.78%) and accuracy (87.39%). In contrast, the Support Vector Machine showed higher sensitivity (98.57%) with lower specificity (59.55%), but lower accuracy (79.02%) and precision (70.81%). Sensitivity (87.70%) and specificity (87.05%) were maintained in balance via Logistic Regression.
Conclusion: These findings imply that Gradient Boosted Trees and Random Forest might be an effective method for identifying patients who would develop AKI following heart surgery. However specific goals, sensitivity/specificity trade-offs, and consideration of the practical ramifications should all be considered when choosing an algorithm.
期刊介绍:
International Journal of Nephrology and Renovascular Disease is an international, peer-reviewed, open-access journal focusing on the pathophysiology of the kidney and vascular supply. Epidemiology, screening, diagnosis, and treatment interventions are covered as well as basic science, biochemical and immunological studies. In particular, emphasis will be given to: -Chronic kidney disease- Complications of renovascular disease- Imaging techniques- Renal hypertension- Renal cancer- Treatment including pharmacological and transplantation- Dialysis and treatment of complications of dialysis and renal disease- Quality of Life- Patient satisfaction and preference- Health economic evaluations. The journal welcomes submitted papers covering original research, basic science, clinical studies, reviews & evaluations, guidelines, expert opinion and commentary, case reports and extended reports. The main focus of the journal will be to publish research and clinical results in humans but preclinical, animal and in vitro studies will be published where they shed light on disease processes and potential new therapies and interventions.