Jane Wang, Amir Ashraf Ganjouei, Taizo Hibi, Nuria Lluis, Camilla Gomes, Fernanda Romero-Hernandez, Han Yin, Lucia Calthorpe, Yukiyasu Okamura, Yuta Abe, Shogo Tanaka, Minoru Tanabe, Zeniche Morise, Horacio Asbun, David Geller, Mohammed Abu Hilal, Mohamed Adam, Adnan Alseidi
{"title":"肝脏外科教科书预后机器学习预测模型的开发和验证:来自多中心国际队列的结果。","authors":"Jane Wang, Amir Ashraf Ganjouei, Taizo Hibi, Nuria Lluis, Camilla Gomes, Fernanda Romero-Hernandez, Han Yin, Lucia Calthorpe, Yukiyasu Okamura, Yuta Abe, Shogo Tanaka, Minoru Tanabe, Zeniche Morise, Horacio Asbun, David Geller, Mohammed Abu Hilal, Mohamed Adam, Adnan Alseidi","doi":"10.1097/AS9.0000000000000539","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>This study aimed to (1) develop a machine learning (ML) model that predicts the textbook outcome in liver surgery (TOLS) using preoperative variables and (2) validate the TOLS criteria by determining whether TOLS is associated with long-term survival after hepatectomy.</p><p><strong>Background: </strong>Textbook outcome is a composite measure that combines several favorable outcomes into a single metric and represents the optimal postoperative course. Recently, an expert panel of surgeons proposed a Delphi consensus-based definition of TOLS.</p><p><strong>Methods: </strong>Adult patients who underwent hepatectomies were identified from a multicenter, international cohort (2010-2022). After data preprocessing and train-test splitting (80:20), 4 models for predicting TOLS were trained and tested. Following model optimization, the performance of the models was evaluated using receiver operating characteristic curves, and a web-based calculator was developed. In addition, a multivariable Cox proportional hazards analysis was conducted to determine the association between TOLS and overall survival (OS).</p><p><strong>Results: </strong>A total of 2059 patients were included, with 62.8% meeting the criteria for TOLS. The XGBoost model, which had the best performance with an area under the curve of 0.73, was chosen for the web-based calculator. The most predictive variables for having TOLS were a minimally invasive approach, fewer lesions, lower Charlson Comorbidity Index, lower preoperative creatinine levels, and smaller lesions. In the multivariable analysis, having TOLS was associated with improved OS (hazard ratio = 0.82, <i>P</i> = 0.015).</p><p><strong>Conclusions: </strong>Our ML model can predict TOLS with acceptable discrimination. We validated the TOLS criteria by demonstrating a significant association with improved OS, thus supporting their use in informing patient care.</p>","PeriodicalId":72231,"journal":{"name":"Annals of surgery open : perspectives of surgical history, education, and clinical approaches","volume":"6 1","pages":"e539"},"PeriodicalIF":0.0000,"publicationDate":"2025-02-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11932622/pdf/","citationCount":"0","resultStr":"{\"title\":\"Development and Validation of a Machine Learning Prediction Model for Textbook Outcome in Liver Surgery: Results From a Multicenter, International Cohort.\",\"authors\":\"Jane Wang, Amir Ashraf Ganjouei, Taizo Hibi, Nuria Lluis, Camilla Gomes, Fernanda Romero-Hernandez, Han Yin, Lucia Calthorpe, Yukiyasu Okamura, Yuta Abe, Shogo Tanaka, Minoru Tanabe, Zeniche Morise, Horacio Asbun, David Geller, Mohammed Abu Hilal, Mohamed Adam, Adnan Alseidi\",\"doi\":\"10.1097/AS9.0000000000000539\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>This study aimed to (1) develop a machine learning (ML) model that predicts the textbook outcome in liver surgery (TOLS) using preoperative variables and (2) validate the TOLS criteria by determining whether TOLS is associated with long-term survival after hepatectomy.</p><p><strong>Background: </strong>Textbook outcome is a composite measure that combines several favorable outcomes into a single metric and represents the optimal postoperative course. Recently, an expert panel of surgeons proposed a Delphi consensus-based definition of TOLS.</p><p><strong>Methods: </strong>Adult patients who underwent hepatectomies were identified from a multicenter, international cohort (2010-2022). After data preprocessing and train-test splitting (80:20), 4 models for predicting TOLS were trained and tested. Following model optimization, the performance of the models was evaluated using receiver operating characteristic curves, and a web-based calculator was developed. In addition, a multivariable Cox proportional hazards analysis was conducted to determine the association between TOLS and overall survival (OS).</p><p><strong>Results: </strong>A total of 2059 patients were included, with 62.8% meeting the criteria for TOLS. The XGBoost model, which had the best performance with an area under the curve of 0.73, was chosen for the web-based calculator. The most predictive variables for having TOLS were a minimally invasive approach, fewer lesions, lower Charlson Comorbidity Index, lower preoperative creatinine levels, and smaller lesions. In the multivariable analysis, having TOLS was associated with improved OS (hazard ratio = 0.82, <i>P</i> = 0.015).</p><p><strong>Conclusions: </strong>Our ML model can predict TOLS with acceptable discrimination. We validated the TOLS criteria by demonstrating a significant association with improved OS, thus supporting their use in informing patient care.</p>\",\"PeriodicalId\":72231,\"journal\":{\"name\":\"Annals of surgery open : perspectives of surgical history, education, and clinical approaches\",\"volume\":\"6 1\",\"pages\":\"e539\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-02-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11932622/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Annals of surgery open : perspectives of surgical history, education, and clinical approaches\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1097/AS9.0000000000000539\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/3/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Annals of surgery open : perspectives of surgical history, education, and clinical approaches","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1097/AS9.0000000000000539","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/3/1 0:00:00","PubModel":"eCollection","JCR":"","JCRName":"","Score":null,"Total":0}
Development and Validation of a Machine Learning Prediction Model for Textbook Outcome in Liver Surgery: Results From a Multicenter, International Cohort.
Objective: This study aimed to (1) develop a machine learning (ML) model that predicts the textbook outcome in liver surgery (TOLS) using preoperative variables and (2) validate the TOLS criteria by determining whether TOLS is associated with long-term survival after hepatectomy.
Background: Textbook outcome is a composite measure that combines several favorable outcomes into a single metric and represents the optimal postoperative course. Recently, an expert panel of surgeons proposed a Delphi consensus-based definition of TOLS.
Methods: Adult patients who underwent hepatectomies were identified from a multicenter, international cohort (2010-2022). After data preprocessing and train-test splitting (80:20), 4 models for predicting TOLS were trained and tested. Following model optimization, the performance of the models was evaluated using receiver operating characteristic curves, and a web-based calculator was developed. In addition, a multivariable Cox proportional hazards analysis was conducted to determine the association between TOLS and overall survival (OS).
Results: A total of 2059 patients were included, with 62.8% meeting the criteria for TOLS. The XGBoost model, which had the best performance with an area under the curve of 0.73, was chosen for the web-based calculator. The most predictive variables for having TOLS were a minimally invasive approach, fewer lesions, lower Charlson Comorbidity Index, lower preoperative creatinine levels, and smaller lesions. In the multivariable analysis, having TOLS was associated with improved OS (hazard ratio = 0.82, P = 0.015).
Conclusions: Our ML model can predict TOLS with acceptable discrimination. We validated the TOLS criteria by demonstrating a significant association with improved OS, thus supporting their use in informing patient care.