Savino Cilla, Romina Rossi, Ragnhild Habberstad, Pal Klepstad, Monia Dall'Agata, Stein Kaasa, Vanessa Valenti, Costanza M Donati, Marco Maltoni, Alessio G Morganti
{"title":"预测骨转移姑息放疗患者总生存期的可解释机器学习模型","authors":"Savino Cilla, Romina Rossi, Ragnhild Habberstad, Pal Klepstad, Monia Dall'Agata, Stein Kaasa, Vanessa Valenti, Costanza M Donati, Marco Maltoni, Alessio G Morganti","doi":"10.1200/CCI.24.00027","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>The estimation of prognosis and life expectancy is critical in the care of patients with advanced cancer. To aid clinical decision making, we build a prognostic strategy combining a machine learning (ML) model with explainable artificial intelligence to predict 1-year survival after palliative radiotherapy (RT) for bone metastasis.</p><p><strong>Materials and methods: </strong>Data collected in the multicentric PRAIS trial were extracted for 574 eligible adults diagnosed with metastatic cancer. The primary end point was the overall survival (OS) at 1 year (1-year OS) after the start of RT. Candidate covariate predictors consisted of 13 clinical and tumor-related pre-RT patient characteristics, seven dosimetric and treatment-related variables, and 45 pre-RT laboratory variables. ML models were developed and internally validated using the Python package. The effectiveness of each model was evaluated in terms of discrimination. A Shapley Additive Explanations (SHAP) explainability analysis to infer the global and local feature importance and to understand the reasons for correct and misclassified predictions was performed.</p><p><strong>Results: </strong>The best-performing model for the classification of 1-year OS was the extreme gradient boosting algorithm, with AUC and F1-score values equal to 0.805 and 0.802, respectively. The SHAP technique revealed that higher chance of 1-year survival is associated with low values of interleukin-8, higher values of hemoglobin and lymphocyte count, and the nonuse of steroids.</p><p><strong>Conclusion: </strong>An explainable ML approach can provide a reliable prediction of 1-year survival after RT in patients with advanced cancer. The implementation of SHAP analysis provides an intelligible explanation of individualized risk prediction, enabling oncologists to identify the best strategy for patient stratification and treatment selection.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":null,"pages":null},"PeriodicalIF":3.3000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Explainable Machine Learning Model to Predict Overall Survival in Patients Treated With Palliative Radiotherapy for Bone Metastases.\",\"authors\":\"Savino Cilla, Romina Rossi, Ragnhild Habberstad, Pal Klepstad, Monia Dall'Agata, Stein Kaasa, Vanessa Valenti, Costanza M Donati, Marco Maltoni, Alessio G Morganti\",\"doi\":\"10.1200/CCI.24.00027\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>The estimation of prognosis and life expectancy is critical in the care of patients with advanced cancer. To aid clinical decision making, we build a prognostic strategy combining a machine learning (ML) model with explainable artificial intelligence to predict 1-year survival after palliative radiotherapy (RT) for bone metastasis.</p><p><strong>Materials and methods: </strong>Data collected in the multicentric PRAIS trial were extracted for 574 eligible adults diagnosed with metastatic cancer. The primary end point was the overall survival (OS) at 1 year (1-year OS) after the start of RT. Candidate covariate predictors consisted of 13 clinical and tumor-related pre-RT patient characteristics, seven dosimetric and treatment-related variables, and 45 pre-RT laboratory variables. ML models were developed and internally validated using the Python package. The effectiveness of each model was evaluated in terms of discrimination. A Shapley Additive Explanations (SHAP) explainability analysis to infer the global and local feature importance and to understand the reasons for correct and misclassified predictions was performed.</p><p><strong>Results: </strong>The best-performing model for the classification of 1-year OS was the extreme gradient boosting algorithm, with AUC and F1-score values equal to 0.805 and 0.802, respectively. The SHAP technique revealed that higher chance of 1-year survival is associated with low values of interleukin-8, higher values of hemoglobin and lymphocyte count, and the nonuse of steroids.</p><p><strong>Conclusion: </strong>An explainable ML approach can provide a reliable prediction of 1-year survival after RT in patients with advanced cancer. The implementation of SHAP analysis provides an intelligible explanation of individualized risk prediction, enabling oncologists to identify the best strategy for patient stratification and treatment selection.</p>\",\"PeriodicalId\":51626,\"journal\":{\"name\":\"JCO Clinical Cancer Informatics\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.3000,\"publicationDate\":\"2024-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"JCO Clinical Cancer Informatics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1200/CCI.24.00027\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ONCOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"JCO Clinical Cancer Informatics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1200/CCI.24.00027","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ONCOLOGY","Score":null,"Total":0}
Explainable Machine Learning Model to Predict Overall Survival in Patients Treated With Palliative Radiotherapy for Bone Metastases.
Purpose: The estimation of prognosis and life expectancy is critical in the care of patients with advanced cancer. To aid clinical decision making, we build a prognostic strategy combining a machine learning (ML) model with explainable artificial intelligence to predict 1-year survival after palliative radiotherapy (RT) for bone metastasis.
Materials and methods: Data collected in the multicentric PRAIS trial were extracted for 574 eligible adults diagnosed with metastatic cancer. The primary end point was the overall survival (OS) at 1 year (1-year OS) after the start of RT. Candidate covariate predictors consisted of 13 clinical and tumor-related pre-RT patient characteristics, seven dosimetric and treatment-related variables, and 45 pre-RT laboratory variables. ML models were developed and internally validated using the Python package. The effectiveness of each model was evaluated in terms of discrimination. A Shapley Additive Explanations (SHAP) explainability analysis to infer the global and local feature importance and to understand the reasons for correct and misclassified predictions was performed.
Results: The best-performing model for the classification of 1-year OS was the extreme gradient boosting algorithm, with AUC and F1-score values equal to 0.805 and 0.802, respectively. The SHAP technique revealed that higher chance of 1-year survival is associated with low values of interleukin-8, higher values of hemoglobin and lymphocyte count, and the nonuse of steroids.
Conclusion: An explainable ML approach can provide a reliable prediction of 1-year survival after RT in patients with advanced cancer. The implementation of SHAP analysis provides an intelligible explanation of individualized risk prediction, enabling oncologists to identify the best strategy for patient stratification and treatment selection.