R H Kuijten, B J J Bindels, O Q Groot, E H Huele, R Gal, M C H de Groot, J M van der Velden, D Delawi, J H Schwab, H M Verkooijen, J J Verlaan, D Tobert, J P H J Rutges
{"title":"Predicting Quality of Life of Patients After Treatment for Spinal Metastatic Disease: Development and Internal Evaluation.","authors":"R H Kuijten, B J J Bindels, O Q Groot, E H Huele, R Gal, M C H de Groot, J M van der Velden, D Delawi, J H Schwab, H M Verkooijen, J J Verlaan, D Tobert, J P H J Rutges","doi":"10.1016/j.spinee.2025.03.016","DOIUrl":null,"url":null,"abstract":"<p><strong>Background context: </strong>When treating spinal metastases in a palliative setting, maintaining or enhancing quality of life (QoL) is the primary therapeutic objective. Clinicians tailor their treatment strategy by weighing the QoL benefits against expected survival. To date, no available model exists that predicts QoL in patients after treatment for spinal metastases.</p><p><strong>Purpose: </strong>To develop and internally evaluate a model predicting QoL for patients after treatment for spinal metastases, across the spectrum of (local) treatment modalities.</p><p><strong>Study design/setting: </strong>Cohort study of prospectively collected data.</p><p><strong>Patient sample: </strong>Patients with spinal metastases referred to a single tertiary referral center in the Netherlands between January 1<sup>st</sup>, 2016, and December 31<sup>st</sup>, 2021.</p><p><strong>Outcome measures: </strong>The primary outcome was achieving a minimal clinically important difference (MCID) on QoL using the EQ-5D-3L index score three months after the referral visit (at the outpatient clinic or emergency department).</p><p><strong>Methods: </strong>Five prediction models using machine learning were developed: random forest, stochastic gradient boosting, support vector machine, penalized logistic regression, and neural network. Performance was assessed using cross-validation during development and bootstrapping for internal evaluation with discrimination (area under the curve (AUC)), calibration, and decision curve analysis. This study was funded by the AOSpine under the Discovery & Innovation award (AOS-DIA-22-012-TUM). A total amount of CHF 40,000 ($45,000) was received.</p><p><strong>Results: </strong>In total, 953 patients were included in the study, of which 308 (32%) achieved the MCID at three months. Discrimination was fair and comparable between the models, but the random forest model outperformed the other models on calibration and was therefore chosen as the final model (AUC 0.78; confidence interval (CI): 0.71 to 0.85; calibration intercept: -0.06; CI: -0.31 to 0.25; calibration slope: 1.05; CI: 0.70 to 1.44), with the following predictors ranked by importance: baseline EQ-5D-3L index score, Karnofsky Performance Scale, primary tumor histology, opioid use, and presence of brain metastases.</p><p><strong>Conclusions: </strong>We developed and internally evaluated a random forest model that predicts clinically meaningful improvement of QoL three months after the baseline visit at the outpatient clinic for patients with spinal metastases. Future studies should externally evaluate the random forest model to confirm its robustness and generalizability in daily practice.</p>","PeriodicalId":49484,"journal":{"name":"Spine Journal","volume":" ","pages":""},"PeriodicalIF":4.9000,"publicationDate":"2025-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Spine Journal","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.spinee.2025.03.016","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background context: When treating spinal metastases in a palliative setting, maintaining or enhancing quality of life (QoL) is the primary therapeutic objective. Clinicians tailor their treatment strategy by weighing the QoL benefits against expected survival. To date, no available model exists that predicts QoL in patients after treatment for spinal metastases.
Purpose: To develop and internally evaluate a model predicting QoL for patients after treatment for spinal metastases, across the spectrum of (local) treatment modalities.
Study design/setting: Cohort study of prospectively collected data.
Patient sample: Patients with spinal metastases referred to a single tertiary referral center in the Netherlands between January 1st, 2016, and December 31st, 2021.
Outcome measures: The primary outcome was achieving a minimal clinically important difference (MCID) on QoL using the EQ-5D-3L index score three months after the referral visit (at the outpatient clinic or emergency department).
Methods: Five prediction models using machine learning were developed: random forest, stochastic gradient boosting, support vector machine, penalized logistic regression, and neural network. Performance was assessed using cross-validation during development and bootstrapping for internal evaluation with discrimination (area under the curve (AUC)), calibration, and decision curve analysis. This study was funded by the AOSpine under the Discovery & Innovation award (AOS-DIA-22-012-TUM). A total amount of CHF 40,000 ($45,000) was received.
Results: In total, 953 patients were included in the study, of which 308 (32%) achieved the MCID at three months. Discrimination was fair and comparable between the models, but the random forest model outperformed the other models on calibration and was therefore chosen as the final model (AUC 0.78; confidence interval (CI): 0.71 to 0.85; calibration intercept: -0.06; CI: -0.31 to 0.25; calibration slope: 1.05; CI: 0.70 to 1.44), with the following predictors ranked by importance: baseline EQ-5D-3L index score, Karnofsky Performance Scale, primary tumor histology, opioid use, and presence of brain metastases.
Conclusions: We developed and internally evaluated a random forest model that predicts clinically meaningful improvement of QoL three months after the baseline visit at the outpatient clinic for patients with spinal metastases. Future studies should externally evaluate the random forest model to confirm its robustness and generalizability in daily practice.
期刊介绍:
The Spine Journal, the official journal of the North American Spine Society, is an international and multidisciplinary journal that publishes original, peer-reviewed articles on research and treatment related to the spine and spine care, including basic science and clinical investigations. It is a condition of publication that manuscripts submitted to The Spine Journal have not been published, and will not be simultaneously submitted or published elsewhere. The Spine Journal also publishes major reviews of specific topics by acknowledged authorities, technical notes, teaching editorials, and other special features, Letters to the Editor-in-Chief are encouraged.