Development of a machine-learning model for patient satisfaction prediction in lumbar spinal stenosis surgery: A multicenter study with ZCQ and JOABPEQ scores.
{"title":"Development of a machine-learning model for patient satisfaction prediction in lumbar spinal stenosis surgery: A multicenter study with ZCQ and JOABPEQ scores.","authors":"Soya Kawabata, Gen Miura, Yuki Akaike, Sota Nagai, Kurenai Hachiya, Takaya Imai, Hiroki Takeda, Atsushi Yoshioka, Shinjiro Kaneko, Yudo Hachiya, Nobuyuki Fujita, Takayuki Kannon, Junichiro Yoshimoto","doi":"10.1016/j.jos.2025.06.014","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Patient satisfaction is an essential metric for evaluating treatment outcomes for LSS, both for patients and for their primary physicians. However, the Zurich Claudication Questionnaire (ZCQ) is the only representative patient-reported outcome measure that evaluates satisfaction. To develop a model using machine learning to predict postoperative satisfaction among older patients with lumbar spinal stenosis (LSS) based on preoperative and postoperative scores of the Japanese Orthopedic Association Back Pain Evaluation Questionnaire (JOABPEQ).</p><p><strong>Methods: </strong>The training dataset was composed of time-course data of ZCQ and JOABPEQ scores from patients aged ≥65 years who underwent LSS surgery at a university hospital. The validation dataset included data from patients with LSS treated at a private orthopedic clinic. A linear support vector machine classifier was trained to predict achievement of a \"Satisfied\" state from preoperative and postoperative JOABPEQ scores. Internal validation was carried out via leave-one-out cross-validation, and external validation using a separate dataset to assess the accuracy, sensitivity, specificity, F1 score, and area under the receiver operating characteristics curve (AUROC). Variable importance was analyzed using model class reliance.</p><p><strong>Results: </strong>A total of 232 and 66 individuals were included in the training and validation datasets, respectively. The machine-learning model exhibited an accuracy of 0.72, sensitivity of 0.75, specificity of 0.69, and AUROC of 0.82. Psychological disorder and walking ability were identified through permutation importance analysis as key factors for satisfaction. External validation on an independent dataset demonstrated comparable accuracy (0.76), sensitivity (0.83), and AUROC (0.75), although the specificity decreased (0.42).</p><p><strong>Conclusions: </strong>The machine learning model presented here can predict the postoperative satisfaction score on the ZCQ from preoperative and postoperative JOABPEQ scores, highlighting its potential for broader application in clinical settings.</p>","PeriodicalId":16939,"journal":{"name":"Journal of Orthopaedic Science","volume":" ","pages":""},"PeriodicalIF":1.4000,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Orthopaedic Science","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.jos.2025.06.014","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Patient satisfaction is an essential metric for evaluating treatment outcomes for LSS, both for patients and for their primary physicians. However, the Zurich Claudication Questionnaire (ZCQ) is the only representative patient-reported outcome measure that evaluates satisfaction. To develop a model using machine learning to predict postoperative satisfaction among older patients with lumbar spinal stenosis (LSS) based on preoperative and postoperative scores of the Japanese Orthopedic Association Back Pain Evaluation Questionnaire (JOABPEQ).
Methods: The training dataset was composed of time-course data of ZCQ and JOABPEQ scores from patients aged ≥65 years who underwent LSS surgery at a university hospital. The validation dataset included data from patients with LSS treated at a private orthopedic clinic. A linear support vector machine classifier was trained to predict achievement of a "Satisfied" state from preoperative and postoperative JOABPEQ scores. Internal validation was carried out via leave-one-out cross-validation, and external validation using a separate dataset to assess the accuracy, sensitivity, specificity, F1 score, and area under the receiver operating characteristics curve (AUROC). Variable importance was analyzed using model class reliance.
Results: A total of 232 and 66 individuals were included in the training and validation datasets, respectively. The machine-learning model exhibited an accuracy of 0.72, sensitivity of 0.75, specificity of 0.69, and AUROC of 0.82. Psychological disorder and walking ability were identified through permutation importance analysis as key factors for satisfaction. External validation on an independent dataset demonstrated comparable accuracy (0.76), sensitivity (0.83), and AUROC (0.75), although the specificity decreased (0.42).
Conclusions: The machine learning model presented here can predict the postoperative satisfaction score on the ZCQ from preoperative and postoperative JOABPEQ scores, highlighting its potential for broader application in clinical settings.
期刊介绍:
The Journal of Orthopaedic Science is the official peer-reviewed journal of the Japanese Orthopaedic Association. The journal publishes the latest researches and topical debates in all fields of clinical and experimental orthopaedics, including musculoskeletal medicine, sports medicine, locomotive syndrome, trauma, paediatrics, oncology and biomaterials, as well as basic researches.