Development of a machine-learning model for patient satisfaction prediction in lumbar spinal stenosis surgery: A multicenter study with ZCQ and JOABPEQ scores.

IF 1.4 4区 医学 Q3 ORTHOPEDICS
Soya Kawabata, Gen Miura, Yuki Akaike, Sota Nagai, Kurenai Hachiya, Takaya Imai, Hiroki Takeda, Atsushi Yoshioka, Shinjiro Kaneko, Yudo Hachiya, Nobuyuki Fujita, Takayuki Kannon, Junichiro Yoshimoto
{"title":"Development of a machine-learning model for patient satisfaction prediction in lumbar spinal stenosis surgery: A multicenter study with ZCQ and JOABPEQ scores.","authors":"Soya Kawabata, Gen Miura, Yuki Akaike, Sota Nagai, Kurenai Hachiya, Takaya Imai, Hiroki Takeda, Atsushi Yoshioka, Shinjiro Kaneko, Yudo Hachiya, Nobuyuki Fujita, Takayuki Kannon, Junichiro Yoshimoto","doi":"10.1016/j.jos.2025.06.014","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Patient satisfaction is an essential metric for evaluating treatment outcomes for LSS, both for patients and for their primary physicians. However, the Zurich Claudication Questionnaire (ZCQ) is the only representative patient-reported outcome measure that evaluates satisfaction. To develop a model using machine learning to predict postoperative satisfaction among older patients with lumbar spinal stenosis (LSS) based on preoperative and postoperative scores of the Japanese Orthopedic Association Back Pain Evaluation Questionnaire (JOABPEQ).</p><p><strong>Methods: </strong>The training dataset was composed of time-course data of ZCQ and JOABPEQ scores from patients aged ≥65 years who underwent LSS surgery at a university hospital. The validation dataset included data from patients with LSS treated at a private orthopedic clinic. A linear support vector machine classifier was trained to predict achievement of a \"Satisfied\" state from preoperative and postoperative JOABPEQ scores. Internal validation was carried out via leave-one-out cross-validation, and external validation using a separate dataset to assess the accuracy, sensitivity, specificity, F1 score, and area under the receiver operating characteristics curve (AUROC). Variable importance was analyzed using model class reliance.</p><p><strong>Results: </strong>A total of 232 and 66 individuals were included in the training and validation datasets, respectively. The machine-learning model exhibited an accuracy of 0.72, sensitivity of 0.75, specificity of 0.69, and AUROC of 0.82. Psychological disorder and walking ability were identified through permutation importance analysis as key factors for satisfaction. External validation on an independent dataset demonstrated comparable accuracy (0.76), sensitivity (0.83), and AUROC (0.75), although the specificity decreased (0.42).</p><p><strong>Conclusions: </strong>The machine learning model presented here can predict the postoperative satisfaction score on the ZCQ from preoperative and postoperative JOABPEQ scores, highlighting its potential for broader application in clinical settings.</p>","PeriodicalId":16939,"journal":{"name":"Journal of Orthopaedic Science","volume":" ","pages":""},"PeriodicalIF":1.4000,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Orthopaedic Science","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.jos.2025.06.014","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Patient satisfaction is an essential metric for evaluating treatment outcomes for LSS, both for patients and for their primary physicians. However, the Zurich Claudication Questionnaire (ZCQ) is the only representative patient-reported outcome measure that evaluates satisfaction. To develop a model using machine learning to predict postoperative satisfaction among older patients with lumbar spinal stenosis (LSS) based on preoperative and postoperative scores of the Japanese Orthopedic Association Back Pain Evaluation Questionnaire (JOABPEQ).

Methods: The training dataset was composed of time-course data of ZCQ and JOABPEQ scores from patients aged ≥65 years who underwent LSS surgery at a university hospital. The validation dataset included data from patients with LSS treated at a private orthopedic clinic. A linear support vector machine classifier was trained to predict achievement of a "Satisfied" state from preoperative and postoperative JOABPEQ scores. Internal validation was carried out via leave-one-out cross-validation, and external validation using a separate dataset to assess the accuracy, sensitivity, specificity, F1 score, and area under the receiver operating characteristics curve (AUROC). Variable importance was analyzed using model class reliance.

Results: A total of 232 and 66 individuals were included in the training and validation datasets, respectively. The machine-learning model exhibited an accuracy of 0.72, sensitivity of 0.75, specificity of 0.69, and AUROC of 0.82. Psychological disorder and walking ability were identified through permutation importance analysis as key factors for satisfaction. External validation on an independent dataset demonstrated comparable accuracy (0.76), sensitivity (0.83), and AUROC (0.75), although the specificity decreased (0.42).

Conclusions: The machine learning model presented here can predict the postoperative satisfaction score on the ZCQ from preoperative and postoperative JOABPEQ scores, highlighting its potential for broader application in clinical settings.

腰椎管狭窄手术患者满意度预测的机器学习模型的开发:一项采用ZCQ和JOABPEQ评分的多中心研究。
背景:患者满意度是评估LSS治疗结果的重要指标,无论是对患者还是对其主治医生。然而,苏黎世跛行问卷(ZCQ)是唯一具有代表性的患者报告的评估满意度的结果测量。基于日本骨科协会背痛评估问卷(JOABPEQ)的术前和术后评分,开发一个使用机器学习预测老年腰椎管狭窄(LSS)患者术后满意度的模型。方法:训练数据集由年龄≥65岁在某大学医院行LSS手术的患者的ZCQ和JOABPEQ评分的时程数据组成。验证数据集包括在一家私人骨科诊所治疗的LSS患者的数据。通过训练线性支持向量机分类器来预测术前和术后JOABPEQ评分是否达到“满意”状态。内部验证通过留一交叉验证进行,外部验证使用单独的数据集评估准确性、灵敏度、特异性、F1评分和受试者工作特征曲线下面积(AUROC)。利用模型类依赖分析变量重要性。结果:共纳入训练数据集232人,纳入验证数据集66人。机器学习模型的准确率为0.72,灵敏度为0.75,特异性为0.69,AUROC为0.82。通过排列重要性分析,确定心理障碍和行走能力为满意度的关键因素。在独立数据集上的外部验证显示出相当的准确性(0.76)、灵敏度(0.83)和AUROC(0.75),尽管特异性降低了(0.42)。结论:本文提出的机器学习模型可以通过术前和术后JOABPEQ评分预测术后ZCQ满意度评分,突出了其在临床环境中更广泛应用的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Orthopaedic Science
Journal of Orthopaedic Science 医学-整形外科
CiteScore
3.00
自引率
0.00%
发文量
290
审稿时长
90 days
期刊介绍: The Journal of Orthopaedic Science is the official peer-reviewed journal of the Japanese Orthopaedic Association. The journal publishes the latest researches and topical debates in all fields of clinical and experimental orthopaedics, including musculoskeletal medicine, sports medicine, locomotive syndrome, trauma, paediatrics, oncology and biomaterials, as well as basic researches.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信