Development of the machine learning model that is highly validated and easily applicable to predict radiographic knee osteoarthritis progression

IF 2.1 3区 医学 Q2 ORTHOPEDICS
Do Weon Lee, Hyuk-Soo Han, Du Hyun Ro, Yong Seuk Lee
{"title":"Development of the machine learning model that is highly validated and easily applicable to predict radiographic knee osteoarthritis progression","authors":"Do Weon Lee,&nbsp;Hyuk-Soo Han,&nbsp;Du Hyun Ro,&nbsp;Yong Seuk Lee","doi":"10.1002/jor.25982","DOIUrl":null,"url":null,"abstract":"<p>Many models using the aid of artificial intelligence have been recently proposed to predict the progression of knee osteoarthritis. However, previous models have not been properly validated with an external data set or have reported poor predictive performances. Therefore, the purpose of this study was to design a machine learning model for knee osteoarthritis progression, focusing on high validation quality and clinical applicability. A retrospective analysis was conducted on prospectively collected data, using the Osteoarthritis Initiative data set (5966 knees) for model development and the Multicenter Osteoarthritis Study data set (3392 knees) for validation. The analysis aimed to predict Kellgren–Lawrence grade (KLG) progression over 4–5 years in knees with initial KLG of 0, 1, or 2. Possible predictors included demographics, comorbidities, history of meniscectomy, gait speed, Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) scores, and radiological findings. The Random Forest algorithm was employed for the predictive model development. Baseline KLG, contralateral knee osteoarthritis, lateral joint space narrowing (JSN) grade, BMI, medial JSN grade, and total WOMAC score were six features selected for the model in descending order of importance. Odds ratios of baseline KLG, contralateral knee osteoarthritis, and lateral JSN grade were 1.76, 2.59, and 4.74, respectively (all <i>p</i> &lt; 0.001). The area-under-the-curve of the ROC curve in the validation set was 0.76 with an accuracy of 0.68 and an F1-score of 0.56. The progression of knee osteoarthritis in 4 ~ 5 years could be well-predicted using easily available variables. This simple and validated model may aid surgeons in knee osteoarthritis patient management.</p>","PeriodicalId":16650,"journal":{"name":"Journal of Orthopaedic Research®","volume":"43 1","pages":"128-138"},"PeriodicalIF":2.1000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Orthopaedic Research®","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/jor.25982","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
引用次数: 0

Abstract

Many models using the aid of artificial intelligence have been recently proposed to predict the progression of knee osteoarthritis. However, previous models have not been properly validated with an external data set or have reported poor predictive performances. Therefore, the purpose of this study was to design a machine learning model for knee osteoarthritis progression, focusing on high validation quality and clinical applicability. A retrospective analysis was conducted on prospectively collected data, using the Osteoarthritis Initiative data set (5966 knees) for model development and the Multicenter Osteoarthritis Study data set (3392 knees) for validation. The analysis aimed to predict Kellgren–Lawrence grade (KLG) progression over 4–5 years in knees with initial KLG of 0, 1, or 2. Possible predictors included demographics, comorbidities, history of meniscectomy, gait speed, Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) scores, and radiological findings. The Random Forest algorithm was employed for the predictive model development. Baseline KLG, contralateral knee osteoarthritis, lateral joint space narrowing (JSN) grade, BMI, medial JSN grade, and total WOMAC score were six features selected for the model in descending order of importance. Odds ratios of baseline KLG, contralateral knee osteoarthritis, and lateral JSN grade were 1.76, 2.59, and 4.74, respectively (all p < 0.001). The area-under-the-curve of the ROC curve in the validation set was 0.76 with an accuracy of 0.68 and an F1-score of 0.56. The progression of knee osteoarthritis in 4 ~ 5 years could be well-predicted using easily available variables. This simple and validated model may aid surgeons in knee osteoarthritis patient management.

开发机器学习模型,该模型经过高度验证,易于应用于预测膝关节骨关节炎的放射学进展。
最近,许多利用人工智能的模型被提出来预测膝关节骨关节炎的进展。然而,以前的模型没有经过外部数据集的适当验证,或者预测性能不佳。因此,本研究的目的是设计一种膝骨关节炎进展的机器学习模型,重点关注高验证质量和临床适用性。研究人员利用骨关节炎倡议数据集(5966 个膝关节)和多中心骨关节炎研究数据集(3392 个膝关节)对前瞻性收集的数据进行了回顾性分析。分析旨在预测初始 KLG 为 0、1 或 2 的膝关节在 4-5 年内的 Kellgren-Lawrence 分级(KLG)进展。可能的预测因素包括人口统计学、合并症、半月板切除术史、步速、西安大略和麦克马斯特大学骨关节炎指数(WOMAC)评分以及放射学检查结果。预测模型的开发采用了随机森林算法。基线KLG、对侧膝关节骨关节炎、外侧关节间隙狭窄(JSN)等级、体重指数(BMI)、内侧JSN等级和WOMAC总分是该模型选择的六个特征,其重要性由高到低依次排列。基线 KLG、对侧膝关节骨关节炎和外侧 JSN 等级的比值比分别为 1.76、2.59 和 4.74(均 p
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Orthopaedic Research®
Journal of Orthopaedic Research® 医学-整形外科
CiteScore
6.10
自引率
3.60%
发文量
261
审稿时长
3-6 weeks
期刊介绍: The Journal of Orthopaedic Research is the forum for the rapid publication of high quality reports of new information on the full spectrum of orthopaedic research, including life sciences, engineering, translational, and clinical studies.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信