Predicting rapid progression in knee osteoarthritis: a novel and interpretable automated machine learning approach, with specific focus on young patients and early disease.

IF 20.3 1区 医学 Q1 RHEUMATOLOGY
Simone Castagno, Mark Birch, Mihaela van der Schaar, Andrew McCaskie
{"title":"Predicting rapid progression in knee osteoarthritis: a novel and interpretable automated machine learning approach, with specific focus on young patients and early disease.","authors":"Simone Castagno, Mark Birch, Mihaela van der Schaar, Andrew McCaskie","doi":"10.1136/ard-2024-225872","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>To facilitate the stratification of patients with osteoarthritis (OA) for new treatment development and clinical trial recruitment, we created an automated machine learning (autoML) tool predicting the rapid progression of knee OA over a 2-year period.</p><p><strong>Methods: </strong>We developed autoML models integrating clinical, biochemical, X-ray and MRI data. Using two data sets within the OA Initiative-the Foundation for the National Institutes of Health OA Biomarker Consortium for training and hold-out validation, and the Pivotal Osteoarthritis Initiative MRI Analyses study for external validation-we employed two distinct definitions of clinical outcomes: Multiclass (categorising OA progression into pain and/or radiographic) and binary. Key predictors of progression were identified through advanced interpretability techniques, and subgroup analyses were conducted by age, sex and ethnicity with a focus on early-stage disease.</p><p><strong>Results: </strong>Although the most reliable models incorporated all available features, simpler models including only clinical variables achieved robust external validation performance, with area under the precision-recall curve (AUC-PRC) 0.727 (95% CI: 0.726 to 0.728) for multiclass predictions; and AUC-PRC 0.764 (95% CI: 0.762 to 0.766) for binary predictions. Multiclass models performed best in patients with early-stage OA (AUC-PRC 0.724-0.806) whereas binary models were more reliable in patients younger than 60 (AUC-PRC 0.617-0.693). Patient-reported outcomes and MRI features emerged as key predictors of progression, though subgroup differences were noted. Finally, we developed web-based applications to visualise our personalised predictions.</p><p><strong>Conclusions: </strong>Our novel tool's transparency and reliability in predicting rapid knee OA progression distinguish it from conventional 'black-box' methods and are more likely to facilitate its acceptance by clinicians and patients, enabling effective implementation in clinical practice.</p>","PeriodicalId":8087,"journal":{"name":"Annals of the Rheumatic Diseases","volume":null,"pages":null},"PeriodicalIF":20.3000,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Annals of the Rheumatic Diseases","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1136/ard-2024-225872","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"RHEUMATOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Objectives: To facilitate the stratification of patients with osteoarthritis (OA) for new treatment development and clinical trial recruitment, we created an automated machine learning (autoML) tool predicting the rapid progression of knee OA over a 2-year period.

Methods: We developed autoML models integrating clinical, biochemical, X-ray and MRI data. Using two data sets within the OA Initiative-the Foundation for the National Institutes of Health OA Biomarker Consortium for training and hold-out validation, and the Pivotal Osteoarthritis Initiative MRI Analyses study for external validation-we employed two distinct definitions of clinical outcomes: Multiclass (categorising OA progression into pain and/or radiographic) and binary. Key predictors of progression were identified through advanced interpretability techniques, and subgroup analyses were conducted by age, sex and ethnicity with a focus on early-stage disease.

Results: Although the most reliable models incorporated all available features, simpler models including only clinical variables achieved robust external validation performance, with area under the precision-recall curve (AUC-PRC) 0.727 (95% CI: 0.726 to 0.728) for multiclass predictions; and AUC-PRC 0.764 (95% CI: 0.762 to 0.766) for binary predictions. Multiclass models performed best in patients with early-stage OA (AUC-PRC 0.724-0.806) whereas binary models were more reliable in patients younger than 60 (AUC-PRC 0.617-0.693). Patient-reported outcomes and MRI features emerged as key predictors of progression, though subgroup differences were noted. Finally, we developed web-based applications to visualise our personalised predictions.

Conclusions: Our novel tool's transparency and reliability in predicting rapid knee OA progression distinguish it from conventional 'black-box' methods and are more likely to facilitate its acceptance by clinicians and patients, enabling effective implementation in clinical practice.

预测膝关节骨关节炎的快速进展:一种新颖且可解释的自动机器学习方法,特别关注年轻患者和早期疾病。
目的:为了便于对骨关节炎(OA)患者进行分层,以便开发新的治疗方法和招募临床试验,我们创建了一种自动机器学习(autoML)工具,用于预测膝关节OA在两年内的快速进展:我们开发了整合临床、生化、X 光和 MRI 数据的 autoML 模型。我们使用了OA倡议中的两个数据集--用于训练和保持验证的美国国立卫生研究院OA生物标志物联盟基金会,以及用于外部验证的关键骨关节炎倡议核磁共振成像分析研究--对临床结果采用了两种不同的定义:我们采用了两种不同的临床结果定义:多类(将 OA 进展分为疼痛和/或影像学)和二元。通过先进的可解释性技术确定了疾病进展的关键预测因素,并按年龄、性别和种族进行了亚组分析,重点关注早期疾病:尽管最可靠的模型包含了所有可用的特征,但只包含临床变量的简单模型也获得了稳健的外部验证性能,多分类预测的精确度-召回曲线下面积(AUC-PRC)为 0.727(95% CI:0.726 至 0.728);二元预测的精确度-召回曲线下面积(AUC-PRC)为 0.764(95% CI:0.762 至 0.766)。多分类模型在早期 OA 患者中表现最佳(AUC-PRC 0.724-0.806),而二元模型在 60 岁以下患者中更为可靠(AUC-PRC 0.617-0.693)。患者报告的结果和磁共振成像特征是预测病情进展的关键因素,但亚组之间也存在差异。最后,我们开发了基于网络的应用程序,将我们的个性化预测可视化:我们的新工具在预测膝关节OA快速进展方面的透明度和可靠性使其有别于传统的 "黑箱 "方法,更容易被临床医生和患者接受,并能在临床实践中有效实施。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Annals of the Rheumatic Diseases
Annals of the Rheumatic Diseases 医学-风湿病学
CiteScore
35.00
自引率
9.90%
发文量
3728
审稿时长
1.4 months
期刊介绍: Annals of the Rheumatic Diseases (ARD) is an international peer-reviewed journal covering all aspects of rheumatology, which includes the full spectrum of musculoskeletal conditions, arthritic disease, and connective tissue disorders. ARD publishes basic, clinical, and translational scientific research, including the most important recommendations for the management of various conditions.
文献相关原料
公司名称 产品信息 采购帮参考价格
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信