Deep learning-assisted 3D model for the detection and classification of knee arthritis

IF 4.2 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
D. Preethi , V. Govindaraj , S. Dhanasekar , K. Martin Sagayam , Syed Immamul Ansarullah , Farhan Amin , Isabel de la Torre D'ıez , Carlos Osorio Garc'ıa , Alina Eugenia Pascual Barrera , Fehaid Salem Alshammari
{"title":"Deep learning-assisted 3D model for the detection and classification of knee arthritis","authors":"D. Preethi ,&nbsp;V. Govindaraj ,&nbsp;S. Dhanasekar ,&nbsp;K. Martin Sagayam ,&nbsp;Syed Immamul Ansarullah ,&nbsp;Farhan Amin ,&nbsp;Isabel de la Torre D'ıez ,&nbsp;Carlos Osorio Garc'ıa ,&nbsp;Alina Eugenia Pascual Barrera ,&nbsp;Fehaid Salem Alshammari","doi":"10.1016/j.imavis.2025.105574","DOIUrl":null,"url":null,"abstract":"<div><div>Osteoarthritis (OA) affects nearly 240 million people worldwide. It is a common degenerative illness that typically affects the knee joint OA causes pain, and functional disability, especially in older adults is a common disease. One of the most common and challenging medical conditions to deal with in old-aged people is the occurrence of knee osteoarthritis (KOA). Manual diagnosis involves observing X-ray images of the knee area and classifying it into different five grades. This requires the physician's expertise, suitable experience, and a lot of time, and even after that, the diagnosis can be prone to errors. Therefore, researchers in the machine learning (ML) and deep learning (DL) domains have employed the capabilities of deep neural network (DNN) models to identify and classify medical images in an automated, faster, and more accurate manner. Combining multiple imaging modalities or utilizing three-dimensional reconstructions can enhance the accuracy and completeness of 2D Images in diagnostic information. Hence to overcome the drawbacks of 2D imaging, the reconstruction of 3D models using 2D images is the main theme of our research. In this paper, we propose a deep learning-based model for the detection and classification of the early diagnosis of arthritis. It is a four-step procedure starting with data collection followed by data conversion. In this step, our proposed model deforms the target's convex hull to produce a 3D model. Herein, a series of 2D photos is utilized, along with surface rendering methods, to create a 3D model. In the third step, the feature extraction is performed followed by mesh refinement. The chamfer loss is optimized based on the rotational shape of the leg bones, and subsequently, the weight of the loss function can be allocated to the target's geometric properties. We have used a modified Gray Level Co-occurrence Matrix (GLCM) for feature extraction. In the fourth step, the image classification is performed and the suggested optimization strategy raises the model's accuracy. A comparison of results with current 3D reconstruction techniques proves that the suggested method can consistently produce a waterproof model with a greater reconstruction accuracy. The deep-seated intricacies and distinct patterns across arthritic phases are estimated through the extraction of complicated statistical variables combined with power spectral density. The high-dimensional data is divided into separate, easily observable groups using the Lion Optimization Algorithm and proposed distance metric. The F1 Score and Jaccard Metric showed an average of 0.85 and 0.23, indicating effective differentiation across clusters.</div></div>","PeriodicalId":50374,"journal":{"name":"Image and Vision Computing","volume":"160 ","pages":"Article 105574"},"PeriodicalIF":4.2000,"publicationDate":"2025-05-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Image and Vision Computing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0262885625001623","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Osteoarthritis (OA) affects nearly 240 million people worldwide. It is a common degenerative illness that typically affects the knee joint OA causes pain, and functional disability, especially in older adults is a common disease. One of the most common and challenging medical conditions to deal with in old-aged people is the occurrence of knee osteoarthritis (KOA). Manual diagnosis involves observing X-ray images of the knee area and classifying it into different five grades. This requires the physician's expertise, suitable experience, and a lot of time, and even after that, the diagnosis can be prone to errors. Therefore, researchers in the machine learning (ML) and deep learning (DL) domains have employed the capabilities of deep neural network (DNN) models to identify and classify medical images in an automated, faster, and more accurate manner. Combining multiple imaging modalities or utilizing three-dimensional reconstructions can enhance the accuracy and completeness of 2D Images in diagnostic information. Hence to overcome the drawbacks of 2D imaging, the reconstruction of 3D models using 2D images is the main theme of our research. In this paper, we propose a deep learning-based model for the detection and classification of the early diagnosis of arthritis. It is a four-step procedure starting with data collection followed by data conversion. In this step, our proposed model deforms the target's convex hull to produce a 3D model. Herein, a series of 2D photos is utilized, along with surface rendering methods, to create a 3D model. In the third step, the feature extraction is performed followed by mesh refinement. The chamfer loss is optimized based on the rotational shape of the leg bones, and subsequently, the weight of the loss function can be allocated to the target's geometric properties. We have used a modified Gray Level Co-occurrence Matrix (GLCM) for feature extraction. In the fourth step, the image classification is performed and the suggested optimization strategy raises the model's accuracy. A comparison of results with current 3D reconstruction techniques proves that the suggested method can consistently produce a waterproof model with a greater reconstruction accuracy. The deep-seated intricacies and distinct patterns across arthritic phases are estimated through the extraction of complicated statistical variables combined with power spectral density. The high-dimensional data is divided into separate, easily observable groups using the Lion Optimization Algorithm and proposed distance metric. The F1 Score and Jaccard Metric showed an average of 0.85 and 0.23, indicating effective differentiation across clusters.
基于深度学习的膝关节关节炎检测与分类三维模型
骨关节炎(OA)影响着全球近2.4亿人。它是一种常见的退行性疾病,通常影响膝关节OA引起疼痛和功能障碍,尤其在老年人中是一种常见病。老年人最常见和最具挑战性的医疗条件之一是膝关节骨关节炎(KOA)的发生。人工诊断包括观察膝关节区域的x线图像并将其分为不同的五个等级。这需要医生的专业知识、适当的经验和大量的时间,即使在此之后,诊断也可能容易出错。因此,机器学习(ML)和深度学习(DL)领域的研究人员利用深度神经网络(DNN)模型的功能,以自动、更快、更准确的方式识别和分类医学图像。结合多种成像方式或利用三维重建可以提高二维图像诊断信息的准确性和完整性。因此,为了克服二维成像的缺点,利用二维图像重建三维模型是我们研究的主题。在本文中,我们提出了一个基于深度学习的模型,用于关节炎的早期诊断的检测和分类。这是一个四步的过程,从数据收集开始,然后是数据转换。在这一步中,我们提出的模型变形目标的凸壳来产生一个3D模型。在这里,我们利用一系列的2D照片,结合表面渲染的方法来创建一个3D模型。第三步,进行特征提取,然后进行网格细化。根据腿骨的旋转形状对倒角损失进行优化,然后将损失函数的权重分配给目标的几何特性。我们使用改进的灰度共生矩阵(GLCM)进行特征提取。第四步,对图像进行分类,提出的优化策略提高了模型的准确率。与现有的三维重建技术进行了对比,结果表明该方法能够持续生成具有较高重建精度的防水模型。通过提取复杂的统计变量并结合功率谱密度来估计关节炎各阶段的深层复杂性和独特模式。使用Lion优化算法和提出的距离度量将高维数据划分为单独的,易于观察的组。F1得分和Jaccard Metric的平均值分别为0.85和0.23,表明集群间存在有效分化。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Image and Vision Computing
Image and Vision Computing 工程技术-工程:电子与电气
CiteScore
8.50
自引率
8.50%
发文量
143
审稿时长
7.8 months
期刊介绍: Image and Vision Computing has as a primary aim the provision of an effective medium of interchange for the results of high quality theoretical and applied research fundamental to all aspects of image interpretation and computer vision. The journal publishes work that proposes new image interpretation and computer vision methodology or addresses the application of such methods to real world scenes. It seeks to strengthen a deeper understanding in the discipline by encouraging the quantitative comparison and performance evaluation of the proposed methodology. The coverage includes: image interpretation, scene modelling, object recognition and tracking, shape analysis, monitoring and surveillance, active vision and robotic systems, SLAM, biologically-inspired computer vision, motion analysis, stereo vision, document image understanding, character and handwritten text recognition, face and gesture recognition, biometrics, vision-based human-computer interaction, human activity and behavior understanding, data fusion from multiple sensor inputs, image databases.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信