Diabetic Foot Ulcer Detection: Combining Deep Learning Models for Improved Localization

IF 4.3 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Rusab Sarmun, Muhammad E. H. Chowdhury, M. Murugappan, Ahmed Aqel, Maymouna Ezzuddin, Syed Mahfuzur Rahman, Amith Khandakar, Sanzida Akter, Rashad Alfkey, Md. Anwarul Hasan
{"title":"Diabetic Foot Ulcer Detection: Combining Deep Learning Models for Improved Localization","authors":"Rusab Sarmun, Muhammad E. H. Chowdhury, M. Murugappan, Ahmed Aqel, Maymouna Ezzuddin, Syed Mahfuzur Rahman, Amith Khandakar, Sanzida Akter, Rashad Alfkey, Md. Anwarul Hasan","doi":"10.1007/s12559-024-10267-3","DOIUrl":null,"url":null,"abstract":"<p>Diabetes mellitus (DM) can cause chronic foot issues and severe infections, including Diabetic Foot Ulcers (DFUs) that heal slowly due to insufficient blood flow. A recurrence of these ulcers can lead to 84% of lower limb amputations and even cause death. High-risk diabetes patients require expensive medications, regular check-ups, and proper personal hygiene to prevent DFUs, which affect 15–25% of diabetics. Accurate diagnosis, appropriate care, and prompt response can prevent amputations and fatalities through early and reliable DFU detection from image analysis. We propose a comprehensive deep learning-based system for detecting DFUs from patients’ feet images by reliably localizing ulcer points. Our method utilizes innovative model ensemble techniques—non-maximum suppression (NMS), Soft-NMS, and weighted bounding box fusion (WBF)—to combine predictions from state-of-the-art object detection models. The performances of diverse cutting-edge model architectures used in this study complement each other, leading to more generalized and improved results when combined in an ensemble. Our WBF-based approach combining YOLOv8m and FRCNN-ResNet101 achieves a mean average precision (mAP) score of 86.4% at the IoU threshold of 0.5 on the DFUC2020 dataset, significantly outperforming the former benchmark by 12.4%. We also perform external validation on the IEEE DataPort Diabetic Foot dataset which has demonstrated robust and reliable model performance on the qualitative analysis. In conclusion, our study effectively developed an innovative diabetic foot ulcer (DFU) detection system using an ensemble model of deep neural networks (DNNs). This AI-driven tool serves as an initial screening aid for medical professionals, augmenting the diagnostic process by enhancing sensitivity to potential DFU cases. While recognizing the presence of false positives, our research contributes to improving patient care through the integration of human medical expertise with AI-based solutions in DFU management.</p>","PeriodicalId":51243,"journal":{"name":"Cognitive Computation","volume":null,"pages":null},"PeriodicalIF":4.3000,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Cognitive Computation","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s12559-024-10267-3","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Diabetes mellitus (DM) can cause chronic foot issues and severe infections, including Diabetic Foot Ulcers (DFUs) that heal slowly due to insufficient blood flow. A recurrence of these ulcers can lead to 84% of lower limb amputations and even cause death. High-risk diabetes patients require expensive medications, regular check-ups, and proper personal hygiene to prevent DFUs, which affect 15–25% of diabetics. Accurate diagnosis, appropriate care, and prompt response can prevent amputations and fatalities through early and reliable DFU detection from image analysis. We propose a comprehensive deep learning-based system for detecting DFUs from patients’ feet images by reliably localizing ulcer points. Our method utilizes innovative model ensemble techniques—non-maximum suppression (NMS), Soft-NMS, and weighted bounding box fusion (WBF)—to combine predictions from state-of-the-art object detection models. The performances of diverse cutting-edge model architectures used in this study complement each other, leading to more generalized and improved results when combined in an ensemble. Our WBF-based approach combining YOLOv8m and FRCNN-ResNet101 achieves a mean average precision (mAP) score of 86.4% at the IoU threshold of 0.5 on the DFUC2020 dataset, significantly outperforming the former benchmark by 12.4%. We also perform external validation on the IEEE DataPort Diabetic Foot dataset which has demonstrated robust and reliable model performance on the qualitative analysis. In conclusion, our study effectively developed an innovative diabetic foot ulcer (DFU) detection system using an ensemble model of deep neural networks (DNNs). This AI-driven tool serves as an initial screening aid for medical professionals, augmenting the diagnostic process by enhancing sensitivity to potential DFU cases. While recognizing the presence of false positives, our research contributes to improving patient care through the integration of human medical expertise with AI-based solutions in DFU management.

糖尿病足溃疡检测:结合深度学习模型改进定位
糖尿病(DM)可导致慢性足部问题和严重感染,包括因血流不足而愈合缓慢的糖尿病足溃疡(DFU)。这些溃疡的复发可导致 84% 的下肢截肢,甚至导致死亡。高危糖尿病患者需要昂贵的药物、定期检查和适当的个人卫生来预防 DFU,15%-25% 的糖尿病患者会受到 DFU 的影响。通过图像分析进行早期、可靠的 DFU 检测,准确的诊断、适当的护理和及时的响应可以防止截肢和死亡。我们提出了一种基于深度学习的综合系统,通过可靠地定位溃疡点,从患者的足部图像中检测出 DFU。我们的方法利用创新的模型集合技术--非最大抑制(NMS)、软-NMS 和加权边界框融合(WBF)--将最先进的物体检测模型的预测结果结合起来。本研究中使用的各种尖端模型架构性能互补,在组合使用时可获得更广泛和更好的结果。我们基于 WBF 的方法结合了 YOLOv8m 和 FRCNN-ResNet101,在 DFUC2020 数据集上,当 IoU 临界值为 0.5 时,平均精度 (mAP) 得分达到 86.4%,比前一个基准高出 12.4%。我们还在 IEEE DataPort 糖尿病足数据集上进行了外部验证,该数据集在定性分析中表现出了稳健可靠的模型性能。总之,我们的研究利用深度神经网络(DNN)的集合模型有效地开发了一种创新的糖尿病足溃疡(DFU)检测系统。这种人工智能驱动的工具可作为医疗专业人员的初步筛查辅助工具,通过提高对潜在 DFU 病例的敏感性来增强诊断过程。在认识到假阳性病例存在的同时,我们的研究通过将人类医疗专业知识与基于人工智能的 DFU 管理解决方案相结合,为改善患者护理做出了贡献。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Cognitive Computation
Cognitive Computation COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE-NEUROSCIENCES
CiteScore
9.30
自引率
3.70%
发文量
116
审稿时长
>12 weeks
期刊介绍: Cognitive Computation is an international, peer-reviewed, interdisciplinary journal that publishes cutting-edge articles describing original basic and applied work involving biologically-inspired computational accounts of all aspects of natural and artificial cognitive systems. It provides a new platform for the dissemination of research, current practices and future trends in the emerging discipline of cognitive computation that bridges the gap between life sciences, social sciences, engineering, physical and mathematical sciences, and humanities.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信