MPLNet: Multi-task supervised progressive learning network for diabetic retinopathy grading

IF 4 3区 计算机科学 Q1 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE
{"title":"MPLNet: Multi-task supervised progressive learning network for diabetic retinopathy grading","authors":"","doi":"10.1016/j.compeleceng.2024.109746","DOIUrl":null,"url":null,"abstract":"<div><div>Diabetic Retinopathy (DR) is a retinal disease resulting from diabetes. In severe cases, it can lead to irreversible damage to the retina or even blindness. Employing deep learning models to assist in DR diagnosis and classification can alleviate the burden of screening. However, challenges such as the tendency of models to overlook subtle lesions (e.g., microaneurysms) in retinal images and the imbalance in DR data distribution hinder accurate grading. To address these issues, this paper proposes a multi-task supervised progressive learning network (MPLNet) consisting of a Lesion-aware feature extraction Module (LFM) and a Category feature extraction Module (CFM). The network utilizes two progressive tasks – DR identification and DR grading – to guide the LFM and CFM in extracting comprehensive lesion information and then learning discriminative features for each category, thereby enhancing the performance of DR grading. Additionally, to improve the feature extraction capabilities of the two modules, this paper introduces the Detail Attention Module (DAM) and the Category Attention Module (CAM). DAM enhances the detection ability of tiny abnormal areas in the retinal images from both channel and spatial dimensions. The CAM thoroughly explores the critical features of each category from multiple dimensions, thereby reducing the impact of data imbalance. The proposed method achieved kappa scores of 87.0%, 88.2%, and 93.0% on the DDR, Messidor-2, and APTOS datasets, respectively. Experimental results demonstrate that MPLNet outperforms other DR grading methods. T-SNE and Grad-CAM visualization techniques verify the interpretability of the model.</div></div>","PeriodicalId":50630,"journal":{"name":"Computers & Electrical Engineering","volume":null,"pages":null},"PeriodicalIF":4.0000,"publicationDate":"2024-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers & Electrical Engineering","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0045790624006736","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
引用次数: 0

Abstract

Diabetic Retinopathy (DR) is a retinal disease resulting from diabetes. In severe cases, it can lead to irreversible damage to the retina or even blindness. Employing deep learning models to assist in DR diagnosis and classification can alleviate the burden of screening. However, challenges such as the tendency of models to overlook subtle lesions (e.g., microaneurysms) in retinal images and the imbalance in DR data distribution hinder accurate grading. To address these issues, this paper proposes a multi-task supervised progressive learning network (MPLNet) consisting of a Lesion-aware feature extraction Module (LFM) and a Category feature extraction Module (CFM). The network utilizes two progressive tasks – DR identification and DR grading – to guide the LFM and CFM in extracting comprehensive lesion information and then learning discriminative features for each category, thereby enhancing the performance of DR grading. Additionally, to improve the feature extraction capabilities of the two modules, this paper introduces the Detail Attention Module (DAM) and the Category Attention Module (CAM). DAM enhances the detection ability of tiny abnormal areas in the retinal images from both channel and spatial dimensions. The CAM thoroughly explores the critical features of each category from multiple dimensions, thereby reducing the impact of data imbalance. The proposed method achieved kappa scores of 87.0%, 88.2%, and 93.0% on the DDR, Messidor-2, and APTOS datasets, respectively. Experimental results demonstrate that MPLNet outperforms other DR grading methods. T-SNE and Grad-CAM visualization techniques verify the interpretability of the model.
MPLNet:用于糖尿病视网膜病变分级的多任务监督渐进学习网络
糖尿病视网膜病变(DR)是一种由糖尿病引起的视网膜疾病。严重时可导致视网膜不可逆转的损伤,甚至失明。采用深度学习模型协助诊断和分类糖尿病视网膜病变可以减轻筛查负担。然而,模型容易忽略视网膜图像中的细微病变(如微动脉瘤)以及 DR 数据分布不平衡等挑战阻碍了准确分级。为了解决这些问题,本文提出了一种由病变感知特征提取模块(LFM)和类别特征提取模块(CFM)组成的多任务监督渐进学习网络(MPLNet)。该网络利用两个渐进任务--DR 识别和 DR 分级--指导 LFM 和 CFM 提取全面的病变信息,然后学习每个类别的判别特征,从而提高 DR 分级的性能。此外,为了提高两个模块的特征提取能力,本文还引入了细节关注模块(DAM)和类别关注模块(CAM)。DAM 从通道和空间两个维度增强了对视网膜图像中微小异常区域的检测能力。类别关注模块从多个维度深入挖掘每个类别的关键特征,从而减少数据不平衡的影响。所提出的方法在 DDR、Messidor-2 和 APTOS 数据集上的 kappa 分数分别达到了 87.0%、88.2% 和 93.0%。实验结果表明,MPLNet优于其他DR分级方法。T-SNE 和 Grad-CAM 可视化技术验证了模型的可解释性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Computers & Electrical Engineering
Computers & Electrical Engineering 工程技术-工程:电子与电气
CiteScore
9.20
自引率
7.00%
发文量
661
审稿时长
47 days
期刊介绍: The impact of computers has nowhere been more revolutionary than in electrical engineering. The design, analysis, and operation of electrical and electronic systems are now dominated by computers, a transformation that has been motivated by the natural ease of interface between computers and electrical systems, and the promise of spectacular improvements in speed and efficiency. Published since 1973, Computers & Electrical Engineering provides rapid publication of topical research into the integration of computer technology and computational techniques with electrical and electronic systems. The journal publishes papers featuring novel implementations of computers and computational techniques in areas like signal and image processing, high-performance computing, parallel processing, and communications. Special attention will be paid to papers describing innovative architectures, algorithms, and software tools.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信