Multi-classification deep learning models for detection of ulcerative colitis, polyps, and dyed-lifted polyps using wireless capsule endoscopy images

IF 5 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Hassaan Malik, Ahmad Naeem, Abolghasem Sadeghi-Niaraki, Rizwan Ali Naqvi, Seung-Won Lee
{"title":"Multi-classification deep learning models for detection of ulcerative colitis, polyps, and dyed-lifted polyps using wireless capsule endoscopy images","authors":"Hassaan Malik, Ahmad Naeem, Abolghasem Sadeghi-Niaraki, Rizwan Ali Naqvi, Seung-Won Lee","doi":"10.1007/s40747-023-01271-5","DOIUrl":null,"url":null,"abstract":"<p>Wireless capsule endoscopy (WCE) enables imaging and diagnostics of the gastrointestinal (GI) tract to be performed without any discomfort. Despite this, several characteristics, including efficacy, tolerance, safety, and performance, make it difficult to apply and modify widely. The use of automated WCE to collect data and perform the analysis is essential for finding anomalies. Medical specialists need a significant amount of time and expertise to examine the data generated by WCE imaging of the patient’s digestive tract. To address these challenges, several computer vision-based solutions have been designed; nevertheless, they do not achieve an acceptable level of accuracy, and more advancements are required. Thus, in this study, we proposed four multi-classification deep learning (DL) models i.e., Vgg-19 + CNN, ResNet152V2, Gated Recurrent Unit (GRU) + ResNet152V2, and ResNet152V2 + Bidirectional GRU (Bi-GRU) and applied it on different publicly available databases for diagnosing ulcerative colitis, polyps, and dyed-lifted polyps using WCE images. To our knowledge, this is the only study that uses a single DL model for the classification of three different GI diseases. We compared the classification performance of the proposed DL classifiers in terms of many parameters such as accuracy, loss, Matthew's correlation coefficient (MCC), recall, precision, negative predictive value (NPV), positive predictive value (PPV), and F1-score. The results revealed that the Vgg-19 + CNN outperforms the three other proposed DL models in classifying GI diseases using WCE images. The Vgg-19 + CNN model achieved an accuracy of 99.45%. The results of four proposed DL classifiers are also compared with recent state-of-the-art classifiers and the proposed Vgg-19 + CNN model has performed better in terms of improved accuracy.</p>","PeriodicalId":10524,"journal":{"name":"Complex & Intelligent Systems","volume":"56 20","pages":""},"PeriodicalIF":5.0000,"publicationDate":"2023-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Complex & Intelligent Systems","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s40747-023-01271-5","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Wireless capsule endoscopy (WCE) enables imaging and diagnostics of the gastrointestinal (GI) tract to be performed without any discomfort. Despite this, several characteristics, including efficacy, tolerance, safety, and performance, make it difficult to apply and modify widely. The use of automated WCE to collect data and perform the analysis is essential for finding anomalies. Medical specialists need a significant amount of time and expertise to examine the data generated by WCE imaging of the patient’s digestive tract. To address these challenges, several computer vision-based solutions have been designed; nevertheless, they do not achieve an acceptable level of accuracy, and more advancements are required. Thus, in this study, we proposed four multi-classification deep learning (DL) models i.e., Vgg-19 + CNN, ResNet152V2, Gated Recurrent Unit (GRU) + ResNet152V2, and ResNet152V2 + Bidirectional GRU (Bi-GRU) and applied it on different publicly available databases for diagnosing ulcerative colitis, polyps, and dyed-lifted polyps using WCE images. To our knowledge, this is the only study that uses a single DL model for the classification of three different GI diseases. We compared the classification performance of the proposed DL classifiers in terms of many parameters such as accuracy, loss, Matthew's correlation coefficient (MCC), recall, precision, negative predictive value (NPV), positive predictive value (PPV), and F1-score. The results revealed that the Vgg-19 + CNN outperforms the three other proposed DL models in classifying GI diseases using WCE images. The Vgg-19 + CNN model achieved an accuracy of 99.45%. The results of four proposed DL classifiers are also compared with recent state-of-the-art classifiers and the proposed Vgg-19 + CNN model has performed better in terms of improved accuracy.

Abstract Image

应用无线胶囊内镜图像检测溃疡性结肠炎、息肉和染色息肉的多分类深度学习模型
无线胶囊内窥镜(WCE)可以在没有任何不适的情况下对胃肠道(GI)进行成像和诊断。尽管如此,包括疗效、耐受性、安全性和性能在内的一些特性使其难以广泛应用和修改。使用自动WCE收集数据并执行分析对于发现异常是必不可少的。医学专家需要大量的时间和专业知识来检查由患者消化道WCE成像生成的数据。为了应对这些挑战,设计了几种基于计算机视觉的解决方案;然而,他们没有达到一个可接受的精度水平,需要更多的进步。因此,在本研究中,我们提出了Vgg-19 + CNN、ResNet152V2、门控循环单元(GRU) + ResNet152V2和ResNet152V2 +双向GRU (Bi-GRU)四种多分类深度学习(DL)模型,并将其应用于不同的公开数据库,用于使用WCE图像诊断溃疡性结肠炎、息肉和染提息肉。据我们所知,这是唯一一项使用单一DL模型对三种不同胃肠道疾病进行分类的研究。我们从准确率、损失、马修相关系数(MCC)、召回率、精度、负预测值(NPV)、正预测值(PPV)和f1分数等多个参数比较了所提出的深度学习分类器的分类性能。结果表明,Vgg-19 + CNN在使用WCE图像对胃肠道疾病进行分类方面优于其他三种DL模型。Vgg-19 + CNN模型的准确率达到99.45%。四种提出的深度学习分类器的结果也与最近最先进的分类器进行了比较,提出的Vgg-19 + CNN模型在提高准确率方面表现更好。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Complex & Intelligent Systems
Complex & Intelligent Systems COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE-
CiteScore
9.60
自引率
10.30%
发文量
297
期刊介绍: Complex & Intelligent Systems aims to provide a forum for presenting and discussing novel approaches, tools and techniques meant for attaining a cross-fertilization between the broad fields of complex systems, computational simulation, and intelligent analytics and visualization. The transdisciplinary research that the journal focuses on will expand the boundaries of our understanding by investigating the principles and processes that underlie many of the most profound problems facing society today.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信