Multi View Image Fusion Using Ensemble Deep Learning Algorithm for Mri and CT Images

IF 1.8 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
N. Thenmoezhi, B. Perumal, A. Lakshmi
{"title":"Multi View Image Fusion Using Ensemble Deep Learning Algorithm for Mri and CT Images","authors":"N. Thenmoezhi, B. Perumal, A. Lakshmi","doi":"10.1145/3640811","DOIUrl":null,"url":null,"abstract":"<p>Medical image fusions are crucial elements in image based health care diagnostics or therapies, and generically applications of computer visions. However, majority of existing methods suffer from noise distortion that affect the overall output. When pictures are distorted by noises, classical fusion techniques perform badly. Hence, fusion techniques that properly maintain information comprehensively from multiple faulty pictures need to be created. This work presents ESLOs (Enhanced Lion Swarm Optimizations) with EDL (Ensemble Deep Learning) to address the aforementioned issues. The primary steps in this study include image fusions, segmentation, noise reduction, feature extraction, picture classification, and feature selection.AMFs (Adaptive Median Filters) are first used for noise removal in sequence to enhance image quality by eliminating noises. The MRIs and CTS images are then segmented using the RKMC algorithm to separate the images into their component regions or objects. Images in black and white are divided into image. In the white image, the RKMC algorithm successfully considered the earlier tumour probability. The next step is feature extraction, which is accomplished by using the MPCA (Modified Principal Component Analysis) to draw out the most informative aspects of the images. Then, ELSOs algorithm is applied for optimal feature selection which is computed by best fitness values. After that, multi view image fusions of multi modal images derive lower, middle and higher level images contents. It is done by using DCNNs (Deep Convolution Neural Networks) and TAcGANs (Tissue-Aware conditional Generative Adversarial Networks) algorithm which fuses the multi view features and relevant image features and it is used for real time applications. The results of this study implies that proposed ELSO+EDL algorithm results in better performances in terms of higher values of accuracies, PSNR and lower RMSE, MAPE with faster executions when compared to other existing algorithms.</p>","PeriodicalId":54312,"journal":{"name":"ACM Transactions on Asian and Low-Resource Language Information Processing","volume":"283 1","pages":""},"PeriodicalIF":1.8000,"publicationDate":"2024-01-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACM Transactions on Asian and Low-Resource Language Information Processing","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1145/3640811","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Medical image fusions are crucial elements in image based health care diagnostics or therapies, and generically applications of computer visions. However, majority of existing methods suffer from noise distortion that affect the overall output. When pictures are distorted by noises, classical fusion techniques perform badly. Hence, fusion techniques that properly maintain information comprehensively from multiple faulty pictures need to be created. This work presents ESLOs (Enhanced Lion Swarm Optimizations) with EDL (Ensemble Deep Learning) to address the aforementioned issues. The primary steps in this study include image fusions, segmentation, noise reduction, feature extraction, picture classification, and feature selection.AMFs (Adaptive Median Filters) are first used for noise removal in sequence to enhance image quality by eliminating noises. The MRIs and CTS images are then segmented using the RKMC algorithm to separate the images into their component regions or objects. Images in black and white are divided into image. In the white image, the RKMC algorithm successfully considered the earlier tumour probability. The next step is feature extraction, which is accomplished by using the MPCA (Modified Principal Component Analysis) to draw out the most informative aspects of the images. Then, ELSOs algorithm is applied for optimal feature selection which is computed by best fitness values. After that, multi view image fusions of multi modal images derive lower, middle and higher level images contents. It is done by using DCNNs (Deep Convolution Neural Networks) and TAcGANs (Tissue-Aware conditional Generative Adversarial Networks) algorithm which fuses the multi view features and relevant image features and it is used for real time applications. The results of this study implies that proposed ELSO+EDL algorithm results in better performances in terms of higher values of accuracies, PSNR and lower RMSE, MAPE with faster executions when compared to other existing algorithms.

利用集合深度学习算法实现 Mri 和 CT 图像的多视图图像融合
医学图像融合是基于图像的保健诊断或治疗以及计算机视觉应用的关键要素。然而,现有的大多数方法都存在噪声失真问题,影响了整体输出效果。当图片被噪声扭曲时,传统的融合技术就会表现不佳。因此,需要创建能从多张有问题的图片中全面适当地保留信息的融合技术。本作品提出了 ESLOs(增强型狮群优化)与 EDL(集合深度学习)来解决上述问题。本研究的主要步骤包括图像融合、分割、降噪、特征提取、图片分类和特征选择。首先使用 AMF(自适应中值滤波器)依次去除噪声,通过消除噪声来提高图像质量。然后使用 RKMC 算法对 MRI 和 CTS 图像进行分割,将图像分成不同的区域或对象。图像分为黑白两色。在白色图像中,RKMC 算法成功地考虑了早期肿瘤的概率。下一步是特征提取,通过使用 MPCA(修正主成分分析)来提取图像中信息量最大的部分。然后,应用 ELSOs 算法进行最佳特征选择,该算法由最佳适配值计算得出。然后,对多模态图像进行多视图图像融合,得出低层、中层和高层图像内容。这是通过使用 DCNNs(深度卷积神经网络)和 TAcGANs(组织感知条件生成对抗网络)算法完成的,该算法将多视图特征和相关图像特征融合在一起,并用于实时应用。这项研究的结果表明,与其他现有算法相比,拟议的 ELSO+EDL 算法在更高的精确度、PSNR 值和更低的 RMSE、MAPE 方面性能更好,执行速度更快。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
3.60
自引率
15.00%
发文量
241
期刊介绍: The ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) publishes high quality original archival papers and technical notes in the areas of computation and processing of information in Asian languages, low-resource languages of Africa, Australasia, Oceania and the Americas, as well as related disciplines. The subject areas covered by TALLIP include, but are not limited to: -Computational Linguistics: including computational phonology, computational morphology, computational syntax (e.g. parsing), computational semantics, computational pragmatics, etc. -Linguistic Resources: including computational lexicography, terminology, electronic dictionaries, cross-lingual dictionaries, electronic thesauri, etc. -Hardware and software algorithms and tools for Asian or low-resource language processing, e.g., handwritten character recognition. -Information Understanding: including text understanding, speech understanding, character recognition, discourse processing, dialogue systems, etc. -Machine Translation involving Asian or low-resource languages. -Information Retrieval: including natural language processing (NLP) for concept-based indexing, natural language query interfaces, semantic relevance judgments, etc. -Information Extraction and Filtering: including automatic abstraction, user profiling, etc. -Speech processing: including text-to-speech synthesis and automatic speech recognition. -Multimedia Asian Information Processing: including speech, image, video, image/text translation, etc. -Cross-lingual information processing involving Asian or low-resource languages. -Papers that deal in theory, systems design, evaluation and applications in the aforesaid subjects are appropriate for TALLIP. Emphasis will be placed on the originality and the practical significance of the reported research.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信