COVID-19 Detection Using Multimodal and Multi-model Ensemble Based Deep Learning Technique

G. Fahmy, Emad Abd-Elrahman, M. Zorkany
{"title":"COVID-19 Detection Using Multimodal and Multi-model Ensemble Based Deep Learning Technique","authors":"G. Fahmy, Emad Abd-Elrahman, M. Zorkany","doi":"10.1109/NRSC57219.2022.9971179","DOIUrl":null,"url":null,"abstract":"COVID-19 is a fatal disease that threatens the people’s health worldwide in the last few years. Although the testing techniques for COVID-19 had become more widespread, they still lack the speed and accuracy of disease pattern detection. Thanks to Artificial Intelligence (AI) as it can accelerate the detection process by deep learning techniques that can be used to achieve high performance in COVID-19 identification. Many types of Convolutional Neural Networks (CNN) as the most image classification deep learning techniques are used for automatically diagnosing this disease using X-ray or Computerized Tomography (CT-scan) medical images. The individual CNN types can obtain good results with a specific type of images like X-ray or CT-scan images in a certain dataset but, it could not give the same quality for other types of images or datasets. Through this paper, multiple standards model and custom CNN model have been merged using ensemble method to enhance the overall performance, while the accuracy of each model is a parameter in majority voting. Consequently, the proposed method will started with an initial simple classifier to classify between X-ray image and CT-image then followed by the ensemble model, and lasted by the decision making algorithm. Using different image types like X-ray and CT-scan images from different dataset sources enhance the overall performance as will be cleared in our results. The proposed model has three main parts: Multimodal imaging data, Multi-model based CNN structure, and decision-making diffusion based on the Multi-model output part. The main objective of using multiple models or multiple algorithms in detecting COVID-19 is to decrease the error percentage and increase the validation accuracy. Testing and validation results assure that the performance of the proposed method for COVID-19 chest X-rays and CT-scan images outperforms the individual and classical CNN learners’ design.","PeriodicalId":156721,"journal":{"name":"2022 39th National Radio Science Conference (NRSC)","volume":"41 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 39th National Radio Science Conference (NRSC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/NRSC57219.2022.9971179","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

COVID-19 is a fatal disease that threatens the people’s health worldwide in the last few years. Although the testing techniques for COVID-19 had become more widespread, they still lack the speed and accuracy of disease pattern detection. Thanks to Artificial Intelligence (AI) as it can accelerate the detection process by deep learning techniques that can be used to achieve high performance in COVID-19 identification. Many types of Convolutional Neural Networks (CNN) as the most image classification deep learning techniques are used for automatically diagnosing this disease using X-ray or Computerized Tomography (CT-scan) medical images. The individual CNN types can obtain good results with a specific type of images like X-ray or CT-scan images in a certain dataset but, it could not give the same quality for other types of images or datasets. Through this paper, multiple standards model and custom CNN model have been merged using ensemble method to enhance the overall performance, while the accuracy of each model is a parameter in majority voting. Consequently, the proposed method will started with an initial simple classifier to classify between X-ray image and CT-image then followed by the ensemble model, and lasted by the decision making algorithm. Using different image types like X-ray and CT-scan images from different dataset sources enhance the overall performance as will be cleared in our results. The proposed model has three main parts: Multimodal imaging data, Multi-model based CNN structure, and decision-making diffusion based on the Multi-model output part. The main objective of using multiple models or multiple algorithms in detecting COVID-19 is to decrease the error percentage and increase the validation accuracy. Testing and validation results assure that the performance of the proposed method for COVID-19 chest X-rays and CT-scan images outperforms the individual and classical CNN learners’ design.
基于多模态和多模型集成的深度学习技术的COVID-19检测
COVID-19是近年来威胁全球人民健康的致命疾病。尽管COVID-19的检测技术已经变得更加普遍,但它们仍然缺乏疾病模式检测的速度和准确性。这要归功于人工智能(AI),因为它可以通过深度学习技术加快检测过程,从而在COVID-19识别中实现高性能。许多类型的卷积神经网络(CNN)作为大多数图像分类深度学习技术被用于使用x射线或计算机断层扫描(ct扫描)医学图像自动诊断该疾病。单个CNN类型对于特定类型的图像(如x射线或ct扫描图像)在某个数据集中可以获得良好的效果,但对于其他类型的图像或数据集则不能给出相同的质量。本文采用集成方法将多个标准模型和自定义CNN模型进行合并,以提高整体性能,同时每个模型的准确率作为多数投票中的一个参数。因此,该方法将从一个初始的简单分类器开始对x射线图像和ct图像进行分类,然后是集成模型,最后是决策算法。使用不同的图像类型,如来自不同数据集来源的x射线和ct扫描图像,可以增强整体性能,这将在我们的结果中得到证明。该模型包括三个主要部分:多模态成像数据、基于多模型的CNN结构和基于多模型输出部分的决策扩散。采用多模型或多算法检测COVID-19的主要目的是降低错误率,提高验证精度。测试和验证结果确保所提出的方法在COVID-19胸部x射线和ct扫描图像上的性能优于个人和经典CNN学习器设计。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信