MA-MFCNet:基于混合注意力的多尺度图像去重特征校准网络

IF 5.3 3区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Luqiao Li;Zhihua Chen;Lei Dai;Ran Li;Bin Sheng
{"title":"MA-MFCNet:基于混合注意力的多尺度图像去重特征校准网络","authors":"Luqiao Li;Zhihua Chen;Lei Dai;Ran Li;Bin Sheng","doi":"10.1109/TETCI.2024.3382233","DOIUrl":null,"url":null,"abstract":"High-quality clear images are the basis for advanced vision tasks such as target detection and semantic segmentation. This paper proposes an image dehazing algorithm named mixed attention-based multi-scale feature calibration network, aiming at solving the problem of uneven haze distribution in low-quality fuzzy images acquired in foggy environments, which is difficult to remove effectively. Our algorithm adopts a U-shaped structure to extract multi-scale features and deep semantic information. In the encoding module, a mixed attention module is designed to assign different weights to each position in the feature map, focusing on the important information and regions where haze is difficult to be removed in the image. In the decoding module, a self-calibration recovery module is designed to fully integrate different levels of features, calibrate feature information, and restore spatial texture details. Finally, the multi-scale feature information is aggregated by the reconstruction module and accurately mapped into the solution space to obtain a clear image after haze removal. Extensive experiments show that our algorithm outperforms state-of-the-art image dehazing algorithms in various synthetic datasets and real hazy scenes in terms of qualitative and quantitative comparisons, and can effectively remove haze in different scenes and recover images with high quality.","PeriodicalId":13135,"journal":{"name":"IEEE Transactions on Emerging Topics in Computational Intelligence","volume":"8 5","pages":"3408-3421"},"PeriodicalIF":5.3000,"publicationDate":"2024-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"MA-MFCNet: Mixed Attention-Based Multi-Scale Feature Calibration Network for Image Dehazing\",\"authors\":\"Luqiao Li;Zhihua Chen;Lei Dai;Ran Li;Bin Sheng\",\"doi\":\"10.1109/TETCI.2024.3382233\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"High-quality clear images are the basis for advanced vision tasks such as target detection and semantic segmentation. This paper proposes an image dehazing algorithm named mixed attention-based multi-scale feature calibration network, aiming at solving the problem of uneven haze distribution in low-quality fuzzy images acquired in foggy environments, which is difficult to remove effectively. Our algorithm adopts a U-shaped structure to extract multi-scale features and deep semantic information. In the encoding module, a mixed attention module is designed to assign different weights to each position in the feature map, focusing on the important information and regions where haze is difficult to be removed in the image. In the decoding module, a self-calibration recovery module is designed to fully integrate different levels of features, calibrate feature information, and restore spatial texture details. Finally, the multi-scale feature information is aggregated by the reconstruction module and accurately mapped into the solution space to obtain a clear image after haze removal. Extensive experiments show that our algorithm outperforms state-of-the-art image dehazing algorithms in various synthetic datasets and real hazy scenes in terms of qualitative and quantitative comparisons, and can effectively remove haze in different scenes and recover images with high quality.\",\"PeriodicalId\":13135,\"journal\":{\"name\":\"IEEE Transactions on Emerging Topics in Computational Intelligence\",\"volume\":\"8 5\",\"pages\":\"3408-3421\"},\"PeriodicalIF\":5.3000,\"publicationDate\":\"2024-04-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Emerging Topics in Computational Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10496923/\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Emerging Topics in Computational Intelligence","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10496923/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

高质量的清晰图像是目标检测和语义分割等高级视觉任务的基础。本文提出了一种名为 "基于混合注意力的多尺度特征校准网络 "的图像去污算法,旨在解决雾霾环境下获取的低质量模糊图像中雾霾分布不均匀、难以有效去除的问题。我们的算法采用 U 型结构提取多尺度特征和深层语义信息。在编码模块中,设计了一个混合注意力模块,为特征图中的每个位置分配不同的权重,重点关注图像中的重要信息和难以去除雾霾的区域。在解码模块中,设计了一个自校准恢复模块,以充分整合不同层次的特征,校准特征信息,恢复空间纹理细节。最后,多尺度特征信息由重构模块汇总,并精确映射到解算空间,从而获得去除雾霾后的清晰图像。大量实验表明,在各种合成数据集和真实雾霾场景中,我们的算法在定性和定量比较方面都优于最先进的图像去雾霾算法,能有效去除不同场景中的雾霾,恢复出高质量的图像。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
MA-MFCNet: Mixed Attention-Based Multi-Scale Feature Calibration Network for Image Dehazing
High-quality clear images are the basis for advanced vision tasks such as target detection and semantic segmentation. This paper proposes an image dehazing algorithm named mixed attention-based multi-scale feature calibration network, aiming at solving the problem of uneven haze distribution in low-quality fuzzy images acquired in foggy environments, which is difficult to remove effectively. Our algorithm adopts a U-shaped structure to extract multi-scale features and deep semantic information. In the encoding module, a mixed attention module is designed to assign different weights to each position in the feature map, focusing on the important information and regions where haze is difficult to be removed in the image. In the decoding module, a self-calibration recovery module is designed to fully integrate different levels of features, calibrate feature information, and restore spatial texture details. Finally, the multi-scale feature information is aggregated by the reconstruction module and accurately mapped into the solution space to obtain a clear image after haze removal. Extensive experiments show that our algorithm outperforms state-of-the-art image dehazing algorithms in various synthetic datasets and real hazy scenes in terms of qualitative and quantitative comparisons, and can effectively remove haze in different scenes and recover images with high quality.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
10.30
自引率
7.50%
发文量
147
期刊介绍: The IEEE Transactions on Emerging Topics in Computational Intelligence (TETCI) publishes original articles on emerging aspects of computational intelligence, including theory, applications, and surveys. TETCI is an electronics only publication. TETCI publishes six issues per year. Authors are encouraged to submit manuscripts in any emerging topic in computational intelligence, especially nature-inspired computing topics not covered by other IEEE Computational Intelligence Society journals. A few such illustrative examples are glial cell networks, computational neuroscience, Brain Computer Interface, ambient intelligence, non-fuzzy computing with words, artificial life, cultural learning, artificial endocrine networks, social reasoning, artificial hormone networks, computational intelligence for the IoT and Smart-X technologies.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信