A Novel Composite Network Based on Parallel Dual Attention for Underwater Image Enhancement

IF 3.4 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS
Jie Liu;Li Cao;He Deng
{"title":"A Novel Composite Network Based on Parallel Dual Attention for Underwater Image Enhancement","authors":"Jie Liu;Li Cao;He Deng","doi":"10.1109/ACCESS.2024.3474031","DOIUrl":null,"url":null,"abstract":"Due to the absorption and scattering of light by suspended particles, underwater images may suffer from color casts, low contrast, and blurred texture details. Traditional statistics-based and physical model-based methods have improved image quality to some extent, yet they fall short in effectively addressing the complex underwater environment and light conditions. Despite significant improvements in handling complex underwater scenes, existing deep learning-based methods still have limitations in restoring texture details and improving image contrast. To address these issues, a novel composite network is proposed based on parallel dual attention. Firstly, a pair of complementary modules, which consists of a multi-branch color enhancement module and a multi-scale pyramid module, is designed to better extract image features from multiple color channels and multiple scales, respectively. Subsequently, a parallel dual attention module is proposed by combining channel and pixel attention mechanisms to further obtain more useful texture details. Finally, a multi-color space stretch module is used to adaptively increase the contrast of images by adjusting histogram distribution in multiple color spaces. Numerous experiments on public datasets have verified the effectiveness and superiority of our composite network in enhancing different underwater images. Compared with state-of-the-art methods, our method achieves excellent performance on paired datasets in terms of full-reference image quality assessment metrics, and has competitive performance on unpaired datasets as well in terms of reference-free image quality assessment metrics, with minimal computational complexity.","PeriodicalId":13079,"journal":{"name":"IEEE Access","volume":"12 ","pages":"146587-146597"},"PeriodicalIF":3.4000,"publicationDate":"2024-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10705163","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Access","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10705163/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Due to the absorption and scattering of light by suspended particles, underwater images may suffer from color casts, low contrast, and blurred texture details. Traditional statistics-based and physical model-based methods have improved image quality to some extent, yet they fall short in effectively addressing the complex underwater environment and light conditions. Despite significant improvements in handling complex underwater scenes, existing deep learning-based methods still have limitations in restoring texture details and improving image contrast. To address these issues, a novel composite network is proposed based on parallel dual attention. Firstly, a pair of complementary modules, which consists of a multi-branch color enhancement module and a multi-scale pyramid module, is designed to better extract image features from multiple color channels and multiple scales, respectively. Subsequently, a parallel dual attention module is proposed by combining channel and pixel attention mechanisms to further obtain more useful texture details. Finally, a multi-color space stretch module is used to adaptively increase the contrast of images by adjusting histogram distribution in multiple color spaces. Numerous experiments on public datasets have verified the effectiveness and superiority of our composite network in enhancing different underwater images. Compared with state-of-the-art methods, our method achieves excellent performance on paired datasets in terms of full-reference image quality assessment metrics, and has competitive performance on unpaired datasets as well in terms of reference-free image quality assessment metrics, with minimal computational complexity.
基于并行双注意力的新型复合网络,用于水下图像增强
由于悬浮颗粒对光线的吸收和散射,水下图像可能会出现偏色、对比度低和纹理细节模糊等问题。传统的基于统计和物理模型的方法在一定程度上改善了图像质量,但在有效处理复杂的水下环境和光照条件方面仍有不足。尽管现有的基于深度学习的方法在处理复杂水下场景方面有了很大改进,但在恢复纹理细节和改善图像对比度方面仍有局限。为了解决这些问题,我们提出了一种基于并行双注意力的新型复合网络。首先,设计了一对互补模块,由多分支色彩增强模块和多尺度金字塔模块组成,分别从多个色彩通道和多个尺度更好地提取图像特征。随后,通过结合通道和像素关注机制,提出了并行双关注模块,以进一步获取更多有用的纹理细节。最后,利用多色彩空间拉伸模块,通过调整多色彩空间的直方图分布,自适应地提高图像的对比度。在公开数据集上进行的大量实验验证了我们的复合网络在增强不同水下图像方面的有效性和优越性。与最先进的方法相比,就全参考图像质量评估指标而言,我们的方法在配对数据集上取得了优异的性能,就无参考图像质量评估指标而言,我们的方法在非配对数据集上也具有竞争力,而且计算复杂度极低。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Access
IEEE Access COMPUTER SCIENCE, INFORMATION SYSTEMSENGIN-ENGINEERING, ELECTRICAL & ELECTRONIC
CiteScore
9.80
自引率
7.70%
发文量
6673
审稿时长
6 weeks
期刊介绍: IEEE Access® is a multidisciplinary, open access (OA), applications-oriented, all-electronic archival journal that continuously presents the results of original research or development across all of IEEE''s fields of interest. IEEE Access will publish articles that are of high interest to readers, original, technically correct, and clearly presented. Supported by author publication charges (APC), its hallmarks are a rapid peer review and publication process with open access to all readers. Unlike IEEE''s traditional Transactions or Journals, reviews are "binary", in that reviewers will either Accept or Reject an article in the form it is submitted in order to achieve rapid turnaround. Especially encouraged are submissions on: Multidisciplinary topics, or applications-oriented articles and negative results that do not fit within the scope of IEEE''s traditional journals. Practical articles discussing new experiments or measurement techniques, interesting solutions to engineering. Development of new or improved fabrication or manufacturing techniques. Reviews or survey articles of new or evolving fields oriented to assist others in understanding the new area.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信