用于水下图像增强的多尺度卷积和三分支级联变换器融合框架

IF 3.5 2区 工程技术 Q2 OPTICS
Dan Xiang , Zebin Zhou , Wenlei Yang , Huihua Wang , Pan Gao , Mingming Xiao , Jinwen Zhang , Xing Zhu
{"title":"用于水下图像增强的多尺度卷积和三分支级联变换器融合框架","authors":"Dan Xiang ,&nbsp;Zebin Zhou ,&nbsp;Wenlei Yang ,&nbsp;Huihua Wang ,&nbsp;Pan Gao ,&nbsp;Mingming Xiao ,&nbsp;Jinwen Zhang ,&nbsp;Xing Zhu","doi":"10.1016/j.optlaseng.2024.108640","DOIUrl":null,"url":null,"abstract":"<div><div>Acquiring high-quality underwater images is critical for various marine applications. However, light absorption and scattering problems in underwater environments severely degrade image quality. To address these issues, this study proposes a Fusion Framework with Multi-Scale Convolution and Triple-Branch Cascaded Transformer for Underwater Image Enhancement(FMTformer). This innovative framework incorporates multi-scale convolution and three-branch cascade transformer to enhance underwater images effectively. The FMTformer framework adds in the Multi-Conv Multi-Scale Fusion (MCMF) mechanism, which utilizes a spectrum of convolutional kernels to adeptly extract multi-scale features from both the base and detail layers of the decomposed image. This method ensures the capture of both high- and low-frequency information. Furthermore, this research introduces the Tri-Branch Self-Attention Transformer (TBSAT), designed to get cross-dimensional interactions via its Tri-Branch structure, significantly refines image processing quality. The framework also embedded the Value Reconstruct Cascade Transformer (VRCT), which refines feature map representation through mixed convolution, yielding enriched attention maps. Empirical evidence indicates that FMTformer achieves parity with the state-of-the-art in both subjective and objective evaluation metrics, outperforming extant methodologies.</div></div>","PeriodicalId":49719,"journal":{"name":"Optics and Lasers in Engineering","volume":null,"pages":null},"PeriodicalIF":3.5000,"publicationDate":"2024-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A fusion framework with multi-scale convolution and triple-branch cascaded transformer for underwater image enhancement\",\"authors\":\"Dan Xiang ,&nbsp;Zebin Zhou ,&nbsp;Wenlei Yang ,&nbsp;Huihua Wang ,&nbsp;Pan Gao ,&nbsp;Mingming Xiao ,&nbsp;Jinwen Zhang ,&nbsp;Xing Zhu\",\"doi\":\"10.1016/j.optlaseng.2024.108640\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Acquiring high-quality underwater images is critical for various marine applications. However, light absorption and scattering problems in underwater environments severely degrade image quality. To address these issues, this study proposes a Fusion Framework with Multi-Scale Convolution and Triple-Branch Cascaded Transformer for Underwater Image Enhancement(FMTformer). This innovative framework incorporates multi-scale convolution and three-branch cascade transformer to enhance underwater images effectively. The FMTformer framework adds in the Multi-Conv Multi-Scale Fusion (MCMF) mechanism, which utilizes a spectrum of convolutional kernels to adeptly extract multi-scale features from both the base and detail layers of the decomposed image. This method ensures the capture of both high- and low-frequency information. Furthermore, this research introduces the Tri-Branch Self-Attention Transformer (TBSAT), designed to get cross-dimensional interactions via its Tri-Branch structure, significantly refines image processing quality. The framework also embedded the Value Reconstruct Cascade Transformer (VRCT), which refines feature map representation through mixed convolution, yielding enriched attention maps. Empirical evidence indicates that FMTformer achieves parity with the state-of-the-art in both subjective and objective evaluation metrics, outperforming extant methodologies.</div></div>\",\"PeriodicalId\":49719,\"journal\":{\"name\":\"Optics and Lasers in Engineering\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2024-10-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Optics and Lasers in Engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0143816624006183\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"OPTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics and Lasers in Engineering","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0143816624006183","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OPTICS","Score":null,"Total":0}
引用次数: 0

摘要

获取高质量的水下图像对于各种海洋应用至关重要。然而,水下环境中的光吸收和散射问题会严重降低图像质量。为解决这些问题,本研究提出了一种用于水下图像增强的多尺度卷积和三分支级联变换器融合框架(FMTformer)。这一创新框架融合了多尺度卷积和三分支级联变换器,可有效增强水下图像。FMTformer 框架加入了多卷积多尺度融合(MCMF)机制,该机制利用卷积核频谱从分解图像的基底层和细节层中巧妙地提取多尺度特征。这种方法可确保同时捕获高频和低频信息。此外,这项研究还引入了三分支自关注变换器(TBSAT),旨在通过其三分支结构获得跨维交互,从而显著提高图像处理质量。该框架还嵌入了价值重构级联变换器(VRCT),通过混合卷积来完善特征图表示,从而产生丰富的注意力图。经验证据表明,FMTformer 在主观和客观评价指标上都达到了最先进水平,优于现有方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A fusion framework with multi-scale convolution and triple-branch cascaded transformer for underwater image enhancement
Acquiring high-quality underwater images is critical for various marine applications. However, light absorption and scattering problems in underwater environments severely degrade image quality. To address these issues, this study proposes a Fusion Framework with Multi-Scale Convolution and Triple-Branch Cascaded Transformer for Underwater Image Enhancement(FMTformer). This innovative framework incorporates multi-scale convolution and three-branch cascade transformer to enhance underwater images effectively. The FMTformer framework adds in the Multi-Conv Multi-Scale Fusion (MCMF) mechanism, which utilizes a spectrum of convolutional kernels to adeptly extract multi-scale features from both the base and detail layers of the decomposed image. This method ensures the capture of both high- and low-frequency information. Furthermore, this research introduces the Tri-Branch Self-Attention Transformer (TBSAT), designed to get cross-dimensional interactions via its Tri-Branch structure, significantly refines image processing quality. The framework also embedded the Value Reconstruct Cascade Transformer (VRCT), which refines feature map representation through mixed convolution, yielding enriched attention maps. Empirical evidence indicates that FMTformer achieves parity with the state-of-the-art in both subjective and objective evaluation metrics, outperforming extant methodologies.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Optics and Lasers in Engineering
Optics and Lasers in Engineering 工程技术-光学
CiteScore
8.90
自引率
8.70%
发文量
384
审稿时长
42 days
期刊介绍: Optics and Lasers in Engineering aims at providing an international forum for the interchange of information on the development of optical techniques and laser technology in engineering. Emphasis is placed on contributions targeted at the practical use of methods and devices, the development and enhancement of solutions and new theoretical concepts for experimental methods. Optics and Lasers in Engineering reflects the main areas in which optical methods are being used and developed for an engineering environment. Manuscripts should offer clear evidence of novelty and significance. Papers focusing on parameter optimization or computational issues are not suitable. Similarly, papers focussed on an application rather than the optical method fall outside the journal''s scope. The scope of the journal is defined to include the following: -Optical Metrology- Optical Methods for 3D visualization and virtual engineering- Optical Techniques for Microsystems- Imaging, Microscopy and Adaptive Optics- Computational Imaging- Laser methods in manufacturing- Integrated optical and photonic sensors- Optics and Photonics in Life Science- Hyperspectral and spectroscopic methods- Infrared and Terahertz techniques
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信