An underwater image enhancement method based on multi-scale layer decomposition and fusion

IF 3.4 2区 工程技术 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
Jie Yang, Jun Wang
{"title":"An underwater image enhancement method based on multi-scale layer decomposition and fusion","authors":"Jie Yang,&nbsp;Jun Wang","doi":"10.1016/j.sigpro.2024.109690","DOIUrl":null,"url":null,"abstract":"<div><p>High-quality underwater images can intuitively reflect the most realistic underwater conditions, guiding for underwater environmental monitoring and resource exploration strongly. But when factors like light absorption affect underwater optical imaging, it has been found that poor visibility and blurred texture details occur in acquired images, posing challenges for the identification and detection of underwater targets. To obtain natural images, an enhancement algorithm is proposed based on multi-scale layer decomposition and fusion. The algorithm employs different strategies to recover image attenuation information from both local and global perspectives, generating two complementary preprocessed fusion inputs. For fusion input 1, operations are conducted in the RGB color space. Initially, the mean proportion of each color channel is used to identify the attenuated color channel. Then, a local compensation strategy is adaptively applied to restore the pixel intensity of the attenuated color channel. Finally, a statistical color correction method is used to eliminate color cast in the image. Fusion input 2 involves two processing stages. In the Lab color space, the algorithm uses the grayscale information to reduce the deviation in the mean values of channels a and b globally. The local mean information of the component L enhances detail textures. In the RGB color space, linear stretching is applied to correct color deviations. To fuse the structural features of two complementary preprocessed inputs and avoid interference between signals from different layers, the color channels of fused input image are first decomposed into muti-scale structural layers based on structural priors. Then, the image enhancement is achieved through layer-by-layer fusion of the corresponding color channels of the two inputs. By testing and analyzing with the, it was found that the proposed method can improve the clarity of attenuated images in various underwater scenarios of UIEBD and RUIE datasets effectively, enhancing image detail and texture richness, increases contrast, and achieving natural and comfortable visual quality. Compared with the quantitative metrics of 14 other algorithms, the proposed algorithm shows an average score improvement of 10.14, 90.48, and 2.06, respectively, in metrics AG (average gradient), EI (edge intensity), and NIQE (natural image quality evaluator). In the RUIE dataset, it shows an average score improvement of 10.21, 94.76, and 1.86, respectively.</p></div>","PeriodicalId":49523,"journal":{"name":"Signal Processing","volume":"227 ","pages":"Article 109690"},"PeriodicalIF":3.4000,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0165168424003104","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

High-quality underwater images can intuitively reflect the most realistic underwater conditions, guiding for underwater environmental monitoring and resource exploration strongly. But when factors like light absorption affect underwater optical imaging, it has been found that poor visibility and blurred texture details occur in acquired images, posing challenges for the identification and detection of underwater targets. To obtain natural images, an enhancement algorithm is proposed based on multi-scale layer decomposition and fusion. The algorithm employs different strategies to recover image attenuation information from both local and global perspectives, generating two complementary preprocessed fusion inputs. For fusion input 1, operations are conducted in the RGB color space. Initially, the mean proportion of each color channel is used to identify the attenuated color channel. Then, a local compensation strategy is adaptively applied to restore the pixel intensity of the attenuated color channel. Finally, a statistical color correction method is used to eliminate color cast in the image. Fusion input 2 involves two processing stages. In the Lab color space, the algorithm uses the grayscale information to reduce the deviation in the mean values of channels a and b globally. The local mean information of the component L enhances detail textures. In the RGB color space, linear stretching is applied to correct color deviations. To fuse the structural features of two complementary preprocessed inputs and avoid interference between signals from different layers, the color channels of fused input image are first decomposed into muti-scale structural layers based on structural priors. Then, the image enhancement is achieved through layer-by-layer fusion of the corresponding color channels of the two inputs. By testing and analyzing with the, it was found that the proposed method can improve the clarity of attenuated images in various underwater scenarios of UIEBD and RUIE datasets effectively, enhancing image detail and texture richness, increases contrast, and achieving natural and comfortable visual quality. Compared with the quantitative metrics of 14 other algorithms, the proposed algorithm shows an average score improvement of 10.14, 90.48, and 2.06, respectively, in metrics AG (average gradient), EI (edge intensity), and NIQE (natural image quality evaluator). In the RUIE dataset, it shows an average score improvement of 10.21, 94.76, and 1.86, respectively.

基于多尺度层分解和融合的水下图像增强方法
高质量的水下图像可以直观地反映最真实的水下状况,对水下环境监测和资源勘探具有很强的指导意义。但是,当光吸收等因素影响水下光学成像时,就会发现获取的图像能见度低、纹理细节模糊,给水下目标的识别和探测带来挑战。为了获得自然的图像,提出了一种基于多尺度层分解和融合的增强算法。该算法采用不同的策略从局部和全局角度恢复图像衰减信息,生成两个互补的预处理融合输入。对于融合输入 1,操作在 RGB 色彩空间中进行。首先,使用每个颜色通道的平均比例来识别衰减的颜色通道。然后,自适应地应用局部补偿策略来恢复衰减颜色通道的像素强度。最后,使用统计色彩校正方法消除图像中的偏色。融合输入 2 包含两个处理阶段。在 Lab 色彩空间中,该算法使用灰度信息来减少通道 a 和 b 全局平均值的偏差。分量 L 的局部平均值信息增强了细节纹理。在 RGB 色彩空间中,采用线性拉伸来纠正色彩偏差。为了融合两个互补预处理输入的结构特征,避免不同层信号之间的干扰,首先根据结构先验将融合输入图像的彩色通道分解为多尺度结构层。然后,通过逐层融合两个输入的相应颜色通道来实现图像增强。通过测试和分析发现,所提出的方法能有效改善 UIEBD 和 RUIE 数据集中各种水下场景下衰减图像的清晰度,增强图像细节和纹理的丰富度,提高对比度,实现自然舒适的视觉质量。与其他 14 种算法的定量指标相比,所提算法在 AG(平均梯度)、EI(边缘强度)和 NIQE(自然图像质量评价器)指标上的平均得分分别提高了 10.14、90.48 和 2.06 分。在 RUIE 数据集中,该算法的平均得分分别提高了 10.21、94.76 和 1.86。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Signal Processing
Signal Processing 工程技术-工程:电子与电气
CiteScore
9.20
自引率
9.10%
发文量
309
审稿时长
41 days
期刊介绍: Signal Processing incorporates all aspects of the theory and practice of signal processing. It features original research work, tutorial and review articles, and accounts of practical developments. It is intended for a rapid dissemination of knowledge and experience to engineers and scientists working in the research, development or practical application of signal processing. Subject areas covered by the journal include: Signal Theory; Stochastic Processes; Detection and Estimation; Spectral Analysis; Filtering; Signal Processing Systems; Software Developments; Image Processing; Pattern Recognition; Optical Signal Processing; Digital Signal Processing; Multi-dimensional Signal Processing; Communication Signal Processing; Biomedical Signal Processing; Geophysical and Astrophysical Signal Processing; Earth Resources Signal Processing; Acoustic and Vibration Signal Processing; Data Processing; Remote Sensing; Signal Processing Technology; Radar Signal Processing; Sonar Signal Processing; Industrial Applications; New Applications.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信