Prior-Based Underwater Enhanced Image Quality Assessment Network

IF 3.8 2区 工程技术 Q1 ENGINEERING, CIVIL
Zheyin Wang;Liquan Shen;Zhengyong Wang;Yufei Lin;Jinbo Chen
{"title":"Prior-Based Underwater Enhanced Image Quality Assessment Network","authors":"Zheyin Wang;Liquan Shen;Zhengyong Wang;Yufei Lin;Jinbo Chen","doi":"10.1109/JOE.2024.3351235","DOIUrl":null,"url":null,"abstract":"Underwater images generally suffer from color cast and haze effects due to light attenuation and scattering, which leads to image quality degradation and poor recognition of image content by autonomous machines. Most of the existing enhancement algorithms try to remove these distortions of underwater images but do not perform perfectly. Moreover, there is no quality evaluation metric that can accurately measure the quality of these enhanced results. Thus, accurately evaluating the enhanced image quality is one of the urgent problems to be solved in underwater imaging research. In this article, a prior-based underwater enhanced image quality assessment network is proposed to measure the quality of those enhanced images objectively. First, underwater imaging priors, including object–camera distance map, ambient light, absorption and scattering parameters, surface–object distance, etc., directly affect the degree of color cast and haze effect in underwater images. Since the underwater raw image is available in the image enhancement task, a novel prior estimation network is designed to estimate these prior parameters from underwater raw images and obtain reliable prior information. Second, a novel prior guidance module is designed to guide these prior features to the enhanced image quality assessment network by simulating the underwater physical model. Ultimately, the quality of the enhanced image can be accurately evaluated through the end-to-end network. Furthermore, experiments show that the prior information can make the quality assessment network pay more attention to the content and distortion of the image, so as to evaluate the quality of the enhanced image more accurately. Extensive experiments on authentic data sets demonstrate the superiority of our model against other representative state-of-the-art models in both quantitative and qualitative results.","PeriodicalId":13191,"journal":{"name":"IEEE Journal of Oceanic Engineering","volume":"49 2","pages":"592-605"},"PeriodicalIF":3.8000,"publicationDate":"2024-02-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Oceanic Engineering","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10436665/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CIVIL","Score":null,"Total":0}
引用次数: 0

Abstract

Underwater images generally suffer from color cast and haze effects due to light attenuation and scattering, which leads to image quality degradation and poor recognition of image content by autonomous machines. Most of the existing enhancement algorithms try to remove these distortions of underwater images but do not perform perfectly. Moreover, there is no quality evaluation metric that can accurately measure the quality of these enhanced results. Thus, accurately evaluating the enhanced image quality is one of the urgent problems to be solved in underwater imaging research. In this article, a prior-based underwater enhanced image quality assessment network is proposed to measure the quality of those enhanced images objectively. First, underwater imaging priors, including object–camera distance map, ambient light, absorption and scattering parameters, surface–object distance, etc., directly affect the degree of color cast and haze effect in underwater images. Since the underwater raw image is available in the image enhancement task, a novel prior estimation network is designed to estimate these prior parameters from underwater raw images and obtain reliable prior information. Second, a novel prior guidance module is designed to guide these prior features to the enhanced image quality assessment network by simulating the underwater physical model. Ultimately, the quality of the enhanced image can be accurately evaluated through the end-to-end network. Furthermore, experiments show that the prior information can make the quality assessment network pay more attention to the content and distortion of the image, so as to evaluate the quality of the enhanced image more accurately. Extensive experiments on authentic data sets demonstrate the superiority of our model against other representative state-of-the-art models in both quantitative and qualitative results.
基于先验的水下增强图像质量评估网络
由于光的衰减和散射,水下图像通常会出现偏色和雾度效应,从而导致图像质量下降和自主机器对图像内容的识别能力下降。现有的大多数增强算法都试图消除水下图像的这些失真,但效果并不完美。此外,也没有质量评估指标可以准确衡量这些增强结果的质量。因此,准确评估增强后的图像质量是水下成像研究亟待解决的问题之一。本文提出了一种基于先验的水下增强图像质量评估网络,以客观衡量这些增强图像的质量。首先,水下成像先验包括物体-摄像机距离图、环境光、吸收和散射参数、表面-物体距离等,这些先验直接影响水下图像的偏色程度和雾度效果。由于在图像增强任务中可以获得水下原始图像,因此设计了一种新型的先验估计网络,从水下原始图像中估计这些先验参数,从而获得可靠的先验信息。其次,设计了一个新颖的先验引导模块,通过模拟水下物理模型将这些先验特征引导至增强图像质量评估网络。最终,增强图像的质量可以通过端到端网络得到准确评估。此外,实验表明,先验信息能使质量评估网络更加关注图像的内容和失真,从而更准确地评估增强图像的质量。在真实数据集上进行的大量实验表明,我们的模型在定量和定性结果上都优于其他具有代表性的最先进模型。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Journal of Oceanic Engineering
IEEE Journal of Oceanic Engineering 工程技术-工程:大洋
CiteScore
9.60
自引率
12.20%
发文量
86
审稿时长
12 months
期刊介绍: The IEEE Journal of Oceanic Engineering (ISSN 0364-9059) is the online-only quarterly publication of the IEEE Oceanic Engineering Society (IEEE OES). The scope of the Journal is the field of interest of the IEEE OES, which encompasses all aspects of science, engineering, and technology that address research, development, and operations pertaining to all bodies of water. This includes the creation of new capabilities and technologies from concept design through prototypes, testing, and operational systems to sense, explore, understand, develop, use, and responsibly manage natural resources.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信