Hierarchical contrastive learning and color standardization for single image sand-dust removal

IF 3.7 4区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
{"title":"Hierarchical contrastive learning and color standardization for single image sand-dust removal","authors":"","doi":"10.1007/s10044-024-01231-w","DOIUrl":null,"url":null,"abstract":"<h3>Abstract</h3> <p>Convolutional neural networks (CNN) have demonstrated impressive performance in reconstructing images in challenging environments. However, there is still a blank in the field of CNN-based sandstorm image processing. Existing sandstorm removal algorithms enhance degraded images by using prior knowledge, but often fail to address the issues of color cast, low contrast, and poor recognizability. To bridge the gap, we present a novel end-to-end sand-dust reconstruction network and incorporate hierarchical contrastive regularization and color constraint in the network. Based on contrastive learning, the hierarchical contrastive regularization reconstructs the sand-free image by pulling it closer to ’positive’ pairs while pushing it away from ’negative’ pairs in representation space. Furthermore, considering the specific characteristics of sandstorm images, we introduce the color constraint term as a sub-loss function to balance the hue, saturation, and value of the reconstructed image. Experimental results show that the proposed SdR-Net outperforms state-of-the-arts in both quantitative and qualitative.</p>","PeriodicalId":54639,"journal":{"name":"Pattern Analysis and Applications","volume":"10 1","pages":""},"PeriodicalIF":3.7000,"publicationDate":"2024-02-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pattern Analysis and Applications","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s10044-024-01231-w","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Convolutional neural networks (CNN) have demonstrated impressive performance in reconstructing images in challenging environments. However, there is still a blank in the field of CNN-based sandstorm image processing. Existing sandstorm removal algorithms enhance degraded images by using prior knowledge, but often fail to address the issues of color cast, low contrast, and poor recognizability. To bridge the gap, we present a novel end-to-end sand-dust reconstruction network and incorporate hierarchical contrastive regularization and color constraint in the network. Based on contrastive learning, the hierarchical contrastive regularization reconstructs the sand-free image by pulling it closer to ’positive’ pairs while pushing it away from ’negative’ pairs in representation space. Furthermore, considering the specific characteristics of sandstorm images, we introduce the color constraint term as a sub-loss function to balance the hue, saturation, and value of the reconstructed image. Experimental results show that the proposed SdR-Net outperforms state-of-the-arts in both quantitative and qualitative.

用于单幅图像除沙尘的分层对比学习和色彩标准化
摘要 卷积神经网络(CNN)在具有挑战性的环境中重建图像方面表现出令人印象深刻的性能。然而,基于 CNN 的沙尘暴图像处理领域仍是空白。现有的沙尘暴去除算法通过利用先验知识来增强退化图像,但往往无法解决偏色、对比度低和可识别性差等问题。为了弥补这一缺陷,我们提出了一种新型端到端沙尘重建网络,并在网络中加入了分层对比正则化和色彩约束。基于对比学习,分层对比正则化通过在表示空间中拉近 "正 "图像对,同时推远 "负 "图像对,来重建无沙尘图像。此外,考虑到沙尘暴图像的特殊性,我们引入了颜色约束项作为子损失函数,以平衡重建图像的色调、饱和度和值。实验结果表明,所提出的 SdR-Net 在定量和定性方面都优于同行。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Pattern Analysis and Applications
Pattern Analysis and Applications 工程技术-计算机:人工智能
CiteScore
7.40
自引率
2.60%
发文量
76
审稿时长
13.5 months
期刊介绍: The journal publishes high quality articles in areas of fundamental research in intelligent pattern analysis and applications in computer science and engineering. It aims to provide a forum for original research which describes novel pattern analysis techniques and industrial applications of the current technology. In addition, the journal will also publish articles on pattern analysis applications in medical imaging. The journal solicits articles that detail new technology and methods for pattern recognition and analysis in applied domains including, but not limited to, computer vision and image processing, speech analysis, robotics, multimedia, document analysis, character recognition, knowledge engineering for pattern recognition, fractal analysis, and intelligent control. The journal publishes articles on the use of advanced pattern recognition and analysis methods including statistical techniques, neural networks, genetic algorithms, fuzzy pattern recognition, machine learning, and hardware implementations which are either relevant to the development of pattern analysis as a research area or detail novel pattern analysis applications. Papers proposing new classifier systems or their development, pattern analysis systems for real-time applications, fuzzy and temporal pattern recognition and uncertainty management in applied pattern recognition are particularly solicited.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信