Hyperspectral Image Residual Denoising Network Based on Mixed-Domain Attention Mechanism

Huan Yang, Juan Xu, Kunhua Liu, Xinyu Lin
{"title":"Hyperspectral Image Residual Denoising Network Based on Mixed-Domain Attention Mechanism","authors":"Huan Yang, Juan Xu, Kunhua Liu, Xinyu Lin","doi":"10.1145/3577117.3577137","DOIUrl":null,"url":null,"abstract":"Hyperspectral images (HSIs) contain not only spatial information, but also detail information on spectrum that reflects the internal features of objects, which can be used to monitor crop growth, for example. It is noteworthy that noises are inevitably introduced in the obtained HSIs due to the imperfection of imaging equipment and data transmission process, which will probably lead to misjudging the species of objects. Currently, HSIs-denoising methods based on deep learning have received considerable amount of attention and achieved promising results. However, these methods did not consider the interdependence among the three domains of HSIs. Based on this, we present a mixed-domain attention-based residual denoising network (for short named MA-RDN), so as to better the noises suppression by taking all the three domains into consideration. Different from existing methods, we introduce a mixed-domain attention module, which consists of three branches, respectively modeling the correlation between two of the domains. In this way, the model is guided to simultaneously focus on all the cross-domain features that are influential in denoising tasks. We take the average value of the three branches as the module's output. Then, a sparse feature extraction subnetwork is designed to preserve spatial-spectral features of HSIs as many as possible, which contains several multiscale structures and channel attentions. In order to avoid the gradient disappearance and model degradation caused by the deepening of the network, we utilize two weighted skip connections in the output. Simulation experiments show that, in different noise conditions, the peak signal-to-noise ratio PSNR of our method is increased of about 1.6 that compared with the Cao et al's GRN [11] method, and the structural similarity SSIM is slightly better than it.","PeriodicalId":309874,"journal":{"name":"Proceedings of the 6th International Conference on Advances in Image Processing","volume":"11 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 6th International Conference on Advances in Image Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3577117.3577137","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Hyperspectral images (HSIs) contain not only spatial information, but also detail information on spectrum that reflects the internal features of objects, which can be used to monitor crop growth, for example. It is noteworthy that noises are inevitably introduced in the obtained HSIs due to the imperfection of imaging equipment and data transmission process, which will probably lead to misjudging the species of objects. Currently, HSIs-denoising methods based on deep learning have received considerable amount of attention and achieved promising results. However, these methods did not consider the interdependence among the three domains of HSIs. Based on this, we present a mixed-domain attention-based residual denoising network (for short named MA-RDN), so as to better the noises suppression by taking all the three domains into consideration. Different from existing methods, we introduce a mixed-domain attention module, which consists of three branches, respectively modeling the correlation between two of the domains. In this way, the model is guided to simultaneously focus on all the cross-domain features that are influential in denoising tasks. We take the average value of the three branches as the module's output. Then, a sparse feature extraction subnetwork is designed to preserve spatial-spectral features of HSIs as many as possible, which contains several multiscale structures and channel attentions. In order to avoid the gradient disappearance and model degradation caused by the deepening of the network, we utilize two weighted skip connections in the output. Simulation experiments show that, in different noise conditions, the peak signal-to-noise ratio PSNR of our method is increased of about 1.6 that compared with the Cao et al's GRN [11] method, and the structural similarity SSIM is slightly better than it.
基于混合域注意机制的高光谱图像残差去噪网络
高光谱图像(hsi)不仅包含空间信息,还包含反映物体内部特征的光谱细节信息,例如可用于监测作物生长。值得注意的是,由于成像设备和数据传输过程的不完善,在得到的hsi中不可避免地会引入噪声,这可能会导致对物体种类的错误判断。目前,基于深度学习的hsis去噪方法得到了相当多的关注,并取得了良好的效果。然而,这些方法没有考虑hsi三个领域之间的相互依存关系。在此基础上,我们提出了一种混合域的基于注意的残差去噪网络(简称MA-RDN),以更好地兼顾三个域的噪声抑制。与现有方法不同,我们引入了一个混合领域关注模块,该模块由三个分支组成,分别对两个领域之间的相关性进行建模。这样,可以引导模型同时关注对去噪任务有影响的所有跨域特征。我们取三个支路的平均值作为模块的输出。然后,设计一个稀疏特征提取子网络,尽可能多地保留hsi的空间光谱特征,该子网络包含多个多尺度结构和信道关注;为了避免网络深度加深导致的梯度消失和模型退化,我们在输出中使用了两个加权跳跃连接。仿真实验表明,在不同噪声条件下,本文方法的峰值信噪比PSNR比Cao等人的GRN[11]方法提高了1.6左右,结构相似度SSIM略好于曹等人的GRN[11]方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信