MFPWTN:一种用于遥感图像超分辨率的多频并行小波变换网络

IF 1.4 4区 地球科学 Q4 ENVIRONMENTAL SCIENCES
Cong Liu, Changlian Shi
{"title":"MFPWTN:一种用于遥感图像超分辨率的多频并行小波变换网络","authors":"Cong Liu, Changlian Shi","doi":"10.1117/1.jrs.17.046503","DOIUrl":null,"url":null,"abstract":"How to fully capture high-frequency information is an important issue in the remote sensing image super-resolution (SR) task. Most of the existing convolutional neural network based methods usually apply the attention mechanism to capture the high-frequency information. However, it is often insufficient since the remote sensing images usually contain more high-frequency information than natural images. Recently, some studies try to transform the original image into the wavelet domain to capture more high-frequency information. However, we observe that these methods usually apply similar network structures to learn different wavelet components, which will be difficult to fully capture the different features. To solve this issue, we propose a method named multi-frequency parallel wavelet transform network (MFPWTN) for remote sensing image SR. Specifically, we initially design two different network structures to reconstruct the high-frequency and low-frequency wavelet components, which can fully capture the characteristics of different frequencies. Subsequently, we introduce a high-frequency fusion module to enhance the information transmission among different high-frequency wavelet components. In addition, we employ the dilated convolution to establish the network structure for reconstructing the low-frequency wavelet component, which allows us to capture different receptive fields by using relatively few parameters. The experimental results on two public remote sensing datasets, UCMerced-LandUse and NWPU-RESISC45, show that the proposed MFPWTN can get superior performance over many existing state-of-the-art algorithms.","PeriodicalId":54879,"journal":{"name":"Journal of Applied Remote Sensing","volume":"72 10","pages":"0"},"PeriodicalIF":1.4000,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"MFPWTN: a multi-frequency parallel wavelet transform network for remote sensing image super-resolution\",\"authors\":\"Cong Liu, Changlian Shi\",\"doi\":\"10.1117/1.jrs.17.046503\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"How to fully capture high-frequency information is an important issue in the remote sensing image super-resolution (SR) task. Most of the existing convolutional neural network based methods usually apply the attention mechanism to capture the high-frequency information. However, it is often insufficient since the remote sensing images usually contain more high-frequency information than natural images. Recently, some studies try to transform the original image into the wavelet domain to capture more high-frequency information. However, we observe that these methods usually apply similar network structures to learn different wavelet components, which will be difficult to fully capture the different features. To solve this issue, we propose a method named multi-frequency parallel wavelet transform network (MFPWTN) for remote sensing image SR. Specifically, we initially design two different network structures to reconstruct the high-frequency and low-frequency wavelet components, which can fully capture the characteristics of different frequencies. Subsequently, we introduce a high-frequency fusion module to enhance the information transmission among different high-frequency wavelet components. In addition, we employ the dilated convolution to establish the network structure for reconstructing the low-frequency wavelet component, which allows us to capture different receptive fields by using relatively few parameters. The experimental results on two public remote sensing datasets, UCMerced-LandUse and NWPU-RESISC45, show that the proposed MFPWTN can get superior performance over many existing state-of-the-art algorithms.\",\"PeriodicalId\":54879,\"journal\":{\"name\":\"Journal of Applied Remote Sensing\",\"volume\":\"72 10\",\"pages\":\"0\"},\"PeriodicalIF\":1.4000,\"publicationDate\":\"2023-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Applied Remote Sensing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/1.jrs.17.046503\",\"RegionNum\":4,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"ENVIRONMENTAL SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Applied Remote Sensing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/1.jrs.17.046503","RegionNum":4,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENVIRONMENTAL SCIENCES","Score":null,"Total":0}
引用次数: 0

摘要

如何充分捕获高频信息是遥感图像超分辨率任务中的一个重要问题。现有的基于卷积神经网络的方法大多采用注意机制来捕获高频信息。然而,由于遥感图像通常比自然图像包含更多的高频信息,因此往往是不够的。近年来,一些研究尝试将原始图像变换到小波域,以捕获更多的高频信息。然而,我们观察到这些方法通常使用相似的网络结构来学习不同的小波分量,这将很难完全捕获不同的特征。针对这一问题,我们提出了一种遥感图像sr的多频并行小波变换网络(MFPWTN)方法。具体而言,我们初步设计了两种不同的网络结构来重构高频和低频小波分量,可以充分捕捉不同频率的特征。随后,我们引入了高频融合模块来增强不同高频小波分量之间的信息传输。此外,我们采用扩展卷积建立了用于重建低频小波分量的网络结构,这使得我们可以用相对较少的参数捕获不同的接受场。在ucced - landuse和NWPU-RESISC45两个公共遥感数据集上的实验结果表明,所提出的MFPWTN比许多现有的最先进算法具有更好的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
MFPWTN: a multi-frequency parallel wavelet transform network for remote sensing image super-resolution
How to fully capture high-frequency information is an important issue in the remote sensing image super-resolution (SR) task. Most of the existing convolutional neural network based methods usually apply the attention mechanism to capture the high-frequency information. However, it is often insufficient since the remote sensing images usually contain more high-frequency information than natural images. Recently, some studies try to transform the original image into the wavelet domain to capture more high-frequency information. However, we observe that these methods usually apply similar network structures to learn different wavelet components, which will be difficult to fully capture the different features. To solve this issue, we propose a method named multi-frequency parallel wavelet transform network (MFPWTN) for remote sensing image SR. Specifically, we initially design two different network structures to reconstruct the high-frequency and low-frequency wavelet components, which can fully capture the characteristics of different frequencies. Subsequently, we introduce a high-frequency fusion module to enhance the information transmission among different high-frequency wavelet components. In addition, we employ the dilated convolution to establish the network structure for reconstructing the low-frequency wavelet component, which allows us to capture different receptive fields by using relatively few parameters. The experimental results on two public remote sensing datasets, UCMerced-LandUse and NWPU-RESISC45, show that the proposed MFPWTN can get superior performance over many existing state-of-the-art algorithms.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Applied Remote Sensing
Journal of Applied Remote Sensing 环境科学-成像科学与照相技术
CiteScore
3.40
自引率
11.80%
发文量
194
审稿时长
3 months
期刊介绍: The Journal of Applied Remote Sensing is a peer-reviewed journal that optimizes the communication of concepts, information, and progress among the remote sensing community.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信