Lightweight remote sensing super-resolution with multi-scale graph attention network

IF 7.5 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Yu Wang , Zhenfeng Shao , Tao Lu , Xiao Huang , Jiaming Wang , Zhizheng Zhang , Xiaolong Zuo
{"title":"Lightweight remote sensing super-resolution with multi-scale graph attention network","authors":"Yu Wang ,&nbsp;Zhenfeng Shao ,&nbsp;Tao Lu ,&nbsp;Xiao Huang ,&nbsp;Jiaming Wang ,&nbsp;Zhizheng Zhang ,&nbsp;Xiaolong Zuo","doi":"10.1016/j.patcog.2024.111178","DOIUrl":null,"url":null,"abstract":"<div><div>Remote Sensing Super-Resolution (RS-SR) constitutes a pivotal component in the domain of remote sensing image analysis, aimed at enhancing the spatial resolution of low-resolution imagery. Recent advancements have seen deep learning techniques achieving substantial progress in the RS-SR field. Notably, Graph Neural Networks (GNNs) have emerged as a potent mechanism for processing remote sensing images, adept at elucidating the intricate inter-pixel relationships within images. Nevertheless, a prevalent limitation among existing GNN-based methodologies is their disregard for the high computational demands, which circumscribes their applicability in environments with limited computational resources. This paper introduces a streamlined RS-SR framework, leveraging a Multi-Scale Graph Attention Network (MSGAN), designed to effectively balance computational efficiency with high performance. The core of MSGAN is a novel multi-scale graph attention module, integrating graph attention block and multi-scale lattice block structures, engineered to comprehensively assimilate both localized and extensive spatial information in remote sensing images. This enhances the framework’s overall efficacy and resilience in RS-SR tasks. Comparative experimental analyses demonstrate that MSGAN delivers competitive results against state-of-the-art methods while reducing parameter count and computational overhead, presenting a promising avenue for deployment in scenarios with limited computational resources.</div></div>","PeriodicalId":49713,"journal":{"name":"Pattern Recognition","volume":"160 ","pages":"Article 111178"},"PeriodicalIF":7.5000,"publicationDate":"2024-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pattern Recognition","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0031320324009294","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Remote Sensing Super-Resolution (RS-SR) constitutes a pivotal component in the domain of remote sensing image analysis, aimed at enhancing the spatial resolution of low-resolution imagery. Recent advancements have seen deep learning techniques achieving substantial progress in the RS-SR field. Notably, Graph Neural Networks (GNNs) have emerged as a potent mechanism for processing remote sensing images, adept at elucidating the intricate inter-pixel relationships within images. Nevertheless, a prevalent limitation among existing GNN-based methodologies is their disregard for the high computational demands, which circumscribes their applicability in environments with limited computational resources. This paper introduces a streamlined RS-SR framework, leveraging a Multi-Scale Graph Attention Network (MSGAN), designed to effectively balance computational efficiency with high performance. The core of MSGAN is a novel multi-scale graph attention module, integrating graph attention block and multi-scale lattice block structures, engineered to comprehensively assimilate both localized and extensive spatial information in remote sensing images. This enhances the framework’s overall efficacy and resilience in RS-SR tasks. Comparative experimental analyses demonstrate that MSGAN delivers competitive results against state-of-the-art methods while reducing parameter count and computational overhead, presenting a promising avenue for deployment in scenarios with limited computational resources.
利用多尺度图注意网络实现轻量级遥感超分辨率
遥感超分辨率(RS-SR)是遥感图像分析领域的重要组成部分,旨在提高低分辨率图像的空间分辨率。近年来,深度学习技术在 RS-SR 领域取得了长足的进步。值得注意的是,图神经网络(GNN)已成为处理遥感图像的有效机制,善于阐明图像中错综复杂的像素间关系。然而,现有的基于 GNN 的方法普遍存在一个局限性,即不考虑高计算需求,这限制了它们在计算资源有限的环境中的适用性。本文利用多尺度图注意网络(MSGAN)引入了一个简化的 RS-SR 框架,旨在有效平衡计算效率和高性能。MSGAN 的核心是一个新颖的多尺度图注意模块,集成了图注意块和多尺度网格块结构,旨在全面吸收遥感图像中的局部和广泛空间信息。这增强了该框架在 RS-SR 任务中的整体效率和弹性。对比实验分析表明,与最先进的方法相比,MSGAN 在减少参数数量和计算开销的同时,还提供了具有竞争力的结果,为在计算资源有限的场景中进行部署提供了广阔的前景。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Pattern Recognition
Pattern Recognition 工程技术-工程:电子与电气
CiteScore
14.40
自引率
16.20%
发文量
683
审稿时长
5.6 months
期刊介绍: The field of Pattern Recognition is both mature and rapidly evolving, playing a crucial role in various related fields such as computer vision, image processing, text analysis, and neural networks. It closely intersects with machine learning and is being applied in emerging areas like biometrics, bioinformatics, multimedia data analysis, and data science. The journal Pattern Recognition, established half a century ago during the early days of computer science, has since grown significantly in scope and influence.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信