A lightweight convolutional neural network super-resolution method to improve the quality of target image in space measurement tasks

IF 5.2 2区 工程技术 Q1 ENGINEERING, MULTIDISCIPLINARY
Bingzan Liu , Yizhen Yang , Hongyu Chen
{"title":"A lightweight convolutional neural network super-resolution method to improve the quality of target image in space measurement tasks","authors":"Bingzan Liu ,&nbsp;Yizhen Yang ,&nbsp;Hongyu Chen","doi":"10.1016/j.measurement.2024.116242","DOIUrl":null,"url":null,"abstract":"<div><div>With the rapid advancement of space technology, space target observation images have become an essential tool for the precise measurement and shape analysis of spacecraft. However, due to the challenging conditions of the space environment, these images often suffer from blurring and distortion, which hampers the effectiveness of spacecraft observation and measurement missions. Although recent progress has been made in super-resolution reconstruction techniques, the limited processing capacity of on-board equipment prevents the direct deployment of these high-complexity methods. In this paper, we propose an efficient and lightweight super-resolution reconstruction algorithm called the Pyramid Frequency-Aware Network for space target observation images. Specifically, we use a divide-and-conquer strategy to separately process low-frequency and high-frequency features, ensuring high-quality feature extraction while reducing the number of parameters. To further improve the model’s ability to capture edge and detailed texture information, we introduce a pyramidal wavelet decomposition and a multi-scale large separable kernel attention model. For high-frequency information, we design an enhanced fusion convolution block that facilitates multi-scale feature extraction and channel mixing. Furthermore, we have established a dataset of space target observation images, which can serve as a valuable reference for future studies on the reconstruction of such images. Extensive experimental results demonstrate that our Pyramid Frequency-Aware Network achieves an excellent balance between peak signal-to-noise ratio, structural similarity index, number of parameters, flops, and running time, both on public standard datasets and our self-built space target observation image dataset. Additionally, the network is lightweight enough to be deployed on resource-constrained equipment, such as satellites.</div></div>","PeriodicalId":18349,"journal":{"name":"Measurement","volume":"242 ","pages":"Article 116242"},"PeriodicalIF":5.2000,"publicationDate":"2024-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Measurement","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0263224124021274","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

With the rapid advancement of space technology, space target observation images have become an essential tool for the precise measurement and shape analysis of spacecraft. However, due to the challenging conditions of the space environment, these images often suffer from blurring and distortion, which hampers the effectiveness of spacecraft observation and measurement missions. Although recent progress has been made in super-resolution reconstruction techniques, the limited processing capacity of on-board equipment prevents the direct deployment of these high-complexity methods. In this paper, we propose an efficient and lightweight super-resolution reconstruction algorithm called the Pyramid Frequency-Aware Network for space target observation images. Specifically, we use a divide-and-conquer strategy to separately process low-frequency and high-frequency features, ensuring high-quality feature extraction while reducing the number of parameters. To further improve the model’s ability to capture edge and detailed texture information, we introduce a pyramidal wavelet decomposition and a multi-scale large separable kernel attention model. For high-frequency information, we design an enhanced fusion convolution block that facilitates multi-scale feature extraction and channel mixing. Furthermore, we have established a dataset of space target observation images, which can serve as a valuable reference for future studies on the reconstruction of such images. Extensive experimental results demonstrate that our Pyramid Frequency-Aware Network achieves an excellent balance between peak signal-to-noise ratio, structural similarity index, number of parameters, flops, and running time, both on public standard datasets and our self-built space target observation image dataset. Additionally, the network is lightweight enough to be deployed on resource-constrained equipment, such as satellites.
在空间测量任务中提高目标图像质量的轻量级卷积神经网络超分辨率方法
随着空间技术的飞速发展,空间目标观测图像已成为精确测量和分析航天器形状的重要工具。然而,由于空间环境条件恶劣,这些图像经常会出现模糊和失真现象,从而影响航天器观测和测量任务的效率。虽然最近在超分辨率重建技术方面取得了进展,但由于星载设备的处理能力有限,无法直接使用这些高复杂度方法。在本文中,我们提出了一种高效、轻量级的超分辨率重建算法--金字塔频率感知网络(Pyramid Frequency-Aware Network),用于空间目标观测图像。具体来说,我们采用分而治之的策略分别处理低频和高频特征,在减少参数数量的同时确保高质量的特征提取。为了进一步提高模型捕捉边缘和细节纹理信息的能力,我们引入了金字塔小波分解和多尺度大可分离核注意力模型。针对高频信息,我们设计了一个增强型融合卷积块,以促进多尺度特征提取和通道混合。此外,我们还建立了一个空间目标观测图像数据集,为今后研究此类图像的重建提供了宝贵的参考。广泛的实验结果表明,无论是在公共标准数据集还是自建的太空目标观测图像数据集上,我们的金字塔频率感知网络都在峰值信噪比、结构相似性指数、参数数量、翻转次数和运行时间之间实现了极佳的平衡。此外,该网络非常轻便,可以部署在卫星等资源有限的设备上。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Measurement
Measurement 工程技术-工程:综合
CiteScore
10.20
自引率
12.50%
发文量
1589
审稿时长
12.1 months
期刊介绍: Contributions are invited on novel achievements in all fields of measurement and instrumentation science and technology. Authors are encouraged to submit novel material, whose ultimate goal is an advancement in the state of the art of: measurement and metrology fundamentals, sensors, measurement instruments, measurement and estimation techniques, measurement data processing and fusion algorithms, evaluation procedures and methodologies for plants and industrial processes, performance analysis of systems, processes and algorithms, mathematical models for measurement-oriented purposes, distributed measurement systems in a connected world.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信