{"title":"A lightweight convolutional neural network super-resolution method to improve the quality of target image in space measurement tasks","authors":"Bingzan Liu , Yizhen Yang , Hongyu Chen","doi":"10.1016/j.measurement.2024.116242","DOIUrl":null,"url":null,"abstract":"<div><div>With the rapid advancement of space technology, space target observation images have become an essential tool for the precise measurement and shape analysis of spacecraft. However, due to the challenging conditions of the space environment, these images often suffer from blurring and distortion, which hampers the effectiveness of spacecraft observation and measurement missions. Although recent progress has been made in super-resolution reconstruction techniques, the limited processing capacity of on-board equipment prevents the direct deployment of these high-complexity methods. In this paper, we propose an efficient and lightweight super-resolution reconstruction algorithm called the Pyramid Frequency-Aware Network for space target observation images. Specifically, we use a divide-and-conquer strategy to separately process low-frequency and high-frequency features, ensuring high-quality feature extraction while reducing the number of parameters. To further improve the model’s ability to capture edge and detailed texture information, we introduce a pyramidal wavelet decomposition and a multi-scale large separable kernel attention model. For high-frequency information, we design an enhanced fusion convolution block that facilitates multi-scale feature extraction and channel mixing. Furthermore, we have established a dataset of space target observation images, which can serve as a valuable reference for future studies on the reconstruction of such images. Extensive experimental results demonstrate that our Pyramid Frequency-Aware Network achieves an excellent balance between peak signal-to-noise ratio, structural similarity index, number of parameters, flops, and running time, both on public standard datasets and our self-built space target observation image dataset. Additionally, the network is lightweight enough to be deployed on resource-constrained equipment, such as satellites.</div></div>","PeriodicalId":18349,"journal":{"name":"Measurement","volume":"242 ","pages":"Article 116242"},"PeriodicalIF":5.2000,"publicationDate":"2024-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Measurement","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0263224124021274","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
With the rapid advancement of space technology, space target observation images have become an essential tool for the precise measurement and shape analysis of spacecraft. However, due to the challenging conditions of the space environment, these images often suffer from blurring and distortion, which hampers the effectiveness of spacecraft observation and measurement missions. Although recent progress has been made in super-resolution reconstruction techniques, the limited processing capacity of on-board equipment prevents the direct deployment of these high-complexity methods. In this paper, we propose an efficient and lightweight super-resolution reconstruction algorithm called the Pyramid Frequency-Aware Network for space target observation images. Specifically, we use a divide-and-conquer strategy to separately process low-frequency and high-frequency features, ensuring high-quality feature extraction while reducing the number of parameters. To further improve the model’s ability to capture edge and detailed texture information, we introduce a pyramidal wavelet decomposition and a multi-scale large separable kernel attention model. For high-frequency information, we design an enhanced fusion convolution block that facilitates multi-scale feature extraction and channel mixing. Furthermore, we have established a dataset of space target observation images, which can serve as a valuable reference for future studies on the reconstruction of such images. Extensive experimental results demonstrate that our Pyramid Frequency-Aware Network achieves an excellent balance between peak signal-to-noise ratio, structural similarity index, number of parameters, flops, and running time, both on public standard datasets and our self-built space target observation image dataset. Additionally, the network is lightweight enough to be deployed on resource-constrained equipment, such as satellites.
期刊介绍:
Contributions are invited on novel achievements in all fields of measurement and instrumentation science and technology. Authors are encouraged to submit novel material, whose ultimate goal is an advancement in the state of the art of: measurement and metrology fundamentals, sensors, measurement instruments, measurement and estimation techniques, measurement data processing and fusion algorithms, evaluation procedures and methodologies for plants and industrial processes, performance analysis of systems, processes and algorithms, mathematical models for measurement-oriented purposes, distributed measurement systems in a connected world.