Yan Dong, Zhenping Qiang, Jiayan Yang, Yunfang Cai, Qingyang Chen, Jia Cao
{"title":"基于神经网络的新型真空太阳望远镜光谱数据压缩","authors":"Yan Dong, Zhenping Qiang, Jiayan Yang, Yunfang Cai, Qingyang Chen, Jia Cao","doi":"10.1007/s11207-025-02447-7","DOIUrl":null,"url":null,"abstract":"<div><p>Due to the rapid increase in spectral data generation as well as storage and transmission constraints, data compression has become particularly important for the New Vacuum Solar Telescope (NVST) at Yunnan Observatory. In this paper, we present a method for compressing NVST Ca II (8542 Å) spectral data based on a Convolutional Variational Autoencoder (VAE). Our results show that the compression ratios of the VAE-based approach may achieve as high as 107, while keeping the error between the decompressed data and the original data within the inherent error range of the raw data. This is much better than the appropriate compression ratio of 30 that is attained using the current PCA-based approach. Furthermore, the stability of the VAE approach is demonstrated by the almost constant differences between the VAE-compressed data and the raw data when the compression ratio ranges from 8 to 107. We also investigated Doppler velocity images deduced from the VAE-compressed data and found that the error in Doppler velocity is significantly less than 5 km s<sup>−1</sup> when the compression ratio does not exceed 107.</p></div>","PeriodicalId":777,"journal":{"name":"Solar Physics","volume":"300 3","pages":""},"PeriodicalIF":2.7000,"publicationDate":"2025-03-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Neural-Based Compression for the Spectral Data of the New Vacuum Solar Telescope\",\"authors\":\"Yan Dong, Zhenping Qiang, Jiayan Yang, Yunfang Cai, Qingyang Chen, Jia Cao\",\"doi\":\"10.1007/s11207-025-02447-7\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Due to the rapid increase in spectral data generation as well as storage and transmission constraints, data compression has become particularly important for the New Vacuum Solar Telescope (NVST) at Yunnan Observatory. In this paper, we present a method for compressing NVST Ca II (8542 Å) spectral data based on a Convolutional Variational Autoencoder (VAE). Our results show that the compression ratios of the VAE-based approach may achieve as high as 107, while keeping the error between the decompressed data and the original data within the inherent error range of the raw data. This is much better than the appropriate compression ratio of 30 that is attained using the current PCA-based approach. Furthermore, the stability of the VAE approach is demonstrated by the almost constant differences between the VAE-compressed data and the raw data when the compression ratio ranges from 8 to 107. We also investigated Doppler velocity images deduced from the VAE-compressed data and found that the error in Doppler velocity is significantly less than 5 km s<sup>−1</sup> when the compression ratio does not exceed 107.</p></div>\",\"PeriodicalId\":777,\"journal\":{\"name\":\"Solar Physics\",\"volume\":\"300 3\",\"pages\":\"\"},\"PeriodicalIF\":2.7000,\"publicationDate\":\"2025-03-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Solar Physics\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://link.springer.com/article/10.1007/s11207-025-02447-7\",\"RegionNum\":3,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ASTRONOMY & ASTROPHYSICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Solar Physics","FirstCategoryId":"101","ListUrlMain":"https://link.springer.com/article/10.1007/s11207-025-02447-7","RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ASTRONOMY & ASTROPHYSICS","Score":null,"Total":0}
引用次数: 0
摘要
由于光谱数据量的迅速增加以及存储和传输的限制,数据压缩对云南天文台新真空太阳望远镜(NVST)来说变得尤为重要。本文提出了一种基于卷积变分自编码器(VAE)的NVST Ca II (8542 Å)频谱数据压缩方法。我们的研究结果表明,基于vae的压缩比可以达到107,同时将解压缩数据与原始数据之间的误差保持在原始数据的固有误差范围内。这比使用当前基于pca的方法获得的30的适当压缩比要好得多。此外,在压缩比为8 ~ 107的范围内,压缩后的数据与原始数据的差异几乎不变,证明了VAE方法的稳定性。我们还研究了由vae压缩数据导出的多普勒速度图像,发现当压缩比不超过107时,多普勒速度的误差明显小于5 km s−1。
Neural-Based Compression for the Spectral Data of the New Vacuum Solar Telescope
Due to the rapid increase in spectral data generation as well as storage and transmission constraints, data compression has become particularly important for the New Vacuum Solar Telescope (NVST) at Yunnan Observatory. In this paper, we present a method for compressing NVST Ca II (8542 Å) spectral data based on a Convolutional Variational Autoencoder (VAE). Our results show that the compression ratios of the VAE-based approach may achieve as high as 107, while keeping the error between the decompressed data and the original data within the inherent error range of the raw data. This is much better than the appropriate compression ratio of 30 that is attained using the current PCA-based approach. Furthermore, the stability of the VAE approach is demonstrated by the almost constant differences between the VAE-compressed data and the raw data when the compression ratio ranges from 8 to 107. We also investigated Doppler velocity images deduced from the VAE-compressed data and found that the error in Doppler velocity is significantly less than 5 km s−1 when the compression ratio does not exceed 107.
期刊介绍:
Solar Physics was founded in 1967 and is the principal journal for the publication of the results of fundamental research on the Sun. The journal treats all aspects of solar physics, ranging from the internal structure of the Sun and its evolution to the outer corona and solar wind in interplanetary space. Papers on solar-terrestrial physics and on stellar research are also published when their results have a direct bearing on our understanding of the Sun.