基于深度学习的卫星太阳耀斑预报模型压缩研究

IF 8.6 1区 物理与天体物理 Q1 ASTRONOMY & ASTROPHYSICS
Kai Feng, Long Xu, Dong Zhao, Sixuan Liu, Xin Huang
{"title":"基于深度学习的卫星太阳耀斑预报模型压缩研究","authors":"Kai Feng, Long Xu, Dong Zhao, Sixuan Liu, Xin Huang","doi":"10.3847/1538-4365/ace96a","DOIUrl":null,"url":null,"abstract":"Abstract Timely solar flare forecasting is challenged by the delay of transmitting vast amounts of data from the satellite to the ground. To avoid this delay, it is expected that forecasting models will be deployed on satellites. Thus, transmitting forecasting results instead of huge volumes of observation data would greatly save network bandwidth and reduce forecasting delay. However, deep-learning models have a huge number of parameters so they need large memory and strong computing power, which hinders their deployment on satellites with limited memory and computing resources. Therefore, there is a great need to compress forecasting models for efficient deployment on satellites. First, three typical compression methods, namely knowledge distillation, pruning, and quantization, are examined individually for compressing of solar flare forecasting models. And then, an assembled compression model is proposed for better compressing solar flare forecasting models. The experimental results demonstrate that the assembled compression model can compress a pretrained solar flare forecasting model to only 1.67% of its original size while maintaining forecasting accuracy.","PeriodicalId":8588,"journal":{"name":"Astrophysical Journal Supplement Series","volume":"26 1","pages":"0"},"PeriodicalIF":8.6000,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Toward Model Compression for a Deep Learning–Based Solar Flare Forecast on Satellites\",\"authors\":\"Kai Feng, Long Xu, Dong Zhao, Sixuan Liu, Xin Huang\",\"doi\":\"10.3847/1538-4365/ace96a\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Abstract Timely solar flare forecasting is challenged by the delay of transmitting vast amounts of data from the satellite to the ground. To avoid this delay, it is expected that forecasting models will be deployed on satellites. Thus, transmitting forecasting results instead of huge volumes of observation data would greatly save network bandwidth and reduce forecasting delay. However, deep-learning models have a huge number of parameters so they need large memory and strong computing power, which hinders their deployment on satellites with limited memory and computing resources. Therefore, there is a great need to compress forecasting models for efficient deployment on satellites. First, three typical compression methods, namely knowledge distillation, pruning, and quantization, are examined individually for compressing of solar flare forecasting models. And then, an assembled compression model is proposed for better compressing solar flare forecasting models. The experimental results demonstrate that the assembled compression model can compress a pretrained solar flare forecasting model to only 1.67% of its original size while maintaining forecasting accuracy.\",\"PeriodicalId\":8588,\"journal\":{\"name\":\"Astrophysical Journal Supplement Series\",\"volume\":\"26 1\",\"pages\":\"0\"},\"PeriodicalIF\":8.6000,\"publicationDate\":\"2023-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Astrophysical Journal Supplement Series\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3847/1538-4365/ace96a\",\"RegionNum\":1,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ASTRONOMY & ASTROPHYSICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Astrophysical Journal Supplement Series","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3847/1538-4365/ace96a","RegionNum":1,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ASTRONOMY & ASTROPHYSICS","Score":null,"Total":0}
引用次数: 0

摘要

太阳耀斑的及时预报受到卫星向地面传输大量数据的延迟的挑战。为了避免这种延误,预计将在卫星上部署预报模型。因此,传输预测结果而不是传输大量的观测数据,将大大节省网络带宽,减少预测延迟。然而,深度学习模型具有大量的参数,因此需要大量的内存和强大的计算能力,这阻碍了它们在内存和计算资源有限的卫星上的部署。因此,非常需要压缩预报模型,以便在卫星上有效部署。首先,分别研究了知识精馏、剪枝和量化三种典型的太阳耀斑预报模型压缩方法。在此基础上,提出了一种组合式压缩模型,以获得更好的压缩太阳耀斑预报模型。实验结果表明,组合压缩模型在保持预测精度的前提下,可以将预训练的太阳耀斑预测模型压缩到原模型大小的1.67%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Toward Model Compression for a Deep Learning–Based Solar Flare Forecast on Satellites
Abstract Timely solar flare forecasting is challenged by the delay of transmitting vast amounts of data from the satellite to the ground. To avoid this delay, it is expected that forecasting models will be deployed on satellites. Thus, transmitting forecasting results instead of huge volumes of observation data would greatly save network bandwidth and reduce forecasting delay. However, deep-learning models have a huge number of parameters so they need large memory and strong computing power, which hinders their deployment on satellites with limited memory and computing resources. Therefore, there is a great need to compress forecasting models for efficient deployment on satellites. First, three typical compression methods, namely knowledge distillation, pruning, and quantization, are examined individually for compressing of solar flare forecasting models. And then, an assembled compression model is proposed for better compressing solar flare forecasting models. The experimental results demonstrate that the assembled compression model can compress a pretrained solar flare forecasting model to only 1.67% of its original size while maintaining forecasting accuracy.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Astrophysical Journal Supplement Series
Astrophysical Journal Supplement Series 地学天文-天文与天体物理
CiteScore
14.50
自引率
5.70%
发文量
264
审稿时长
2 months
期刊介绍: The Astrophysical Journal Supplement (ApJS) serves as an open-access journal that publishes significant articles featuring extensive data or calculations in the field of astrophysics. It also facilitates Special Issues, presenting thematically related papers simultaneously in a single volume.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信