一种基于注意力机制的流星探测优化训练方法,以提高对有限数据的鲁棒性

IF 1.9 4区 物理与天体物理 Q2 ASTRONOMY & ASTROPHYSICS
V.Y. Shirasuna, A.L.S. Gradvohl
{"title":"一种基于注意力机制的流星探测优化训练方法,以提高对有限数据的鲁棒性","authors":"V.Y. Shirasuna,&nbsp;A.L.S. Gradvohl","doi":"10.1016/j.ascom.2023.100753","DOIUrl":null,"url":null,"abstract":"<div><p><span>Researchers have extensively used convolutional neural networks<span> to detect meteor falls on Earth. However, when dealing with limited available data, these networks may need more robustness to classify new real-world images correctly. This study proposes an optimized training approach of a pre-trained model with an attention mechanism<span> to achieve better generalization results in such a scenario. We compare two architectures, an optimized base model and another version with an attention mechanism. Furthermore, we present a new and publicly available optical meteor dataset that merges several public data sources. We used the merged dataset to train classification models combined with a stratified five-fold cross-validation strategy to determine the reliability of the prediction. The experimental results from both architectures showed good and similar performance. To further determine the best architecture, we performed an additional analysis with visual explanations in new observations. The architecture with an attention mechanism was the best model achieving a </span></span></span>false alarm ratio of 2.6% and an accuracy of 97%.</p></div>","PeriodicalId":48757,"journal":{"name":"Astronomy and Computing","volume":null,"pages":null},"PeriodicalIF":1.9000,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An optimized training approach for meteor detection with an attention mechanism to improve robustness on limited data\",\"authors\":\"V.Y. Shirasuna,&nbsp;A.L.S. Gradvohl\",\"doi\":\"10.1016/j.ascom.2023.100753\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p><span>Researchers have extensively used convolutional neural networks<span> to detect meteor falls on Earth. However, when dealing with limited available data, these networks may need more robustness to classify new real-world images correctly. This study proposes an optimized training approach of a pre-trained model with an attention mechanism<span> to achieve better generalization results in such a scenario. We compare two architectures, an optimized base model and another version with an attention mechanism. Furthermore, we present a new and publicly available optical meteor dataset that merges several public data sources. We used the merged dataset to train classification models combined with a stratified five-fold cross-validation strategy to determine the reliability of the prediction. The experimental results from both architectures showed good and similar performance. To further determine the best architecture, we performed an additional analysis with visual explanations in new observations. The architecture with an attention mechanism was the best model achieving a </span></span></span>false alarm ratio of 2.6% and an accuracy of 97%.</p></div>\",\"PeriodicalId\":48757,\"journal\":{\"name\":\"Astronomy and Computing\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.9000,\"publicationDate\":\"2023-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Astronomy and Computing\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2213133723000689\",\"RegionNum\":4,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ASTRONOMY & ASTROPHYSICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Astronomy and Computing","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2213133723000689","RegionNum":4,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ASTRONOMY & ASTROPHYSICS","Score":null,"Total":0}
引用次数: 0

摘要

研究人员已经广泛使用卷积神经网络来探测地球上的流星。然而,当处理有限的可用数据时,这些网络可能需要更多的鲁棒性来正确分类新的真实世界的图像。本研究提出了一种带有注意机制的预训练模型的优化训练方法,以在该场景下获得更好的泛化效果。我们比较了两种架构,一种是优化的基础模型,另一种是带有注意机制的版本。此外,我们提出了一个新的和公开可用的光学流星数据集,它合并了几个公共数据源。我们使用合并的数据集来训练分类模型,并结合分层的五重交叉验证策略来确定预测的可靠性。两种架构的实验结果都显示出良好且相似的性能。为了进一步确定最佳架构,我们在新的观察中使用视觉解释进行了额外的分析。带有注意机制的体系结构是最好的模型,其虚警率为2.6%,准确率为97%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
An optimized training approach for meteor detection with an attention mechanism to improve robustness on limited data

Researchers have extensively used convolutional neural networks to detect meteor falls on Earth. However, when dealing with limited available data, these networks may need more robustness to classify new real-world images correctly. This study proposes an optimized training approach of a pre-trained model with an attention mechanism to achieve better generalization results in such a scenario. We compare two architectures, an optimized base model and another version with an attention mechanism. Furthermore, we present a new and publicly available optical meteor dataset that merges several public data sources. We used the merged dataset to train classification models combined with a stratified five-fold cross-validation strategy to determine the reliability of the prediction. The experimental results from both architectures showed good and similar performance. To further determine the best architecture, we performed an additional analysis with visual explanations in new observations. The architecture with an attention mechanism was the best model achieving a false alarm ratio of 2.6% and an accuracy of 97%.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Astronomy and Computing
Astronomy and Computing ASTRONOMY & ASTROPHYSICSCOMPUTER SCIENCE,-COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
CiteScore
4.10
自引率
8.00%
发文量
67
期刊介绍: Astronomy and Computing is a peer-reviewed journal that focuses on the broad area between astronomy, computer science and information technology. The journal aims to publish the work of scientists and (software) engineers in all aspects of astronomical computing, including the collection, analysis, reduction, visualisation, preservation and dissemination of data, and the development of astronomical software and simulations. The journal covers applications for academic computer science techniques to astronomy, as well as novel applications of information technologies within astronomy.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信