利用注意力增强型 ResNets 预测星系形态

IF 2.7 4区 地球科学 Q2 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
Akshit Gupta, Kanwarpreet Kaur, Neeru Jindal
{"title":"利用注意力增强型 ResNets 预测星系形态","authors":"Akshit Gupta, Kanwarpreet Kaur, Neeru Jindal","doi":"10.1007/s12145-024-01449-6","DOIUrl":null,"url":null,"abstract":"<p>The practice of categorizing the galaxies according to morphologies exists and offers crucial details on the creation and development of the universe. The conventional visual inspection techniques have been very subjective and time-consuming. However, it is now possible to classify galaxies with greater accuracy owing to advancements in deep learning techniques. Deep Learning has demonstrated considerable potential in the research of galaxy classification and offers fresh perspectives on the genesis and evolution of galaxies. The suggested methodology employs Residual Networks for variety in a transfer learning-based method. To improve the accuracy of ResNet, an attention mechanism has been included. In our investigation, we used two relatively shallow ResNet models, ResNet18 and ResNet50 by incorporating a soft attention mechanism into them. The presented approach is validated on the Galaxy Zoo dataset from Kaggle. The accuracy increases from 60.15% to 80.20% for ResNet18 and from 78.21% to 80.55% for ResNet50, thus, demonstrating that the proposed work is now on a level with the accuracy of the far more complex, ResNet152 model. We have found that the attention mechanism can successfully improve the accuracy of even shallow models, which has implications for future studies in image recognition tasks.</p>","PeriodicalId":49318,"journal":{"name":"Earth Science Informatics","volume":"8 1","pages":""},"PeriodicalIF":2.7000,"publicationDate":"2024-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Predicting galaxy morphology using attention-enhanced ResNets\",\"authors\":\"Akshit Gupta, Kanwarpreet Kaur, Neeru Jindal\",\"doi\":\"10.1007/s12145-024-01449-6\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>The practice of categorizing the galaxies according to morphologies exists and offers crucial details on the creation and development of the universe. The conventional visual inspection techniques have been very subjective and time-consuming. However, it is now possible to classify galaxies with greater accuracy owing to advancements in deep learning techniques. Deep Learning has demonstrated considerable potential in the research of galaxy classification and offers fresh perspectives on the genesis and evolution of galaxies. The suggested methodology employs Residual Networks for variety in a transfer learning-based method. To improve the accuracy of ResNet, an attention mechanism has been included. In our investigation, we used two relatively shallow ResNet models, ResNet18 and ResNet50 by incorporating a soft attention mechanism into them. The presented approach is validated on the Galaxy Zoo dataset from Kaggle. The accuracy increases from 60.15% to 80.20% for ResNet18 and from 78.21% to 80.55% for ResNet50, thus, demonstrating that the proposed work is now on a level with the accuracy of the far more complex, ResNet152 model. We have found that the attention mechanism can successfully improve the accuracy of even shallow models, which has implications for future studies in image recognition tasks.</p>\",\"PeriodicalId\":49318,\"journal\":{\"name\":\"Earth Science Informatics\",\"volume\":\"8 1\",\"pages\":\"\"},\"PeriodicalIF\":2.7000,\"publicationDate\":\"2024-08-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Earth Science Informatics\",\"FirstCategoryId\":\"89\",\"ListUrlMain\":\"https://doi.org/10.1007/s12145-024-01449-6\",\"RegionNum\":4,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Earth Science Informatics","FirstCategoryId":"89","ListUrlMain":"https://doi.org/10.1007/s12145-024-01449-6","RegionNum":4,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

根据形态对星系进行分类的做法是存在的,它提供了有关宇宙产生和发展的重要细节。传统的视觉检测技术非常主观且耗时。然而,由于深度学习技术的进步,现在可以更准确地对星系进行分类。深度学习已在星系分类研究中展现出相当大的潜力,并为星系的起源和演化提供了全新的视角。所建议的方法采用基于迁移学习的残差网络(Residual Networks)进行分类。为了提高残差网络的准确性,还加入了注意力机制。在研究中,我们使用了两个相对较浅的 ResNet 模型 ResNet18 和 ResNet50,并在其中加入了软注意力机制。所提出的方法在 Kaggle 的 Galaxy Zoo 数据集上进行了验证。ResNet18的准确率从60.15%提高到80.20%,ResNet50的准确率从78.21%提高到80.55%,这表明所提出的方法与更为复杂的ResNet152模型的准确率相当。我们发现,即使是浅层模型,注意力机制也能成功提高其准确性,这对未来图像识别任务的研究具有重要意义。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Predicting galaxy morphology using attention-enhanced ResNets

Predicting galaxy morphology using attention-enhanced ResNets

The practice of categorizing the galaxies according to morphologies exists and offers crucial details on the creation and development of the universe. The conventional visual inspection techniques have been very subjective and time-consuming. However, it is now possible to classify galaxies with greater accuracy owing to advancements in deep learning techniques. Deep Learning has demonstrated considerable potential in the research of galaxy classification and offers fresh perspectives on the genesis and evolution of galaxies. The suggested methodology employs Residual Networks for variety in a transfer learning-based method. To improve the accuracy of ResNet, an attention mechanism has been included. In our investigation, we used two relatively shallow ResNet models, ResNet18 and ResNet50 by incorporating a soft attention mechanism into them. The presented approach is validated on the Galaxy Zoo dataset from Kaggle. The accuracy increases from 60.15% to 80.20% for ResNet18 and from 78.21% to 80.55% for ResNet50, thus, demonstrating that the proposed work is now on a level with the accuracy of the far more complex, ResNet152 model. We have found that the attention mechanism can successfully improve the accuracy of even shallow models, which has implications for future studies in image recognition tasks.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Earth Science Informatics
Earth Science Informatics COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS-GEOSCIENCES, MULTIDISCIPLINARY
CiteScore
4.60
自引率
3.60%
发文量
157
审稿时长
4.3 months
期刊介绍: The Earth Science Informatics [ESIN] journal aims at rapid publication of high-quality, current, cutting-edge, and provocative scientific work in the area of Earth Science Informatics as it relates to Earth systems science and space science. This includes articles on the application of formal and computational methods, computational Earth science, spatial and temporal analyses, and all aspects of computer applications to the acquisition, storage, processing, interchange, and visualization of data and information about the materials, properties, processes, features, and phenomena that occur at all scales and locations in the Earth system’s five components (atmosphere, hydrosphere, geosphere, biosphere, cryosphere) and in space (see "About this journal" for more detail). The quarterly journal publishes research, methodology, and software articles, as well as editorials, comments, and book and software reviews. Review articles of relevant findings, topics, and methodologies are also considered.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信