Cao Jie , Xu Ting-ting , Deng Yu-he , Li Guang-ping , Gao Xian-jun , Yang Ming-cun , Liu Zhi-jing , Zhou Wei-hong
{"title":"Classification of Galaxy Morphology Based on FPN-ViT Model","authors":"Cao Jie , Xu Ting-ting , Deng Yu-he , Li Guang-ping , Gao Xian-jun , Yang Ming-cun , Liu Zhi-jing , Zhou Wei-hong","doi":"10.1016/j.chinastron.2024.11.001","DOIUrl":null,"url":null,"abstract":"<div><div>With the development of artificial intelligence technology, the research of galaxy morphology classification using deep learning methods has made great progress, but there are still shortcomings in classification accuracy, automation, and spatial characteristics representation of galaxies. The Vision Transformer model (ViT) has good robustness in galaxy morphology classification, but has limitations in handling multi-scale images. In this paper, we propose to introduce the Feature Pyramid Networks (FPN) into the ViT model to classify galaxies. The results show that the average accuracy, precision, recall, and F1-score of the FPN-ViT model are above 95%, and the indexes are improved compared with the traditional ViT model. Meanwhile, we add different levels of Gaussian noise and pretzel noise to the original galaxy images to verify that the FPN-ViT model can obtain better classification performance for low signal-to-noise ratio data. In addition, to evaluate the model comprehensively, the t-distributed Stochastic Neighbor Embedding (t-SNE) algorithm is used to visualize and analyze the classification results, which can show the effect of FPN-ViT model on galaxy morphology classification more directly. The application of FPN network to the classification of galaxy morphology by ViT model is a new attempt, which is of great importance for the subsequent research.</div></div>","PeriodicalId":35730,"journal":{"name":"Chinese Astronomy and Astrophysics","volume":"48 4","pages":"Pages 683-704"},"PeriodicalIF":0.0000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Chinese Astronomy and Astrophysics","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0275106224000912","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"Physics and Astronomy","Score":null,"Total":0}
引用次数: 0
Abstract
With the development of artificial intelligence technology, the research of galaxy morphology classification using deep learning methods has made great progress, but there are still shortcomings in classification accuracy, automation, and spatial characteristics representation of galaxies. The Vision Transformer model (ViT) has good robustness in galaxy morphology classification, but has limitations in handling multi-scale images. In this paper, we propose to introduce the Feature Pyramid Networks (FPN) into the ViT model to classify galaxies. The results show that the average accuracy, precision, recall, and F1-score of the FPN-ViT model are above 95%, and the indexes are improved compared with the traditional ViT model. Meanwhile, we add different levels of Gaussian noise and pretzel noise to the original galaxy images to verify that the FPN-ViT model can obtain better classification performance for low signal-to-noise ratio data. In addition, to evaluate the model comprehensively, the t-distributed Stochastic Neighbor Embedding (t-SNE) algorithm is used to visualize and analyze the classification results, which can show the effect of FPN-ViT model on galaxy morphology classification more directly. The application of FPN network to the classification of galaxy morphology by ViT model is a new attempt, which is of great importance for the subsequent research.
期刊介绍:
The vigorous growth of astronomical and astrophysical science in China led to an increase in papers on astrophysics which Acta Astronomica Sinica could no longer absorb. Translations of papers from two new journals the Chinese Journal of Space Science and Acta Astrophysica Sinica are added to the translation of Acta Astronomica Sinica to form the new journal Chinese Astronomy and Astrophysics. Chinese Astronomy and Astrophysics brings English translations of notable articles to astronomers and astrophysicists outside China.