{"title":"利用数据集平衡方法和符号分类组合改进脉冲星探测工作","authors":"N. Anđelić","doi":"10.1016/j.ascom.2024.100801","DOIUrl":null,"url":null,"abstract":"<div><p>Highly accurate detection of pulsars is mandatory. With the application of machine learning (ML) algorithms, the detection of pulsars can certainly be improved if the dataset is balanced. In this paper, the publicly available dataset (HTRU2) is highly imbalanced so various balancing methods were applied. The balanced dataset was used in genetic programming symbolic classifier (GPSC) to obtain symbolic expressions (SEs) that can detect pulsars with high classification accuracy. To find the optimal combination of GPSC hyperparameters the random hyperparameter search (RHS) method was developed and applied. The GPSC was trained using 5-fold cross-validation so after each training a total of 5 SEs were obtained. The best set of SEs are selected based on their classification performance and all of them are applied on the original dataset. The best classification accuracy (ACC), the area under receiver operating characteristic (AUC), precision, recall, and f1-score were achieved in the case of the dataset balanced with the AllKNN method i.e. all mean evaluation metric values are equal to 0.995. The ensemble consisted of 25 SEs that achieved the <span><math><mrow><mi>A</mi><mi>C</mi><mi>C</mi><mo>=</mo><mn>0</mn><mo>.</mo><mn>978</mn></mrow></math></span>, <span><math><mrow><mi>A</mi><mi>U</mi><mi>C</mi><mo>=</mo><mn>0</mn><mo>.</mo><mn>9452</mn></mrow></math></span> , <span><math><mrow><mi>P</mi><mi>r</mi><mi>e</mi><mi>c</mi><mi>i</mi><mi>s</mi><mi>i</mi><mi>o</mi><mi>n</mi><mo>=</mo><mn>0</mn><mo>.</mo><mn>905</mn></mrow></math></span>, <span><math><mrow><mi>R</mi><mi>e</mi><mi>c</mi><mi>a</mi><mi>l</mi><mi>l</mi><mo>=</mo><mn>0</mn><mo>.</mo><mn>9963</mn></mrow></math></span>, and <span><math><mrow><mi>F</mi><mn>1</mn><mo>−</mo><mi>S</mi><mi>c</mi><mi>o</mi><mi>r</mi><mi>e</mi><mo>=</mo><mn>0</mn><mo>.</mo><mn>94877</mn></mrow></math></span>, on the original dataset.</p></div>","PeriodicalId":48757,"journal":{"name":"Astronomy and Computing","volume":"47 ","pages":"Article 100801"},"PeriodicalIF":1.9000,"publicationDate":"2024-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Improvement of pulsars detection using dataset balancing methods and symbolic classification ensemble\",\"authors\":\"N. Anđelić\",\"doi\":\"10.1016/j.ascom.2024.100801\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Highly accurate detection of pulsars is mandatory. With the application of machine learning (ML) algorithms, the detection of pulsars can certainly be improved if the dataset is balanced. In this paper, the publicly available dataset (HTRU2) is highly imbalanced so various balancing methods were applied. The balanced dataset was used in genetic programming symbolic classifier (GPSC) to obtain symbolic expressions (SEs) that can detect pulsars with high classification accuracy. To find the optimal combination of GPSC hyperparameters the random hyperparameter search (RHS) method was developed and applied. The GPSC was trained using 5-fold cross-validation so after each training a total of 5 SEs were obtained. The best set of SEs are selected based on their classification performance and all of them are applied on the original dataset. The best classification accuracy (ACC), the area under receiver operating characteristic (AUC), precision, recall, and f1-score were achieved in the case of the dataset balanced with the AllKNN method i.e. all mean evaluation metric values are equal to 0.995. The ensemble consisted of 25 SEs that achieved the <span><math><mrow><mi>A</mi><mi>C</mi><mi>C</mi><mo>=</mo><mn>0</mn><mo>.</mo><mn>978</mn></mrow></math></span>, <span><math><mrow><mi>A</mi><mi>U</mi><mi>C</mi><mo>=</mo><mn>0</mn><mo>.</mo><mn>9452</mn></mrow></math></span> , <span><math><mrow><mi>P</mi><mi>r</mi><mi>e</mi><mi>c</mi><mi>i</mi><mi>s</mi><mi>i</mi><mi>o</mi><mi>n</mi><mo>=</mo><mn>0</mn><mo>.</mo><mn>905</mn></mrow></math></span>, <span><math><mrow><mi>R</mi><mi>e</mi><mi>c</mi><mi>a</mi><mi>l</mi><mi>l</mi><mo>=</mo><mn>0</mn><mo>.</mo><mn>9963</mn></mrow></math></span>, and <span><math><mrow><mi>F</mi><mn>1</mn><mo>−</mo><mi>S</mi><mi>c</mi><mi>o</mi><mi>r</mi><mi>e</mi><mo>=</mo><mn>0</mn><mo>.</mo><mn>94877</mn></mrow></math></span>, on the original dataset.</p></div>\",\"PeriodicalId\":48757,\"journal\":{\"name\":\"Astronomy and Computing\",\"volume\":\"47 \",\"pages\":\"Article 100801\"},\"PeriodicalIF\":1.9000,\"publicationDate\":\"2024-02-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Astronomy and Computing\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2213133724000167\",\"RegionNum\":4,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ASTRONOMY & ASTROPHYSICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Astronomy and Computing","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2213133724000167","RegionNum":4,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ASTRONOMY & ASTROPHYSICS","Score":null,"Total":0}
引用次数: 0
摘要
脉冲星的高精度探测是必须的。随着机器学习(ML)算法的应用,如果数据集是平衡的,那么脉冲星的探测效果肯定会得到改善。本文公开的数据集(HTRU2)高度不平衡,因此采用了多种平衡方法。平衡后的数据集被用于遗传编程符号分类器(GPSC),以获得能以高分类精度探测脉冲星的符号表达式(SE)。为了找到 GPSC 超参数的最佳组合,开发并应用了随机超参数搜索(RHS)方法。GPSC 采用 5 倍交叉验证法进行训练,因此每次训练后总共会得到 5 个 SE。根据分类性能选出一组最佳 SE,并将所有 SE 应用于原始数据集。在使用 AllKNN 方法平衡数据集的情况下,即所有平均评估指标值都等于 0.995 时,分类准确率(ACC)、接收器操作特征下面积(AUC)、精确度、召回率和 f1 分数都达到了最佳水平。该集合由 25 个 SE 组成,在原始数据集上实现了 ACC=0.978, AUC=0.9452, Precision=0.905, Recall=0.9963 和 F1-Score=0.94877 的结果。
Improvement of pulsars detection using dataset balancing methods and symbolic classification ensemble
Highly accurate detection of pulsars is mandatory. With the application of machine learning (ML) algorithms, the detection of pulsars can certainly be improved if the dataset is balanced. In this paper, the publicly available dataset (HTRU2) is highly imbalanced so various balancing methods were applied. The balanced dataset was used in genetic programming symbolic classifier (GPSC) to obtain symbolic expressions (SEs) that can detect pulsars with high classification accuracy. To find the optimal combination of GPSC hyperparameters the random hyperparameter search (RHS) method was developed and applied. The GPSC was trained using 5-fold cross-validation so after each training a total of 5 SEs were obtained. The best set of SEs are selected based on their classification performance and all of them are applied on the original dataset. The best classification accuracy (ACC), the area under receiver operating characteristic (AUC), precision, recall, and f1-score were achieved in the case of the dataset balanced with the AllKNN method i.e. all mean evaluation metric values are equal to 0.995. The ensemble consisted of 25 SEs that achieved the , , , , and , on the original dataset.
Astronomy and ComputingASTRONOMY & ASTROPHYSICSCOMPUTER SCIENCE,-COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
CiteScore
4.10
自引率
8.00%
发文量
67
期刊介绍:
Astronomy and Computing is a peer-reviewed journal that focuses on the broad area between astronomy, computer science and information technology. The journal aims to publish the work of scientists and (software) engineers in all aspects of astronomical computing, including the collection, analysis, reduction, visualisation, preservation and dissemination of data, and the development of astronomical software and simulations. The journal covers applications for academic computer science techniques to astronomy, as well as novel applications of information technologies within astronomy.