基于Naïve贝叶斯和粒子群优化的小数据集和不平衡数据集分类方法分析

Muhammad Misdram, E. Noersasongko, A. Syukur, Purwanto Faculty, Muljono Muljono, Heru Agus Santoso, De Rosal Ignatius Moses Setiadi
{"title":"基于Naïve贝叶斯和粒子群优化的小数据集和不平衡数据集分类方法分析","authors":"Muhammad Misdram, E. Noersasongko, A. Syukur, Purwanto Faculty, Muljono Muljono, Heru Agus Santoso, De Rosal Ignatius Moses Setiadi","doi":"10.1109/iSemantic50169.2020.9234225","DOIUrl":null,"url":null,"abstract":"The classification method in data mining requires a good learning process to get optimal accuracy. This can be done if the dataset used is ideal, balanced, and has a lot of records, but in reality, it is difficult to get such a dataset. The imputation method is one way to fill in missing values, in a dataset that is not ideal. A large number of missing values can reduce the number of records in the learning process and affect accuracy. This research aims to analyze the effects of zero and mean imputation methods on classification accuracy in small datasets using the Naïve Bayes classifier (NBC) and NBC which have been optimized with Particle Swarm Optimization (PSO). Tests were carried out on five types of datasets originating from the UCI database, where one of the datasets did not require an imputation method because it did not have a missing value. Based on the results of the PSO testing proven to be able to improve the accuracy of the NBC classification on all datasets. While the imputation method can improve classification accuracy up to 4.33% in Biomarker datasets.","PeriodicalId":345558,"journal":{"name":"2020 International Seminar on Application for Technology of Information and Communication (iSemantic)","volume":"20 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Analysis of Imputation Methods of Small and Unbalanced Datasets in Classifications using Naïve Bayes and Particle Swarm Optimization\",\"authors\":\"Muhammad Misdram, E. Noersasongko, A. Syukur, Purwanto Faculty, Muljono Muljono, Heru Agus Santoso, De Rosal Ignatius Moses Setiadi\",\"doi\":\"10.1109/iSemantic50169.2020.9234225\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The classification method in data mining requires a good learning process to get optimal accuracy. This can be done if the dataset used is ideal, balanced, and has a lot of records, but in reality, it is difficult to get such a dataset. The imputation method is one way to fill in missing values, in a dataset that is not ideal. A large number of missing values can reduce the number of records in the learning process and affect accuracy. This research aims to analyze the effects of zero and mean imputation methods on classification accuracy in small datasets using the Naïve Bayes classifier (NBC) and NBC which have been optimized with Particle Swarm Optimization (PSO). Tests were carried out on five types of datasets originating from the UCI database, where one of the datasets did not require an imputation method because it did not have a missing value. Based on the results of the PSO testing proven to be able to improve the accuracy of the NBC classification on all datasets. While the imputation method can improve classification accuracy up to 4.33% in Biomarker datasets.\",\"PeriodicalId\":345558,\"journal\":{\"name\":\"2020 International Seminar on Application for Technology of Information and Communication (iSemantic)\",\"volume\":\"20 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-09-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 International Seminar on Application for Technology of Information and Communication (iSemantic)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/iSemantic50169.2020.9234225\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 International Seminar on Application for Technology of Information and Communication (iSemantic)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/iSemantic50169.2020.9234225","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3

摘要

数据挖掘中的分类方法需要一个良好的学习过程来获得最佳的准确率。如果使用的数据集是理想的,平衡的,并且有很多记录,这是可以做到的,但在现实中,很难得到这样的数据集。在不理想的数据集中,插入方法是填充缺失值的一种方法。大量的缺失值会减少学习过程中的记录数量,影响准确性。本研究的目的是利用Naïve贝叶斯分类器(NBC)和经过粒子群优化(PSO)的贝叶斯分类器(NBC),分析零归一和均值归一方法对小数据集分类精度的影响。对来自UCI数据库的五种类型的数据集进行了测试,其中一种数据集不需要输入方法,因为它没有缺失值。基于PSO测试的结果证明,能够在所有数据集上提高NBC分类的准确性。而在生物标记物数据集上,该方法可将分类准确率提高4.33%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Analysis of Imputation Methods of Small and Unbalanced Datasets in Classifications using Naïve Bayes and Particle Swarm Optimization
The classification method in data mining requires a good learning process to get optimal accuracy. This can be done if the dataset used is ideal, balanced, and has a lot of records, but in reality, it is difficult to get such a dataset. The imputation method is one way to fill in missing values, in a dataset that is not ideal. A large number of missing values can reduce the number of records in the learning process and affect accuracy. This research aims to analyze the effects of zero and mean imputation methods on classification accuracy in small datasets using the Naïve Bayes classifier (NBC) and NBC which have been optimized with Particle Swarm Optimization (PSO). Tests were carried out on five types of datasets originating from the UCI database, where one of the datasets did not require an imputation method because it did not have a missing value. Based on the results of the PSO testing proven to be able to improve the accuracy of the NBC classification on all datasets. While the imputation method can improve classification accuracy up to 4.33% in Biomarker datasets.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信