Proceedings of the 3rd International Conference on Machine Learning and Soft Computing最新文献_第2页

Empirical Comparison of Area under ROC curve (AUC) and Mathew Correlation Coefficient (MCC) for Evaluating Machine Learning Algorithms on Imbalanced Datasets for Binary Classification ROC曲线下面积(Area under ROC curve, AUC)和马修相关系数(Mathew Correlation Coefficient, MCC)在非平衡数据集上评估机器学习算法的经验比较

Proceedings of the 3rd International Conference on Machine Learning and Soft Computing Pub Date : 2019-01-25 DOI: 10.1145/3310986.3311023

Chongomweru Halimu, Asem Kasem, S. Newaz

{"title":"Empirical Comparison of Area under ROC curve (AUC) and Mathew Correlation Coefficient (MCC) for Evaluating Machine Learning Algorithms on Imbalanced Datasets for Binary Classification","authors":"Chongomweru Halimu, Asem Kasem, S. Newaz","doi":"10.1145/3310986.3311023","DOIUrl":"https://doi.org/10.1145/3310986.3311023","url":null,"abstract":"A common challenge encountered when trying to perform classifications and comparing classifiers is selecting a suitable performance metric. This is particularly important when the data has class-imbalance problems. Area under the Receiver Operating Characteristic Curve (AUC) has been commonly used by the machine learning community in such situations, and recently researchers are starting to use Matthew Correlation Coefficient (MCC), especially in biomedical research. However, there is no empirical study that has been conducted to compare the suitability of the two metrics. In this paper, the aim of this study is to provide insights about how AUC and MCC are compared to each other when used with classical machine learning algorithms over a range of imbalanced datasets. In our study, we utilize an earlier-proposed criteria for comparing metrics based on the degree of consistency and degree of Discriminancy to compare AUC against MCC. We carry out experiments using four machine learning algorithms on 54 imbalanced datasets, with imbalance ratios ranging from 1% to 10%. The results demonstrate that both AUC and MCC are statistically consistent with each other; however AUC is more discriminating than MCC. The same observation is noticed when evaluated on 23 balanced datasets. This suggests AUC to be a better measure than MCC in evaluating and comparing classification algorithms.","PeriodicalId":252781,"journal":{"name":"Proceedings of the 3rd International Conference on Machine Learning and Soft Computing","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-01-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117084428","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 65

Face Reconstruction with Generative Adversarial Network 基于生成对抗网络的人脸重建

Proceedings of the 3rd International Conference on Machine Learning and Soft Computing Pub Date : 2019-01-25 DOI: 10.1145/3310986.3311008

Dino Hariatma Putra, T. Basaruddin

引用次数: 0

Sliding Window Method on Quantum Key Distribution Protocol 量子密钥分发协议的滑动窗口方法

Proceedings of the 3rd International Conference on Machine Learning and Soft Computing Pub Date : 2019-01-25 DOI: 10.1145/3310986.3311030

G. Mogos

引用次数: 0

Solving Dietary Planning Problem using Particle Swarm Optimization with Genetic Operators 基于遗传算子的粒子群算法求解膳食规划问题

Proceedings of the 3rd International Conference on Machine Learning and Soft Computing Pub Date : 2019-01-25 DOI: 10.1145/3310986.3311005

Edmarlyn Porras, Arnel C. Fajardo, Ruji P. Medina

引用次数: 5

QASA: Advanced Document Retriever for Open-Domain Question Answering by Learning to Rank Question-Aware Self-Attentive Document Representations QASA:基于学习对问题感知的自关注文档表示进行排序的开放域问答高级文档检索器

Proceedings of the 3rd International Conference on Machine Learning and Soft Computing Pub Date : 2019-01-25 DOI: 10.1145/3310986.3310999

Trang M. Nguyen, Van-Lien Tran, Duy-Cat Can, Quang-Thuy Ha, L. T. Vu, Chng Eng Siong

引用次数: 1

Image-Based Silkworm Egg Classification and Counting Using Counting Neural Network 基于图像的计数神经网络蚕卵分类与计数

Proceedings of the 3rd International Conference on Machine Learning and Soft Computing Pub Date : 2019-01-25 DOI: 10.1145/3310986.3310988

Supachaya Prathan, S. Auephanwiriyakul, N. Theera-Umpon, S. Marukatat

引用次数: 1

Exploring the Relationship between the Structural and the Actual Similarities of Automata 探讨自动机的结构相似度与实际相似度之间的关系

Proceedings of the 3rd International Conference on Machine Learning and Soft Computing Pub Date : 2019-01-25 DOI: 10.1145/3310986.3311032

P. Grachev, R. Bezborodov, I. Smetannikov, A. Filchenkov

引用次数: 2

Improved collaborative filtering recommendations using quantitative implication rules mining in implication field 在蕴涵领域改进了基于定量蕴涵规则挖掘的协同过滤推荐

Proceedings of the 3rd International Conference on Machine Learning and Soft Computing Pub Date : 2019-01-25 DOI: 10.1145/3310986.3310996

H. T. Nguyen, H. Huynh, Lan Phuong Phan, H. Huynh

引用次数: 2

Self-developed Three Wheels Omni-Directional for Autonomous Mobile Robots 自主研制的三轮全方位自主移动机器人

Proceedings of the 3rd International Conference on Machine Learning and Soft Computing Pub Date : 2019-01-25 DOI: 10.1145/3310986.3310995

Truong Le Phuong, Khai La Khai

引用次数: 2

Inception-v3-Based Recommender System for Crops 基于inception -v3的作物推荐系统

Proceedings of the 3rd International Conference on Machine Learning and Soft Computing Pub Date : 2019-01-25 DOI: 10.1145/3310986.3310993

E. P. Guidang

引用次数: 1