{"title":"Effect of Sampling Strategies on Fine-grained Emotion Classification in Microblog Text","authors":"Jasy Liew Suet Yan, Howard R. Turtle","doi":"10.1109/AiDAS47888.2019.8970953","DOIUrl":null,"url":null,"abstract":"This study investigates the effect of diverse training samples on machine learning model performance for fine-grained emotion classification. Using four different sampling strategies (random sampling, sampling by topic and two variations of sampling by user), we found the class distribution of28 emotion categories to differ across the samples produced by each sampling strategy. However, combining different sampling strategies is complementary in generating sufficiently diverse training examples for the emotion classifiers. Based on support vector machine (SVM) and Bayesian network learning algorithms, our findings show that a classifier trained on combined data from the four sampling strategies performs better and is more generalizable than a classifier trained only on data from a single sampling strategy. Demonstrating how the diversity of the training samples affect the performance of emotion classifiers is the main contribution of this study.","PeriodicalId":227508,"journal":{"name":"2019 1st International Conference on Artificial Intelligence and Data Sciences (AiDAS)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 1st International Conference on Artificial Intelligence and Data Sciences (AiDAS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/AiDAS47888.2019.8970953","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
This study investigates the effect of diverse training samples on machine learning model performance for fine-grained emotion classification. Using four different sampling strategies (random sampling, sampling by topic and two variations of sampling by user), we found the class distribution of28 emotion categories to differ across the samples produced by each sampling strategy. However, combining different sampling strategies is complementary in generating sufficiently diverse training examples for the emotion classifiers. Based on support vector machine (SVM) and Bayesian network learning algorithms, our findings show that a classifier trained on combined data from the four sampling strategies performs better and is more generalizable than a classifier trained only on data from a single sampling strategy. Demonstrating how the diversity of the training samples affect the performance of emotion classifiers is the main contribution of this study.