Majesty Eksa Permana, Handoko Ramadhan, I. Budi, Aris Budi Santoso, Prabu Kresna Putra
{"title":"Sentiment Analysis and Topic Detection of Mobile Banking Application Review","authors":"Majesty Eksa Permana, Handoko Ramadhan, I. Budi, Aris Budi Santoso, Prabu Kresna Putra","doi":"10.1109/ICIC50835.2020.9288616","DOIUrl":null,"url":null,"abstract":"Understanding user needs and application quality are difficult things in developing an application. Sentiment analysis and topic modeling based on application review can be used to understand the user needs and application quality. This research aimed to determine customer sentiment towards mobile banking applications and what aspects need to be improved or maintained from the application. The data come from application user reviews on Google Play Store, which amounted to 6194 data. Labeling is done manually, generates two main classes namely positive and negative classes. The sentiment analysis process is done using Naive Bayes models. While the topic modeling process is carried out using the LDA algorithm. The results of the experiment were Naive Bayes method has a good level of accuracy, recall, and precision. The highest accuracy, recall, and precision are at the value of k=5, which is 86.762% accuracy, 93.474% for recall, and 92.482% for precision. Based on the LDA algorithm, the most frequent topics in negative classes are related to OTP code delivery constraints, application login problems, and network connection. On the other hand, the most frequent topics in positives classes included ease, simplicity, and helpfulness.","PeriodicalId":413610,"journal":{"name":"2020 Fifth International Conference on Informatics and Computing (ICIC)","volume":"4291 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"7","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 Fifth International Conference on Informatics and Computing (ICIC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICIC50835.2020.9288616","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 7
Abstract
Understanding user needs and application quality are difficult things in developing an application. Sentiment analysis and topic modeling based on application review can be used to understand the user needs and application quality. This research aimed to determine customer sentiment towards mobile banking applications and what aspects need to be improved or maintained from the application. The data come from application user reviews on Google Play Store, which amounted to 6194 data. Labeling is done manually, generates two main classes namely positive and negative classes. The sentiment analysis process is done using Naive Bayes models. While the topic modeling process is carried out using the LDA algorithm. The results of the experiment were Naive Bayes method has a good level of accuracy, recall, and precision. The highest accuracy, recall, and precision are at the value of k=5, which is 86.762% accuracy, 93.474% for recall, and 92.482% for precision. Based on the LDA algorithm, the most frequent topics in negative classes are related to OTP code delivery constraints, application login problems, and network connection. On the other hand, the most frequent topics in positives classes included ease, simplicity, and helpfulness.
在开发应用程序时,理解用户需求和应用程序质量是很困难的事情。基于应用审查的情感分析和主题建模可以用来了解用户需求和应用质量。本研究旨在确定客户对移动银行应用程序的看法,以及应用程序需要改进或维护的方面。数据来自Google Play Store上的应用用户评论,共计6194条数据。标记是手动完成的,生成两个主要类别,即正类和负类。情感分析过程是使用朴素贝叶斯模型完成的。而主题建模过程则采用LDA算法进行。实验结果表明,朴素贝叶斯方法具有较好的准确率、召回率和精密度。准确率、查全率和查准率在k=5时最高,准确率为86.762%,查全率为93.474%,查准率为92.482%。基于LDA算法,负类中最常见的主题与OTP代码交付约束、应用程序登录问题和网络连接有关。另一方面,积极类中最常见的话题包括轻松、简单和有用。