{"title":"Sentiment Analysis of Maxim Online Transportation App Reviews using Support Vector Machine (SVM) Algorithm","authors":"Putri Kurniawati, Riska Yanu Fa'rifah, Deden Witarsyah","doi":"10.47065/bits.v5i2.4265","DOIUrl":null,"url":null,"abstract":"The continuous emergence of online transportation service platforms is one of the effects of the ever-increasing technological advancements. One such online transportation service application, Maxim, has recently been slowly gaining ground in the ride-hailing market in Indonesia. According to data collected by one media outlet in 2022, Maxim ranks third as the most preferred online transportation platform by the public, following Gojek and Grab. This suggests that there are factors causing users to lack interest in or hesitate to use the Maxim application. On the Google Play Store, user ratings (in numerical values) and written reviews serve as reasons for the potential users lack of interest. Analyzing ratings alone is less accurate and does not provide in-depth information and meaning regarding users experiences. To understand user opinions about Maxim's service and functionality, an analysis of user reviews is crucial. Therefore, this research conducts sentiment analysis on Maxim user reviews using the Support Vector Machine (SVM) algorithm to classify reviews quickly. The reviews are categorized into two classes: positive and negative sentiment. The classification process is carried out in three scenarios with different data training and testing ratios: 60:40, 70:30, and 80:20, using a Linear kernel and hyperparameter optimization with GridSearch. The best accuracy is achieved with a 70:30 ratio, which is 89.82%. Evaluation using the confusion matrix also yields a precision of 92.66%, recall of 94.09%, and an F1 score of 93.38%. The ROC-AUC curve evaluation results in an AUC value of 0.8505. The sentiment analysis results tend to lean towards positive sentiment, indicating a high level of user satisfaction with the Maxim application. Based on these sentiment results, developers can identify what aspects of the Maxim application need to be maintained and improved.","PeriodicalId":474248,"journal":{"name":"Building of Informatics, Technology and Science (BITS)","volume":"69 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Building of Informatics, Technology and Science (BITS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.47065/bits.v5i2.4265","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
The continuous emergence of online transportation service platforms is one of the effects of the ever-increasing technological advancements. One such online transportation service application, Maxim, has recently been slowly gaining ground in the ride-hailing market in Indonesia. According to data collected by one media outlet in 2022, Maxim ranks third as the most preferred online transportation platform by the public, following Gojek and Grab. This suggests that there are factors causing users to lack interest in or hesitate to use the Maxim application. On the Google Play Store, user ratings (in numerical values) and written reviews serve as reasons for the potential users lack of interest. Analyzing ratings alone is less accurate and does not provide in-depth information and meaning regarding users experiences. To understand user opinions about Maxim's service and functionality, an analysis of user reviews is crucial. Therefore, this research conducts sentiment analysis on Maxim user reviews using the Support Vector Machine (SVM) algorithm to classify reviews quickly. The reviews are categorized into two classes: positive and negative sentiment. The classification process is carried out in three scenarios with different data training and testing ratios: 60:40, 70:30, and 80:20, using a Linear kernel and hyperparameter optimization with GridSearch. The best accuracy is achieved with a 70:30 ratio, which is 89.82%. Evaluation using the confusion matrix also yields a precision of 92.66%, recall of 94.09%, and an F1 score of 93.38%. The ROC-AUC curve evaluation results in an AUC value of 0.8505. The sentiment analysis results tend to lean towards positive sentiment, indicating a high level of user satisfaction with the Maxim application. Based on these sentiment results, developers can identify what aspects of the Maxim application need to be maintained and improved.
网络交通服务平台的不断涌现,是技术不断进步的结果之一。其中一个在线交通服务应用程序Maxim最近在印度尼西亚的叫车服务市场上慢慢取得了进展。根据一家媒体在2022年收集的数据,Maxim在公众最喜欢的在线交通平台中排名第三,仅次于Gojek和Grab。这表明有一些因素导致用户对Maxim应用程序缺乏兴趣或犹豫不决。在Google Play Store中,用户评级(数值)和书面评论是潜在用户缺乏兴趣的原因。单独分析评分不太准确,也不能提供有关用户体验的深入信息和意义。要了解用户对Maxim服务和功能的看法,对用户评论的分析至关重要。因此,本研究采用支持向量机(SVM)算法对Maxim用户评论进行情感分析,快速对评论进行分类。评价分为正面评价和负面评价两类。使用线性核和GridSearch的超参数优化,在三种不同的数据训练和测试比例(60:40、70:30和80:20)下进行分类过程。在70:30的比例下,准确率达到89.82%。使用混淆矩阵的评估也产生了92.66%的精度,94.09%的召回率和93.38%的F1分数。ROC-AUC曲线评价的AUC值为0.8505。情感分析结果倾向于积极的情绪,表明用户对Maxim应用程序的满意度较高。基于这些情感结果,开发人员可以确定Maxim应用程序的哪些方面需要维护和改进。