Ilham Zharif Mustaqim, Hasna Melani Puspasari, Avita Tri Utami, Rahmad Syalevi, Y. Ruldeviyani
{"title":"利用监督机器学习评估公众对公共服务应用的满意度","authors":"Ilham Zharif Mustaqim, Hasna Melani Puspasari, Avita Tri Utami, Rahmad Syalevi, Y. Ruldeviyani","doi":"10.11591/ijai.v13.i2.pp1608-1618","DOIUrl":null,"url":null,"abstract":"The COVID-19 pandemic has enormously affected the economic situation worldwide, including in Indonesia resulting in 30 million Indonesian tumbling into penury. The Ministry of Social Affairs initiated a program to distribute social assistance aimed at the poorest households. ‘Aplikasi Cek Bansos’ is a public service application that aims to validate their status towards the social assistance program. Understanding the public sentiment and factors affecting public satisfaction levels is crucial to be performed. The goal of this study is to perform a comparative study of supervised machine learning to learn the sentiment of the public and the dominant variable resulting in public satisfaction. Support vector machine, Naïve Bayes dan K-nearest neighbor (KNN) are performed to seek the highest accuracy. This experiment discovered that the KNN algorithm produced outstanding performance where the accuracy hit 99.21%. Sentiment prediction indicated negative perception as the majority covering 83.81%. Trigrams analysis is performed to learn themes affecting satisfaction levels toward the application. Negative themes are grouped into the following categories: App instability, hope for improvement, navigation issues, and low-quality content. Some recommendations are offered for the Ministry of Social Affairs and developers, to overcome negative feedback and enhance public satisfaction level towards the application.","PeriodicalId":507934,"journal":{"name":"IAES International Journal of Artificial Intelligence (IJ-AI)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Assessing public satisfaction of public service application using supervised machine learning\",\"authors\":\"Ilham Zharif Mustaqim, Hasna Melani Puspasari, Avita Tri Utami, Rahmad Syalevi, Y. Ruldeviyani\",\"doi\":\"10.11591/ijai.v13.i2.pp1608-1618\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The COVID-19 pandemic has enormously affected the economic situation worldwide, including in Indonesia resulting in 30 million Indonesian tumbling into penury. The Ministry of Social Affairs initiated a program to distribute social assistance aimed at the poorest households. ‘Aplikasi Cek Bansos’ is a public service application that aims to validate their status towards the social assistance program. Understanding the public sentiment and factors affecting public satisfaction levels is crucial to be performed. The goal of this study is to perform a comparative study of supervised machine learning to learn the sentiment of the public and the dominant variable resulting in public satisfaction. Support vector machine, Naïve Bayes dan K-nearest neighbor (KNN) are performed to seek the highest accuracy. This experiment discovered that the KNN algorithm produced outstanding performance where the accuracy hit 99.21%. Sentiment prediction indicated negative perception as the majority covering 83.81%. Trigrams analysis is performed to learn themes affecting satisfaction levels toward the application. Negative themes are grouped into the following categories: App instability, hope for improvement, navigation issues, and low-quality content. Some recommendations are offered for the Ministry of Social Affairs and developers, to overcome negative feedback and enhance public satisfaction level towards the application.\",\"PeriodicalId\":507934,\"journal\":{\"name\":\"IAES International Journal of Artificial Intelligence (IJ-AI)\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IAES International Journal of Artificial Intelligence (IJ-AI)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.11591/ijai.v13.i2.pp1608-1618\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IAES International Journal of Artificial Intelligence (IJ-AI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.11591/ijai.v13.i2.pp1608-1618","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Assessing public satisfaction of public service application using supervised machine learning
The COVID-19 pandemic has enormously affected the economic situation worldwide, including in Indonesia resulting in 30 million Indonesian tumbling into penury. The Ministry of Social Affairs initiated a program to distribute social assistance aimed at the poorest households. ‘Aplikasi Cek Bansos’ is a public service application that aims to validate their status towards the social assistance program. Understanding the public sentiment and factors affecting public satisfaction levels is crucial to be performed. The goal of this study is to perform a comparative study of supervised machine learning to learn the sentiment of the public and the dominant variable resulting in public satisfaction. Support vector machine, Naïve Bayes dan K-nearest neighbor (KNN) are performed to seek the highest accuracy. This experiment discovered that the KNN algorithm produced outstanding performance where the accuracy hit 99.21%. Sentiment prediction indicated negative perception as the majority covering 83.81%. Trigrams analysis is performed to learn themes affecting satisfaction levels toward the application. Negative themes are grouped into the following categories: App instability, hope for improvement, navigation issues, and low-quality content. Some recommendations are offered for the Ministry of Social Affairs and developers, to overcome negative feedback and enhance public satisfaction level towards the application.