The Effect of BERT, ELECTRA and ALBERT Language Models on Sentiment Analysis for Turkish Product Reviews

Nowadays, shopping is done more comfortably and without time constraints with the throwing of e-commerce platforms. These platforms allow consumers to examine reviews before purchasing products. Thus, consumers can decide whether to buy a product with positive or negative comments about the products. In this paper, Turkish sentiment analysis was carried out on the product comments at the Hepsiburada platform. For sentiment analysis, firstly, the success of Random Forest, Naive Bayes and Logistic Regression machine learning methods was measured. Then, the effect of BERT, ELECTRA and ALBERT language models on sentiment analysis was analyzed and the success of language models was compared with machine learning methods. While Naive Bayes achieved the highest accuracy with 89.95% among machine learning methods, ELECTRA was the most successful with 92.54% among language models. As a result of the study, it has been shown that the ELECTRA and ALBERT language models are more successful than machine learning methods.