Machine Learning-based Weibo user group profiling under hot events

Abstract

The construction of Weibo user profiles in hot events can help to grasp the characteristics of Weibo users involved in the events, which is conductive to the relevant department to strengthen public opinion guidance and propaganda education. Taking the “Viya's tax evasion” case as an example, firstly, the Latent Dirichlet allocation (LDA) topic model is used to construct a topic model ofWeibo content in the case, and the optimal number of topics is determined by perplexity. Then, the k-prototype algorithm and the improved Density-Based Spatial Clustering of Applications with Noise (DBSCAN) algorithm are respectively used to cluster Weibo users and analyze the similarities and differences between the various categories of users. At last, the clustering results of the two algorithms are compared. The experiments show that the topic generation method based on the LDA topic model has a good effect on describing discussion topics. In the process of data containing mixed attributes, the k-Prototype algorithm and the improved DBSCAN algorithm have their respective advantages, and the combined results of the two algorithms can obtain a more complete user group portrait.