A Short Text Topic Model Based on Semantics and Word Expansion

Abstract

In recent years, with the increasing amount of short text information, there are more and more researches on short text information, and the topic information analysis of short texts is one of the key researches. In order to overcome the sparsity problem of short text datasets, this paper conducts research on the basis of the short text topic model Biterm Topic Model (BTM). Aiming at the problem of lack of semantic association in BTM model, this paper proposes a biterm acquisition method based on semantic dependencies. The method firstly apply semantic analysis on the text, and then combines words with strong correlation into biterm. The semantic relevance between words in biterm is enhanced. In order to further solve the text sparse problem, this paper proposes to expand the number of biterms based on similarity calculation of words and calculation of relationship between words. This method not only solves the sparsity problem, but also enhances the topic tendency of text.