Abstract or Full-text in Topic Modeling?

Abstract

Topic modeling is a text mining technique used for automatic extraction of topics addressed in document collections. Although there are different topic models proposed by researchers, the most preferred one is Latent Dirichlet Allocation (LDA). Despite such widespread use, uncertainties about LDA have not been fully resolved yet. In this study, the effect of using abstracts or full-text articles on LDA model parameters is investigated. For this purpose, LDA parameters are optimized on abstracts and full-texts of articles published in two different scientific journals and the results obtained are compared with each other.