A Multimodal Multimedia Retrieval Model Based on pLSA

Abstract

In this paper, we propose a multimodal multimedia retrieval model based on probabilistic Latent Semantic analysis (pLSA) to achieve multimodal retrieval. Firstly, We employ pLSA, to respectively simulate the generative processes of texts and images in the same documents. Then we employ the multivariate linear regression method to analyze the correlation between representations of texts and images and use the ordinary least squares (OLS) method to obtain the estimation of the regression matrix that can be used to transform between textual and visual modal data. Extensive experiments results demonstrate the effectiveness and efficiency of the proposed model.