Accelerating hierarchical distributed latent Dirichlet allocation algorithm by parallel GPU: Accelerating hierarchical distributed latent Dirichlet allocation algorithm by parallel GPU

Abstract

Hierarchical Distributed Latent Dirichlet Allocation(HD-LDA),a popular topic modeling technique for exploring collections,is an improved Latent Dirichlet Allocation(LDA) algorithm running in distributed environment. Mahout has realized HD-LDA algorithm in the framework of Hadoop. However the algorithm processed the whole documents of a single node in sequence,and the execution time of the HD-LDA program was very long when processing a large amount of documents. A new method was proposed to combine Hadoop with Graphic Processing Unit(GPU) to solve the above problem when transferring the computation from CPU to GPU. The application results show that combining the Hadoop with GPU which processes many documents in parallel can decrease the execution time of HD-LDA program greatly and achieve seven times speedup.