A Hybrid Approach to Paraphrase Detection

In this paper, we present a hybrid approach to the paraphrase detection task. The approach takes advantage of both feature-engineering and neural-based methods. First, we represent words and entities in a given sentence by using their pre-trained vectors. Then, those pre-trained vectors are encoded by a bidirectional long-short term memory network. The output matrix is fed into an attention network to obtain an attention vector. The final representation of the sentence is inner product of the matrix and the attention vector. We conduct experiments on the Microsoft Research Paraphrase corpus, a popular dataset used for benchmarking paraphrase detection methods. The experimental results show that our approach achieves competitive results.