An Answer Summarization Scheme Based on Multilayer Attention Model

At present, deep learning technologies have been widely used in the field of natural language process, such as text summarization. In CQA, the answer summary could help users get a complete answer quickly. There are still some problems with the current answer summary scheme, such as semantic inconsistency, repetition of words, etc. In order to solve this, we propose a novel scheme Answer Summarization based on Multi-layer Attention Scheme (ASMAM). Based on the traditional Seq2Seq, we introduce self-attention and multi-head attention scheme respectively during sentence and text encoding, which could improve text representation ability of the model. In order to solve "long distance dependence" of RNN and too many parameters of LSTM, we all use GRU as the neuron at the encoder and decoder sides. Experiments over the Yahoo! Answers dataset demonstrate that the coherence and fluency of the generated summary are all superior to the benchmark model in ROUGE evaluation system.