Abstractive summarization by neural attention model with document content memory

Abstract

In this paper, we propose a generative approach for abstractive summarization, which creates summaries based on a language model. The main goal of our paper is to generate a long sequence of words with coherent sentences by reflecting the key concepts of the original document and the characteristics of summaries. To achieve this goal, we propose an attention mechanism that uses Document Content Memory for learning the language model effectively. To evaluate its effectiveness, the proposed methods are compared with other language models and an extractive summarization method. The results demonstrated that the proposed methods could be competitive with other approaches.