Image generation using generative adversarial networks and attention mechanism

Abstract

For image generation, deep neural networks are trained to extract high-level features on natural images and to reconstruct the images from the features. However it is difficult to learn to generate images containing enormous contents. To overcome this difficulty, a network with an attention mechanism has been proposed. It is trained to attend to parts of the image and to generate images step by step. This enables the network to deal with the details of a part of the image and the rough structure of the entire image. The attention mechanism is implemented by recurrent neural networks. Additionally, the Generative Adversarial Networks (GANs) approach has been proposed to generate more realistic images. In this study, we present image generation where leverages effectiveness of attention mechanism and the GANs approach. We show our method enables the iterative construction of images and more realistic image generation than standard GANs and the attention mechanism of DRAW.