A Brief History of Deep Learning-Based Text Generation

A dynamic domain in Artificial Intelligence research, Natural Language Generation centres on the automatic generation of realistic text. To help navigate this vast and swiftly developing body of work, the study provides a concise overview of noteworthy stages in the history of text generation. To this end, the paper describes deep learning models for a broad audience, focusing on traditional, convolutional, recurrent and generative adversarial networks, as well as transformer architecture.