Advanced NLP Framework for Text Processing

Abstract

Natural language processing (NLP) used in platform such as machine translation, chatbot, and text generation etc., Text augmentation helps in providing the suitable answer for the given instance. Nlpaug is a text augmentation library which helps in augmenting the text. In this paper different NLP framework is provided and implemented. Advanced open source library makes use of neural network for effective result generation. The objectives of this paper are to apply and implement the advanced NLP framework for text processing and compare various open source library for natural language processing. Advanced library used in this paper are nlpaug, texthero, nltk, spacy, gensim, sklearn. Text augmentation can be done in more predominate manner with the help of nlpaug. Further, nlpaug can be used to train the conversational chatbot effectively. However, nlpaug library and other library is having the drawback such as understanding the meanings emojis and any other special characters from the string.