Functional words removal techniques: A review

Abstract

With the growth of internet activities, electronic documents has become the key source of data and optimization of this data is very important for various research tasks such as Information Retrieval, Natural Language Processing, Web mining, Text mining etc. The data which is present in the web is a combination of both structured as well as unstructured data which mostly contains textual data. Hence, text processing is required for extracting useful information from that type of data which can then be used for further processes. Preprocessing plays a vital role in all text processing activities. Stop-word removal is one of the most important pre-processing techniques which eliminate the functional words from the document. Thus, helps in improving the performance of the system. In this paper, all the stop-word removal techniques used for Indian text are discussed along with the analysis of results produced by using those techniques for various Indian languages is also presented.