Named entity recognition in Assamese using CRFS and rules

Abstract

Named Entity Recognition (NER) is an important task in all Natural Language Processing (NLP) applications. It is the process of identifying and classifying the proper noun into classes such as person, location, organization and miscellaneous. Substantial work has been done in English and other European languages, achieving greater accuracy compared to the Indian Languages. Although NER in Indian languages is a difficult and challenging task and suffers from scarcity of resources, such work has started to appear recently. This paper discusses work on NER in Assamese using both Conditional Random Fields and a Rule-Based approach which gives an F-measure of 90-95% accuracy.