Zar Zar Hlaing, Ye Kyaw Thu, Myat Myo Nwe Wai, T. Supnithi, P. Netisopakul
{"title":"缅甸POS资源扩展对自动标注方法的影响","authors":"Zar Zar Hlaing, Ye Kyaw Thu, Myat Myo Nwe Wai, T. Supnithi, P. Netisopakul","doi":"10.1109/iSAI-NLP51646.2020.9376835","DOIUrl":null,"url":null,"abstract":"Part-of-speech (POS) tagging is the process of assigning the part-of-speech tag or other lexical class marker to each word in a sentence. It is also one of the most important steps in Natural Language Processing (NLP) task pipeline. There are several research works in Myanmar POS tagging implemented with different approaches. However, there is only one publicly available tagged corpus named myPOS corpus. The size of this corpus is only 11 thousand sentences. It is not enough to train downstream NLP tasks, such as machine learning. For this reason, we manually extended the original myPOS corpus as myPOS version 2.0 and the size of the extended corpus becomes approximately triple size of the original myPOS corpus. To evaluate the effects of the extended corpus versus the original corpus, the accuracies of four supervised tagging algorithms, namely, Conditional Random Fields (CRFs), Hidden Markov Model (HMM), Ripple Down Rules based (RDR), and neural sequence labeling approach of Conditional Random Fields $(\\mathrm{NCRF}^{++})$ are compared. The results showed that the extended myPOS version 2.0 improved the accuracies of automatic POS tagging methods compared with the original myPOS.","PeriodicalId":311014,"journal":{"name":"2020 15th International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP)","volume":"46 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":"{\"title\":\"Myanmar POS Resource Extension Effects on Automatic Tagging Methods\",\"authors\":\"Zar Zar Hlaing, Ye Kyaw Thu, Myat Myo Nwe Wai, T. Supnithi, P. Netisopakul\",\"doi\":\"10.1109/iSAI-NLP51646.2020.9376835\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Part-of-speech (POS) tagging is the process of assigning the part-of-speech tag or other lexical class marker to each word in a sentence. It is also one of the most important steps in Natural Language Processing (NLP) task pipeline. There are several research works in Myanmar POS tagging implemented with different approaches. However, there is only one publicly available tagged corpus named myPOS corpus. The size of this corpus is only 11 thousand sentences. It is not enough to train downstream NLP tasks, such as machine learning. For this reason, we manually extended the original myPOS corpus as myPOS version 2.0 and the size of the extended corpus becomes approximately triple size of the original myPOS corpus. To evaluate the effects of the extended corpus versus the original corpus, the accuracies of four supervised tagging algorithms, namely, Conditional Random Fields (CRFs), Hidden Markov Model (HMM), Ripple Down Rules based (RDR), and neural sequence labeling approach of Conditional Random Fields $(\\\\mathrm{NCRF}^{++})$ are compared. The results showed that the extended myPOS version 2.0 improved the accuracies of automatic POS tagging methods compared with the original myPOS.\",\"PeriodicalId\":311014,\"journal\":{\"name\":\"2020 15th International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP)\",\"volume\":\"46 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-11-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"6\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 15th International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/iSAI-NLP51646.2020.9376835\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 15th International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/iSAI-NLP51646.2020.9376835","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Myanmar POS Resource Extension Effects on Automatic Tagging Methods
Part-of-speech (POS) tagging is the process of assigning the part-of-speech tag or other lexical class marker to each word in a sentence. It is also one of the most important steps in Natural Language Processing (NLP) task pipeline. There are several research works in Myanmar POS tagging implemented with different approaches. However, there is only one publicly available tagged corpus named myPOS corpus. The size of this corpus is only 11 thousand sentences. It is not enough to train downstream NLP tasks, such as machine learning. For this reason, we manually extended the original myPOS corpus as myPOS version 2.0 and the size of the extended corpus becomes approximately triple size of the original myPOS corpus. To evaluate the effects of the extended corpus versus the original corpus, the accuracies of four supervised tagging algorithms, namely, Conditional Random Fields (CRFs), Hidden Markov Model (HMM), Ripple Down Rules based (RDR), and neural sequence labeling approach of Conditional Random Fields $(\mathrm{NCRF}^{++})$ are compared. The results showed that the extended myPOS version 2.0 improved the accuracies of automatic POS tagging methods compared with the original myPOS.