缅甸POS资源扩展对自动标注方法的影响

Zar Zar Hlaing, Ye Kyaw Thu, Myat Myo Nwe Wai, T. Supnithi, P. Netisopakul
{"title":"缅甸POS资源扩展对自动标注方法的影响","authors":"Zar Zar Hlaing, Ye Kyaw Thu, Myat Myo Nwe Wai, T. Supnithi, P. Netisopakul","doi":"10.1109/iSAI-NLP51646.2020.9376835","DOIUrl":null,"url":null,"abstract":"Part-of-speech (POS) tagging is the process of assigning the part-of-speech tag or other lexical class marker to each word in a sentence. It is also one of the most important steps in Natural Language Processing (NLP) task pipeline. There are several research works in Myanmar POS tagging implemented with different approaches. However, there is only one publicly available tagged corpus named myPOS corpus. The size of this corpus is only 11 thousand sentences. It is not enough to train downstream NLP tasks, such as machine learning. For this reason, we manually extended the original myPOS corpus as myPOS version 2.0 and the size of the extended corpus becomes approximately triple size of the original myPOS corpus. To evaluate the effects of the extended corpus versus the original corpus, the accuracies of four supervised tagging algorithms, namely, Conditional Random Fields (CRFs), Hidden Markov Model (HMM), Ripple Down Rules based (RDR), and neural sequence labeling approach of Conditional Random Fields $(\\mathrm{NCRF}^{++})$ are compared. The results showed that the extended myPOS version 2.0 improved the accuracies of automatic POS tagging methods compared with the original myPOS.","PeriodicalId":311014,"journal":{"name":"2020 15th International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP)","volume":"46 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":"{\"title\":\"Myanmar POS Resource Extension Effects on Automatic Tagging Methods\",\"authors\":\"Zar Zar Hlaing, Ye Kyaw Thu, Myat Myo Nwe Wai, T. Supnithi, P. Netisopakul\",\"doi\":\"10.1109/iSAI-NLP51646.2020.9376835\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Part-of-speech (POS) tagging is the process of assigning the part-of-speech tag or other lexical class marker to each word in a sentence. It is also one of the most important steps in Natural Language Processing (NLP) task pipeline. There are several research works in Myanmar POS tagging implemented with different approaches. However, there is only one publicly available tagged corpus named myPOS corpus. The size of this corpus is only 11 thousand sentences. It is not enough to train downstream NLP tasks, such as machine learning. For this reason, we manually extended the original myPOS corpus as myPOS version 2.0 and the size of the extended corpus becomes approximately triple size of the original myPOS corpus. To evaluate the effects of the extended corpus versus the original corpus, the accuracies of four supervised tagging algorithms, namely, Conditional Random Fields (CRFs), Hidden Markov Model (HMM), Ripple Down Rules based (RDR), and neural sequence labeling approach of Conditional Random Fields $(\\\\mathrm{NCRF}^{++})$ are compared. The results showed that the extended myPOS version 2.0 improved the accuracies of automatic POS tagging methods compared with the original myPOS.\",\"PeriodicalId\":311014,\"journal\":{\"name\":\"2020 15th International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP)\",\"volume\":\"46 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-11-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"6\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 15th International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/iSAI-NLP51646.2020.9376835\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 15th International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/iSAI-NLP51646.2020.9376835","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 6

摘要

词性标记是为句子中的每个单词指定词性标记或其他词性类标记的过程。它也是自然语言处理(NLP)任务流水线中最重要的步骤之一。在缅甸有几个研究工作,用不同的方法实施POS标签。然而,只有一个公开可用的标记语料库,名为myPOS语料库。这个语料库的大小只有11000个句子。仅仅训练下游的NLP任务是不够的,比如机器学习。因此,我们手动将原始myPOS语料库扩展为myPOS 2.0版本,扩展后的语料库的大小大约是原始myPOS语料库的三倍。为了评估扩展语料库与原始语料库的效果,比较了四种监督标记算法的准确性,即条件随机场(CRFs)、隐马尔可夫模型(HMM)、基于Ripple Down规则(RDR)和条件随机场(\ mathm {NCRF}^{++})$的神经序列标记方法。结果表明,扩展后的myPOS 2.0版本与原始myPOS相比,提高了自动标注方法的准确率。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Myanmar POS Resource Extension Effects on Automatic Tagging Methods
Part-of-speech (POS) tagging is the process of assigning the part-of-speech tag or other lexical class marker to each word in a sentence. It is also one of the most important steps in Natural Language Processing (NLP) task pipeline. There are several research works in Myanmar POS tagging implemented with different approaches. However, there is only one publicly available tagged corpus named myPOS corpus. The size of this corpus is only 11 thousand sentences. It is not enough to train downstream NLP tasks, such as machine learning. For this reason, we manually extended the original myPOS corpus as myPOS version 2.0 and the size of the extended corpus becomes approximately triple size of the original myPOS corpus. To evaluate the effects of the extended corpus versus the original corpus, the accuracies of four supervised tagging algorithms, namely, Conditional Random Fields (CRFs), Hidden Markov Model (HMM), Ripple Down Rules based (RDR), and neural sequence labeling approach of Conditional Random Fields $(\mathrm{NCRF}^{++})$ are compared. The results showed that the extended myPOS version 2.0 improved the accuracies of automatic POS tagging methods compared with the original myPOS.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信