Named Entity Recognition in Vietnamese documents

Q. Tran, T. Pham, Quoc Hung Ngo, D. Dinh, Nigel Collier
{"title":"Named Entity Recognition in Vietnamese documents","authors":"Q. Tran, T. Pham, Quoc Hung Ngo, D. Dinh, Nigel Collier","doi":"10.2201/NIIPI.2007.4.2","DOIUrl":null,"url":null,"abstract":"NamedEntityRecognition (NER) aimstoclassify wordsin a documentintopre-definedtarget entity classes and is now considered to be fundamental for many natural language processing tasks such a si nformation retrieval, machine translation, information extraction and question answering. This paper presents the results of an experiment in which a Support Vector Machine (SVM) based NER model is applied to the Vietnamese language. Though this state of the art machine learning method has been widely applied to NER in several well-studied languages, this is the first time this method has been applied to Vietnamese. In a comparison against Conditional Random Fields (CRFs) the SVM model was shown to outperform CRF by optimizing its feature window size, obtaining an overall F-score of 87.75. The paper also presents a detailed discussion about the characteristics of the Vietnamese language and provides an analysis of the factors which influence performance in this task.","PeriodicalId":91638,"journal":{"name":"... Proceedings of the ... IEEE International Conference on Progress in Informatics and Computing. IEEE International Conference on Progress in Informatics and Computing","volume":"21 1 1","pages":"5"},"PeriodicalIF":0.0000,"publicationDate":"2007-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"34","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"... Proceedings of the ... IEEE International Conference on Progress in Informatics and Computing. IEEE International Conference on Progress in Informatics and Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2201/NIIPI.2007.4.2","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 34

Abstract

NamedEntityRecognition (NER) aimstoclassify wordsin a documentintopre-definedtarget entity classes and is now considered to be fundamental for many natural language processing tasks such a si nformation retrieval, machine translation, information extraction and question answering. This paper presents the results of an experiment in which a Support Vector Machine (SVM) based NER model is applied to the Vietnamese language. Though this state of the art machine learning method has been widely applied to NER in several well-studied languages, this is the first time this method has been applied to Vietnamese. In a comparison against Conditional Random Fields (CRFs) the SVM model was shown to outperform CRF by optimizing its feature window size, obtaining an overall F-score of 87.75. The paper also presents a detailed discussion about the characteristics of the Vietnamese language and provides an analysis of the factors which influence performance in this task.
越南文件中的命名实体识别
命名实体识别(NER)的目的是将文档中的单词分类到重新定义的目标实体类中,现在被认为是许多自然语言处理任务的基础,例如信息检索、机器翻译、信息提取和问答。本文介绍了一种基于支持向量机(SVM)的NER模型应用于越南语的实验结果。尽管这种最先进的机器学习方法已被广泛应用于几种经过充分研究的语言的NER,但这是该方法首次应用于越南语。在与条件随机场(CRF)的比较中,SVM模型通过优化其特征窗口大小而优于CRF,获得了87.75的总体f分。本文还详细讨论了越南语的特点,并分析了影响这项任务表现的因素。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信