基于n -最优句法知识增强的统计机器翻译预排序模型

Junyan Liu
{"title":"基于n -最优句法知识增强的统计机器翻译预排序模型","authors":"Junyan Liu","doi":"10.1145/3573428.3573448","DOIUrl":null,"url":null,"abstract":"Syntactic heterogeneity between source and target languages has an important impact on the performance of Statistical Machine Translation (SMT). On the basis of phrase-based Chinese-English SMT, a method of source language pre-ordering based on N-best syntactic knowledge enhancement is proposed. First, the source language input sentences are analyzed by N-best Syntax, and the high reliability sub-tree structure is obtained by calculating statistical probability. Two optimization strategies are used to optimize the initial rule set: rule deduction and rule probability threshold control mechanism. Second, the source language phrase translation table is used as a constraint to control the sequence between phrases. Finally, the syntax analysis tree of the source-side sentences is pre-ordered. The experimental results of Chinese-English SMT based on the NIST 2005 and 2008 test data sets show that comparing to the baseline system, the BLEU score of automatic evaluation criterion of the N-best syntactic knowledge-enhanced SMT pre-ordering method increased by 0.68 and 0.83 respectively.","PeriodicalId":314698,"journal":{"name":"Proceedings of the 2022 6th International Conference on Electronic Information Technology and Computer Engineering","volume":"13 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The Pre-ordering Model for Statistical Machine Translation of Enhancing the N-best Syntactic Knowledge\",\"authors\":\"Junyan Liu\",\"doi\":\"10.1145/3573428.3573448\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Syntactic heterogeneity between source and target languages has an important impact on the performance of Statistical Machine Translation (SMT). On the basis of phrase-based Chinese-English SMT, a method of source language pre-ordering based on N-best syntactic knowledge enhancement is proposed. First, the source language input sentences are analyzed by N-best Syntax, and the high reliability sub-tree structure is obtained by calculating statistical probability. Two optimization strategies are used to optimize the initial rule set: rule deduction and rule probability threshold control mechanism. Second, the source language phrase translation table is used as a constraint to control the sequence between phrases. Finally, the syntax analysis tree of the source-side sentences is pre-ordered. The experimental results of Chinese-English SMT based on the NIST 2005 and 2008 test data sets show that comparing to the baseline system, the BLEU score of automatic evaluation criterion of the N-best syntactic knowledge-enhanced SMT pre-ordering method increased by 0.68 and 0.83 respectively.\",\"PeriodicalId\":314698,\"journal\":{\"name\":\"Proceedings of the 2022 6th International Conference on Electronic Information Technology and Computer Engineering\",\"volume\":\"13 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 2022 6th International Conference on Electronic Information Technology and Computer Engineering\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3573428.3573448\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2022 6th International Conference on Electronic Information Technology and Computer Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3573428.3573448","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

源语言和目标语言之间的句法异质性对统计机器翻译的性能有重要影响。在基于短语的汉英SMT的基础上,提出了一种基于N-best句法知识增强的源语言预排序方法。首先,采用N-best句法对源语言输入句子进行分析,通过统计概率计算得到高可靠性子树结构;采用规则演绎和规则概率阈值控制机制两种优化策略对初始规则集进行优化。其次,使用源语言短语翻译表作为约束来控制短语之间的顺序。最后,对源端句子的语法分析树进行预先排序。基于NIST 2005年和2008年测试数据集的汉英SMT实验结果表明,与基线系统相比,N-best句法知识增强SMT预排序方法的自动评价标准BLEU得分分别提高了0.68和0.83。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
The Pre-ordering Model for Statistical Machine Translation of Enhancing the N-best Syntactic Knowledge
Syntactic heterogeneity between source and target languages has an important impact on the performance of Statistical Machine Translation (SMT). On the basis of phrase-based Chinese-English SMT, a method of source language pre-ordering based on N-best syntactic knowledge enhancement is proposed. First, the source language input sentences are analyzed by N-best Syntax, and the high reliability sub-tree structure is obtained by calculating statistical probability. Two optimization strategies are used to optimize the initial rule set: rule deduction and rule probability threshold control mechanism. Second, the source language phrase translation table is used as a constraint to control the sequence between phrases. Finally, the syntax analysis tree of the source-side sentences is pre-ordered. The experimental results of Chinese-English SMT based on the NIST 2005 and 2008 test data sets show that comparing to the baseline system, the BLEU score of automatic evaluation criterion of the N-best syntactic knowledge-enhanced SMT pre-ordering method increased by 0.68 and 0.83 respectively.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信