Building Neural Machine Translation Systems for Multilingual Participatory Spaces

P. Lohar, G. Xie, Daniel Gallagher, Andy Way
{"title":"Building Neural Machine Translation Systems for Multilingual Participatory Spaces","authors":"P. Lohar, G. Xie, Daniel Gallagher, Andy Way","doi":"10.3390/analytics2020022","DOIUrl":null,"url":null,"abstract":"This work presents the development of the translation component in a multistage, multilevel, multimode, multilingual and dynamic deliberative (M4D2) system, built to facilitate automated moderation and translation in the languages of five European countries: Italy, Ireland, Germany, France and Poland. Two main topics were to be addressed in the deliberation process: (i) the environment and climate change; and (ii) the economy and inequality. In this work, we describe the development of neural machine translation (NMT) models for these domains for six European languages: Italian, English (included as the second official language of Ireland), Irish, German, French and Polish. As a result, we generate 30 NMT models, initially baseline systems built using freely available online data, which are then adapted to the domains of interest in the project by (i) filtering the corpora, (ii) tuning the systems with automatically extracted in-domain development datasets and (iii) using corpus concatenation techniques to expand the amount of data available. We compare our results produced by the domain-adapted systems with those produced by Google Translate, and demonstrate that fast, high-quality systems can be produced that facilitate multilingual deliberation in a secure environment.","PeriodicalId":93078,"journal":{"name":"Big data analytics","volume":"29 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Big data analytics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3390/analytics2020022","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

This work presents the development of the translation component in a multistage, multilevel, multimode, multilingual and dynamic deliberative (M4D2) system, built to facilitate automated moderation and translation in the languages of five European countries: Italy, Ireland, Germany, France and Poland. Two main topics were to be addressed in the deliberation process: (i) the environment and climate change; and (ii) the economy and inequality. In this work, we describe the development of neural machine translation (NMT) models for these domains for six European languages: Italian, English (included as the second official language of Ireland), Irish, German, French and Polish. As a result, we generate 30 NMT models, initially baseline systems built using freely available online data, which are then adapted to the domains of interest in the project by (i) filtering the corpora, (ii) tuning the systems with automatically extracted in-domain development datasets and (iii) using corpus concatenation techniques to expand the amount of data available. We compare our results produced by the domain-adapted systems with those produced by Google Translate, and demonstrate that fast, high-quality systems can be produced that facilitate multilingual deliberation in a secure environment.
构建多语言参与空间的神经机器翻译系统
本工作介绍了一个多阶段、多层次、多模式、多语言和动态审议(M4D2)系统中翻译部分的开发,该系统旨在促进意大利、爱尔兰、德国、法国和波兰这五个欧洲国家语言的自动审核和翻译。在审议过程中将处理两个主要议题:(i)环境和气候变化;(二)经济和不平等。在这项工作中,我们描述了六种欧洲语言在这些领域的神经机器翻译(NMT)模型的发展:意大利语、英语(包括作为爱尔兰的第二官方语言)、爱尔兰语、德语、法语和波兰语。因此,我们生成了30个NMT模型,最初是使用免费在线数据构建的基线系统,然后通过(i)过滤语料库,(ii)使用自动提取的领域内开发数据集调整系统,以及(iii)使用语料库连接技术来扩展可用的数据量来适应项目中感兴趣的领域。我们将领域适应系统产生的结果与谷歌翻译产生的结果进行了比较,并证明可以产生快速,高质量的系统,以便在安全环境中促进多语言审议。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
审稿时长
5 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信