N. Arvanitis, C. Constantinopoulos, D. Kosmopoulos
{"title":"使用序列到序列注意模型的手语注释翻译","authors":"N. Arvanitis, C. Constantinopoulos, D. Kosmopoulos","doi":"10.1109/SITIS.2019.00056","DOIUrl":null,"url":null,"abstract":"This work deals with the problem of Sign Language Translation and more specifically with translating Glosses to text. We applied Sequence to Sequence models with attention mechanism to a parallel gloss to English corpus. This is the first work that used these models to translate American gloss sentences to English. We present our experiments on several network architectures with three different attention functions. The results are very promising and can be useful for the further implementation of a full sign language recognition system.","PeriodicalId":301876,"journal":{"name":"2019 15th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS)","volume":"47 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"16","resultStr":"{\"title\":\"Translation of Sign Language Glosses to Text Using Sequence-to-Sequence Attention Models\",\"authors\":\"N. Arvanitis, C. Constantinopoulos, D. Kosmopoulos\",\"doi\":\"10.1109/SITIS.2019.00056\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This work deals with the problem of Sign Language Translation and more specifically with translating Glosses to text. We applied Sequence to Sequence models with attention mechanism to a parallel gloss to English corpus. This is the first work that used these models to translate American gloss sentences to English. We present our experiments on several network architectures with three different attention functions. The results are very promising and can be useful for the further implementation of a full sign language recognition system.\",\"PeriodicalId\":301876,\"journal\":{\"name\":\"2019 15th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS)\",\"volume\":\"47 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"16\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 15th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SITIS.2019.00056\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 15th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SITIS.2019.00056","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 16
摘要
这项工作涉及到手语翻译的问题,更具体地说,是将注释翻译成文本。我们将Sequence to Sequence模型与注意机制应用于英语语料库的并行注释。这是第一个使用这些模型将美式注释句翻译成英语的作品。我们在几种具有三种不同注意力函数的网络架构上进行了实验。研究结果对进一步实现完整的手语识别系统具有重要意义。
Translation of Sign Language Glosses to Text Using Sequence-to-Sequence Attention Models
This work deals with the problem of Sign Language Translation and more specifically with translating Glosses to text. We applied Sequence to Sequence models with attention mechanism to a parallel gloss to English corpus. This is the first work that used these models to translate American gloss sentences to English. We present our experiments on several network architectures with three different attention functions. The results are very promising and can be useful for the further implementation of a full sign language recognition system.