英语到泰米尔语的多模态图像字幕翻译

V. H. Vishnu Kumar, N. Lalithamani
{"title":"英语到泰米尔语的多模态图像字幕翻译","authors":"V. H. Vishnu Kumar, N. Lalithamani","doi":"10.1109/AIC55036.2022.9848810","DOIUrl":null,"url":null,"abstract":"Bridging the gap between the latest technologies and the local languages, Machine Translation has had a big impact on countless non-English speakers who do not get access to these latest technologies coming out which are exclusive only to English Speakers. One such new research field which requires the intervention of Translation is the domain of Image Captioning. With the potential to impact 75 million worldwide users of the language, we have created a one-of-a-kind unique Tamil Image Captioning Dataset, translated from Microsoft’s Common Objects in Context Dataset or commonly called the COCO Dataset, for Captioning of Images in the language of Tamil. With the help of the dataset created, this research work will explore several multi-modal architectures to provide captions of images directly in the language of Tamil for any given input Image. The results of the captions generated have been discussed and evaluated using the popular evaluation metric, Bilingual Evaluation Understudy Score (BLEU).","PeriodicalId":433590,"journal":{"name":"2022 IEEE World Conference on Applied Intelligence and Computing (AIC)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"English to Tamil Multi-Modal Image Captioning Translation\",\"authors\":\"V. H. Vishnu Kumar, N. Lalithamani\",\"doi\":\"10.1109/AIC55036.2022.9848810\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Bridging the gap between the latest technologies and the local languages, Machine Translation has had a big impact on countless non-English speakers who do not get access to these latest technologies coming out which are exclusive only to English Speakers. One such new research field which requires the intervention of Translation is the domain of Image Captioning. With the potential to impact 75 million worldwide users of the language, we have created a one-of-a-kind unique Tamil Image Captioning Dataset, translated from Microsoft’s Common Objects in Context Dataset or commonly called the COCO Dataset, for Captioning of Images in the language of Tamil. With the help of the dataset created, this research work will explore several multi-modal architectures to provide captions of images directly in the language of Tamil for any given input Image. The results of the captions generated have been discussed and evaluated using the popular evaluation metric, Bilingual Evaluation Understudy Score (BLEU).\",\"PeriodicalId\":433590,\"journal\":{\"name\":\"2022 IEEE World Conference on Applied Intelligence and Computing (AIC)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-06-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE World Conference on Applied Intelligence and Computing (AIC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/AIC55036.2022.9848810\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE World Conference on Applied Intelligence and Computing (AIC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/AIC55036.2022.9848810","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

机器翻译弥合了最新技术和当地语言之间的差距,对无数非英语人士产生了巨大影响,他们无法接触到这些只有英语人士才能接触到的最新技术。其中一个需要翻译介入的新研究领域就是图像字幕领域。由于有可能影响全球7500万泰米尔语用户,我们已经创建了一个独一无二的泰米尔语图像字幕数据集,翻译自微软的通用对象上下文数据集或通常称为COCO数据集,用于泰米尔语图像字幕。在创建的数据集的帮助下,本研究工作将探索几种多模式架构,为任何给定的输入图像直接提供泰米尔语的图像标题。使用流行的评估指标——双语评估替补评分(BLEU),对生成的字幕结果进行了讨论和评估。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
English to Tamil Multi-Modal Image Captioning Translation
Bridging the gap between the latest technologies and the local languages, Machine Translation has had a big impact on countless non-English speakers who do not get access to these latest technologies coming out which are exclusive only to English Speakers. One such new research field which requires the intervention of Translation is the domain of Image Captioning. With the potential to impact 75 million worldwide users of the language, we have created a one-of-a-kind unique Tamil Image Captioning Dataset, translated from Microsoft’s Common Objects in Context Dataset or commonly called the COCO Dataset, for Captioning of Images in the language of Tamil. With the help of the dataset created, this research work will explore several multi-modal architectures to provide captions of images directly in the language of Tamil for any given input Image. The results of the captions generated have been discussed and evaluated using the popular evaluation metric, Bilingual Evaluation Understudy Score (BLEU).
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信