Audio to Sign Language conversion using Natural Language Processing

Nayana J, Suparna Bhat, Rekha R Nair, T. Babu
{"title":"Audio to Sign Language conversion using Natural Language Processing","authors":"Nayana J, Suparna Bhat, Rekha R Nair, T. Babu","doi":"10.1109/C2I456876.2022.10051414","DOIUrl":null,"url":null,"abstract":"People who are deaf never get to enjoy things that hearing folks do, whether it's conversation, playing the game, going to seminars, or participating in virtual meetings, for example. The major challenge they have while interacting among regular people is connection, because every regular person has no concept what sign language is or how it works.. Our project's objective is to help those who have hearing loss develop a system for communication. The spoken message is converted into signs. It converts the spoken word into signs. This system receives voice as inputs, converts the soundtrack into a text, and displays the key symbols used in Indian language using well before graphics or GIFs. The use of this technology makes communication between those who have normal hearing and those who are difficult to hear easier This takes into account how your arms, body, and appearance are combined. Around the universe, there really are 135 different varieties of hand signals. There are numerous different sign languages, including American Sign Language (ASL), Indian Sign Language (ISL), British Sign Language (BSL), Australian Sign Language (Auslan), and many more In this initiative, Indian Sign Language is being used. The deaf community may take advantage of all the activities that hearing people engage in, from social engagement to accessing information, thanks to this technology. NLP is used to pre-process the text (Natural Language Processing). With the help of this technology, hearing-impaired people may participate in a wide range of activities, from socialising to accessing information NLP is used to post the text (Natural Language Processing). This programme converts audio into text, displays Indian sign language, and then accepts speech as input. Accuracy rate for the planned project work is 99%, and Validation accuracy is 96%.","PeriodicalId":165055,"journal":{"name":"2022 3rd International Conference on Communication, Computing and Industry 4.0 (C2I4)","volume":"46 22","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 3rd International Conference on Communication, Computing and Industry 4.0 (C2I4)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/C2I456876.2022.10051414","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

People who are deaf never get to enjoy things that hearing folks do, whether it's conversation, playing the game, going to seminars, or participating in virtual meetings, for example. The major challenge they have while interacting among regular people is connection, because every regular person has no concept what sign language is or how it works.. Our project's objective is to help those who have hearing loss develop a system for communication. The spoken message is converted into signs. It converts the spoken word into signs. This system receives voice as inputs, converts the soundtrack into a text, and displays the key symbols used in Indian language using well before graphics or GIFs. The use of this technology makes communication between those who have normal hearing and those who are difficult to hear easier This takes into account how your arms, body, and appearance are combined. Around the universe, there really are 135 different varieties of hand signals. There are numerous different sign languages, including American Sign Language (ASL), Indian Sign Language (ISL), British Sign Language (BSL), Australian Sign Language (Auslan), and many more In this initiative, Indian Sign Language is being used. The deaf community may take advantage of all the activities that hearing people engage in, from social engagement to accessing information, thanks to this technology. NLP is used to pre-process the text (Natural Language Processing). With the help of this technology, hearing-impaired people may participate in a wide range of activities, from socialising to accessing information NLP is used to post the text (Natural Language Processing). This programme converts audio into text, displays Indian sign language, and then accepts speech as input. Accuracy rate for the planned project work is 99%, and Validation accuracy is 96%.
使用自然语言处理的音频到手语转换
聋人永远不会享受正常人所做的事情,无论是交谈,玩游戏,参加研讨会,还是参加虚拟会议。他们在与普通人互动时遇到的主要挑战是联系,因为每个普通人都不知道什么是手语,也不知道它是如何工作的。我们项目的目标是帮助那些有听力损失的人建立一个沟通系统。口头信息被转换成符号。它将口头语言转化为符号。该系统接收声音作为输入,将原声转换为文本,并在图形或gif之前显示印度语中使用的关键符号。这项技术的使用使听力正常的人和听力困难的人之间的交流变得更加容易,这需要考虑到你的手臂、身体和外表是如何结合在一起的。在宇宙中,有135种不同的手势。有许多不同的手语,包括美国手语(ASL),印度手语(ISL),英国手语(BSL),澳大利亚手语(Auslan)等等。在这项倡议中,印度手语被使用。多亏了这项技术,聋人社区可以利用正常人参与的所有活动,从社交活动到获取信息。NLP用于文本的预处理(自然语言处理)。在这项技术的帮助下,听障人士可以参与广泛的活动,从社交到获取信息,NLP用于发布文本(自然语言处理)。这个程序将音频转换为文本,显示印度手语,然后接受语音输入。计划项目工作的准确率为99%,验证准确率为96%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信