Ano Raw: A Deep Learning Based Approach to Transliterating the Filipino Sign Language

Mark Allen Cabutaje, Kenneth Ang Brondial, Alyssa Franchesca Obillo, Mideth B. Abisado, Shekinah Lor B. Huyo-a, G. Sampedro
{"title":"Ano Raw: A Deep Learning Based Approach to Transliterating the Filipino Sign Language","authors":"Mark Allen Cabutaje, Kenneth Ang Brondial, Alyssa Franchesca Obillo, Mideth B. Abisado, Shekinah Lor B. Huyo-a, G. Sampedro","doi":"10.1109/ICEIC57457.2023.10049890","DOIUrl":null,"url":null,"abstract":"Deaf people communicate best through sign language. It is one of the most vital languages worldwide. Sign languages, like spoken languages, are sophisticated, naturally formed structures that are arranged around a set of conversational activities. In the Philippines, practicing Filipino Sign Language (FSL) already had improved communication for deaf people. However, the community’s main difficulty is that most Filipinos do not comprehend or use FSL. Within the deaf community, these gestures, whether ASL or FSL, are still limited. People who are normal and hearing would never attempt to learn sign language. This results in a significant communication gap between the deaf and the hearing. Human translators are needed in order for deaf people to be understood. While they can be helpful, they are not always available or attainable. Filipino Sign Language Alphabet Recognition using Convolutional Neural Networks (CNN) is proposed to address this growing challenge. The proposed solution can recognize and forecast a letter using an image training model. The model peaked at the 15th epoch, with an accuracy rate of 92% and validation accuracy of 93%. The study aims to bridge the gaps between the deaf community with the hearing in the Philippines.","PeriodicalId":373752,"journal":{"name":"2023 International Conference on Electronics, Information, and Communication (ICEIC)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 International Conference on Electronics, Information, and Communication (ICEIC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICEIC57457.2023.10049890","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

Deaf people communicate best through sign language. It is one of the most vital languages worldwide. Sign languages, like spoken languages, are sophisticated, naturally formed structures that are arranged around a set of conversational activities. In the Philippines, practicing Filipino Sign Language (FSL) already had improved communication for deaf people. However, the community’s main difficulty is that most Filipinos do not comprehend or use FSL. Within the deaf community, these gestures, whether ASL or FSL, are still limited. People who are normal and hearing would never attempt to learn sign language. This results in a significant communication gap between the deaf and the hearing. Human translators are needed in order for deaf people to be understood. While they can be helpful, they are not always available or attainable. Filipino Sign Language Alphabet Recognition using Convolutional Neural Networks (CNN) is proposed to address this growing challenge. The proposed solution can recognize and forecast a letter using an image training model. The model peaked at the 15th epoch, with an accuracy rate of 92% and validation accuracy of 93%. The study aims to bridge the gaps between the deaf community with the hearing in the Philippines.
Ano Raw:基于深度学习的菲律宾手语音译方法
聋人最好通过手语进行交流。它是世界上最重要的语言之一。手语和口语一样,是复杂的、自然形成的结构,围绕着一系列对话活动进行安排。在菲律宾,练习菲律宾手语(FSL)已经改善了聋人的沟通。然而,社区的主要困难是大多数菲律宾人不理解或使用FSL。在聋人群体中,这些手势,无论是美国手语还是手语,仍然是有限的。正常人和听力正常的人永远不会尝试学习手语。这就导致了聋人与正常人之间的交流有很大的差距。为了让聋哑人被理解,需要人工翻译。虽然它们可能很有帮助,但它们并不总是可用或可实现的。使用卷积神经网络(CNN)的菲律宾手语字母表识别被提出来解决这一日益严峻的挑战。该方法利用图像训练模型对字母进行识别和预测。模型在第15历元达到峰值,准确率为92%,验证准确率为93%。这项研究旨在弥合菲律宾聋人社区与正常人之间的差距。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信