A Comprehensive Study on Relative Distances of Hand Landmarks Approach for American Sign Language Gesture

Shail Shah, Jaynil Vaidya, Kishan Pipariya, Manan Shah
{"title":"A Comprehensive Study on Relative Distances of Hand Landmarks Approach for American Sign Language Gesture","authors":"Shail Shah,&nbsp;Jaynil Vaidya,&nbsp;Kishan Pipariya,&nbsp;Manan Shah","doi":"10.1007/s41133-024-00064-w","DOIUrl":null,"url":null,"abstract":"<div><p>Communication with people with hearing or speaking disabilities is always difficult when there is no knowledge of sign language. The presence of sign language is not enough to communicate smoothly, this process requires another easy medium for communication to make it more efficient, that is, via a digital medium. This paper proposes using Feed-Forward Neural Networks on hand landmarks for real-time sign language identification. The hand landmarks identification was carried out using the MediaPipe Hands library. This approach would make the classification problem efficient by making it faster and requiring less memory. Through this, we aim to bridge the gap between the difficulties that arise during communication between people who do and do not know American Sign Language.</p></div>","PeriodicalId":100147,"journal":{"name":"Augmented Human Research","volume":"9 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-02-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Augmented Human Research","FirstCategoryId":"1085","ListUrlMain":"https://link.springer.com/article/10.1007/s41133-024-00064-w","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Communication with people with hearing or speaking disabilities is always difficult when there is no knowledge of sign language. The presence of sign language is not enough to communicate smoothly, this process requires another easy medium for communication to make it more efficient, that is, via a digital medium. This paper proposes using Feed-Forward Neural Networks on hand landmarks for real-time sign language identification. The hand landmarks identification was carried out using the MediaPipe Hands library. This approach would make the classification problem efficient by making it faster and requiring less memory. Through this, we aim to bridge the gap between the difficulties that arise during communication between people who do and do not know American Sign Language.

Abstract Image

美国手语手势的手部地标相对距离方法综合研究
在不懂手语的情况下,与有听力或语言障碍的人交流总是很困难。仅有手语还不足以实现顺畅的交流,这一过程需要另一种简便的交流媒介,即通过数字媒介来提高效率。本文提出利用前馈神经网络对手部地标进行实时手语识别。手部地标识别使用 MediaPipe Hands 库进行。这种方法可以提高分类问题的效率,使其速度更快,所需的内存更少。通过这种方法,我们的目标是消除懂和不懂美国手语的人在交流过程中出现的困难。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信