Sign Language Recognition Using Keypoints Through DTW

Sumathi Pawar, Karuna Pandith, Manjula Gururaj Rao, N. Chiplunkar, Rajalaxmi Samaga
{"title":"Sign Language Recognition Using Keypoints Through DTW","authors":"Sumathi Pawar, Karuna Pandith, Manjula Gururaj Rao, N. Chiplunkar, Rajalaxmi Samaga","doi":"10.1109/CCIP57447.2022.10058664","DOIUrl":null,"url":null,"abstract":"Hearing-impaired people utilize hand signals, which is an organized collection of hand gestures with distinct meanings. Despite the fact that automated Sign Language Recognition(SLR) is essential for these people, the focus of the research is still challenging and mostly unexplored. This paper is focused on an implemented system for recognizing sign language using SLR system. For numerous computer vision that help to increase communications among hearing impaired, deaf and dumb the sign language identification is a exciting and crucial research area. This research, offers a model with Dynamic Time Wrapping(DTW) approach for recognizing signs in video clips. This innovative technique uses body and hand skeletal features that are derived from RGB movies to capture highly discriminative skeletal data for gesture identification. Experiments on a sizable sign language videos shows that this methodology is better than other cutting-edge methods that just use RGB features. The holistic features extracted as connected key points to identify sign language of the image and accuracy of the results are analyzed.","PeriodicalId":309964,"journal":{"name":"2022 Fourth International Conference on Cognitive Computing and Information Processing (CCIP)","volume":"118 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 Fourth International Conference on Cognitive Computing and Information Processing (CCIP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CCIP57447.2022.10058664","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Hearing-impaired people utilize hand signals, which is an organized collection of hand gestures with distinct meanings. Despite the fact that automated Sign Language Recognition(SLR) is essential for these people, the focus of the research is still challenging and mostly unexplored. This paper is focused on an implemented system for recognizing sign language using SLR system. For numerous computer vision that help to increase communications among hearing impaired, deaf and dumb the sign language identification is a exciting and crucial research area. This research, offers a model with Dynamic Time Wrapping(DTW) approach for recognizing signs in video clips. This innovative technique uses body and hand skeletal features that are derived from RGB movies to capture highly discriminative skeletal data for gesture identification. Experiments on a sizable sign language videos shows that this methodology is better than other cutting-edge methods that just use RGB features. The holistic features extracted as connected key points to identify sign language of the image and accuracy of the results are analyzed.
基于DTW的手语关键点识别
听障人士使用手势,这是一种有组织的手势集合,具有不同的含义。尽管自动手语识别(SLR)对这些人来说是必不可少的,但研究的重点仍然具有挑战性,而且大部分尚未被探索。本文研究了一种基于单反识别系统的手语识别系统。手语识别是一个令人兴奋和至关重要的研究领域,对于许多有助于增进听障人士、聋哑人之间交流的计算机视觉来说。本研究提出了一种基于动态时间包裹(DTW)方法的视频片段符号识别模型。这项创新技术利用来自RGB电影的身体和手部骨骼特征来捕获高度判别的骨骼数据,用于手势识别。在大量的手语视频上进行的实验表明,该方法优于其他仅使用RGB特征的前沿方法。将提取的整体特征作为连接点用于图像的手语识别,并对结果的准确性进行了分析。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信