{"title":"利用深度学习进行手势识别和手语检测","authors":"Sherin Shanavas, Naila N N, Harikrishnan S R","doi":"10.48175/ijarsct-19315","DOIUrl":null,"url":null,"abstract":"Gesture recognition and sign language detection are essential for improving human-computer interaction and accessibility. The proposed system employs deep learning techniques using TensorFlow and Keras, combined with computer vision capabilities of OpenCV, to enhance the accuracy of gesture and sign language interpretation. Convolutional Neural Networks (CNNs) are utilised to extract spatial and spatiotemporal features from video frames, ensuring robust gesture recognition. For sign language detection, CNNs recognize static hand gestures, while sequential models built with Keras facilitate the translation of continuous sign language. This integration showcases the potential of TensorFlow, Keras, and OpenCV in creating more inclusive and intuitive digital experiences","PeriodicalId":472960,"journal":{"name":"International Journal of Advanced Research in Science, Communication and Technology","volume":"33 2","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Gesture Recognition and Sign Language Detection using Deep Learning\",\"authors\":\"Sherin Shanavas, Naila N N, Harikrishnan S R\",\"doi\":\"10.48175/ijarsct-19315\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Gesture recognition and sign language detection are essential for improving human-computer interaction and accessibility. The proposed system employs deep learning techniques using TensorFlow and Keras, combined with computer vision capabilities of OpenCV, to enhance the accuracy of gesture and sign language interpretation. Convolutional Neural Networks (CNNs) are utilised to extract spatial and spatiotemporal features from video frames, ensuring robust gesture recognition. For sign language detection, CNNs recognize static hand gestures, while sequential models built with Keras facilitate the translation of continuous sign language. This integration showcases the potential of TensorFlow, Keras, and OpenCV in creating more inclusive and intuitive digital experiences\",\"PeriodicalId\":472960,\"journal\":{\"name\":\"International Journal of Advanced Research in Science, Communication and Technology\",\"volume\":\"33 2\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-08-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Advanced Research in Science, Communication and Technology\",\"FirstCategoryId\":\"0\",\"ListUrlMain\":\"https://doi.org/10.48175/ijarsct-19315\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Advanced Research in Science, Communication and Technology","FirstCategoryId":"0","ListUrlMain":"https://doi.org/10.48175/ijarsct-19315","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
手势识别和手语检测对于改善人机交互和无障碍环境至关重要。拟议的系统采用了 TensorFlow 和 Keras 深度学习技术,并结合 OpenCV 的计算机视觉功能,以提高手势和手语解释的准确性。卷积神经网络(CNN)用于从视频帧中提取空间和时空特征,确保手势识别的稳健性。在手势语检测方面,CNN 可识别静态手势,而利用 Keras 建立的序列模型可促进连续手势语的翻译。这一集成展示了 TensorFlow、Keras 和 OpenCV 在创造更具包容性和直观性的数字体验方面的潜力。
Gesture Recognition and Sign Language Detection using Deep Learning
Gesture recognition and sign language detection are essential for improving human-computer interaction and accessibility. The proposed system employs deep learning techniques using TensorFlow and Keras, combined with computer vision capabilities of OpenCV, to enhance the accuracy of gesture and sign language interpretation. Convolutional Neural Networks (CNNs) are utilised to extract spatial and spatiotemporal features from video frames, ensuring robust gesture recognition. For sign language detection, CNNs recognize static hand gestures, while sequential models built with Keras facilitate the translation of continuous sign language. This integration showcases the potential of TensorFlow, Keras, and OpenCV in creating more inclusive and intuitive digital experiences