使用CNN从图像中识别美国手语字母

Neeraj Singla
{"title":"使用CNN从图像中识别美国手语字母","authors":"Neeraj Singla","doi":"10.1109/ICEEICT56924.2023.10156922","DOIUrl":null,"url":null,"abstract":"American Sign Language (ASL) is a complex and diverse language used by millions of individuals with hearing impairments or disabilities. Accurate and efficient recognition of ASL letters from images is crucial for effective communication and accessibility.[1] However, this is a difficult task due to different hand shapes, orientations, and lighting conditions.In this study, we present a deep learning-based approach for accurately recognizing ASL characters from images. We trained three convolutional neural network (CNN) models, namely VGG16, InceptionV3, and MobileNetV2, on a large dataset of ASL letter images. These models were chosen because they have shown impressive performance in image classification tasks in various contexts. After training, we evaluated the models on a test set of ASL letter images, achieving classification accuracies of 90.7%, 95.7%, and 98% for VGG16, InceptionV3, and MobileNetV2 respectively.Our research provides significant contributions to the field of computer vision, particularly in the recognition of ASL letters from images. Our findings highlight the potential of deep learning-based research development for improving communication technology and accessibility for individuals with hearing impairments, by providing accurate and efficient recognition of ASL letters from images.","PeriodicalId":345324,"journal":{"name":"2023 Second International Conference on Electrical, Electronics, Information and Communication Technologies (ICEEICT)","volume":"155 1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-04-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"American Sign Language Letter Recognition from Images Using CNN\",\"authors\":\"Neeraj Singla\",\"doi\":\"10.1109/ICEEICT56924.2023.10156922\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"American Sign Language (ASL) is a complex and diverse language used by millions of individuals with hearing impairments or disabilities. Accurate and efficient recognition of ASL letters from images is crucial for effective communication and accessibility.[1] However, this is a difficult task due to different hand shapes, orientations, and lighting conditions.In this study, we present a deep learning-based approach for accurately recognizing ASL characters from images. We trained three convolutional neural network (CNN) models, namely VGG16, InceptionV3, and MobileNetV2, on a large dataset of ASL letter images. These models were chosen because they have shown impressive performance in image classification tasks in various contexts. After training, we evaluated the models on a test set of ASL letter images, achieving classification accuracies of 90.7%, 95.7%, and 98% for VGG16, InceptionV3, and MobileNetV2 respectively.Our research provides significant contributions to the field of computer vision, particularly in the recognition of ASL letters from images. Our findings highlight the potential of deep learning-based research development for improving communication technology and accessibility for individuals with hearing impairments, by providing accurate and efficient recognition of ASL letters from images.\",\"PeriodicalId\":345324,\"journal\":{\"name\":\"2023 Second International Conference on Electrical, Electronics, Information and Communication Technologies (ICEEICT)\",\"volume\":\"155 1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-04-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 Second International Conference on Electrical, Electronics, Information and Communication Technologies (ICEEICT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICEEICT56924.2023.10156922\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 Second International Conference on Electrical, Electronics, Information and Communication Technologies (ICEEICT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICEEICT56924.2023.10156922","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

美国手语(ASL)是一种复杂而多样的语言,被数百万有听力障碍或残疾的人使用。从图像中准确和高效地识别美国手语字母对于有效的沟通和可及性至关重要然而,由于手的形状、方向和光照条件不同,这是一项艰巨的任务。在这项研究中,我们提出了一种基于深度学习的方法来准确地从图像中识别美国手语字符。我们在一个大型的美国手语字母图像数据集上训练了三个卷积神经网络(CNN)模型,分别是VGG16、InceptionV3和MobileNetV2。选择这些模型是因为它们在各种背景下的图像分类任务中表现出令人印象深刻的性能。训练后,我们在ASL字母图像的测试集上对模型进行了评估,VGG16、InceptionV3和MobileNetV2的分类准确率分别为90.7%、95.7%和98%。我们的研究为计算机视觉领域做出了重大贡献,特别是在从图像中识别美国手语字母方面。我们的研究结果强调了基于深度学习的研究发展的潜力,通过从图像中准确有效地识别美国手语字母,可以改善听力障碍患者的沟通技术和可及性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
American Sign Language Letter Recognition from Images Using CNN
American Sign Language (ASL) is a complex and diverse language used by millions of individuals with hearing impairments or disabilities. Accurate and efficient recognition of ASL letters from images is crucial for effective communication and accessibility.[1] However, this is a difficult task due to different hand shapes, orientations, and lighting conditions.In this study, we present a deep learning-based approach for accurately recognizing ASL characters from images. We trained three convolutional neural network (CNN) models, namely VGG16, InceptionV3, and MobileNetV2, on a large dataset of ASL letter images. These models were chosen because they have shown impressive performance in image classification tasks in various contexts. After training, we evaluated the models on a test set of ASL letter images, achieving classification accuracies of 90.7%, 95.7%, and 98% for VGG16, InceptionV3, and MobileNetV2 respectively.Our research provides significant contributions to the field of computer vision, particularly in the recognition of ASL letters from images. Our findings highlight the potential of deep learning-based research development for improving communication technology and accessibility for individuals with hearing impairments, by providing accurate and efficient recognition of ASL letters from images.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信