基于机器学习分类器、人工神经网络和CNN的美国手语字母有效识别系统

Diponkor Bala, Mohammad Alamgir Hossain, Mohammad Anwarul Islam, Mohammed Mynuddin, Md Shamim Hossain, M. Abdullah
{"title":"基于机器学习分类器、人工神经网络和CNN的美国手语字母有效识别系统","authors":"Diponkor Bala, Mohammad Alamgir Hossain, Mohammad Anwarul Islam, Mohammed Mynuddin, Md Shamim Hossain, M. Abdullah","doi":"10.1109/IATMSI56455.2022.10119336","DOIUrl":null,"url":null,"abstract":"People who cannot talk are called audibly impaired, and they communicate with others through other means. The most popular method of communication is through sign language. American Sign Language (ASL) is the de-facto standard for sign languages taught globally. Automated sign language recognition tries to bridge the gap. Convolutional neural networks are the method of choice these days when it comes to the classification of multiclass images. To recognize ASL alphabets, we used a CNN, traditional machine learning classifiers, and an artificial neural network. The Sign Language MNIST dataset has a total of 34,627 image data, of which 27,455 and 7172 are training and test data respectively. Except for J and Z, the dataset comprises 24 alphabets. We used the training dataset to train our CNN, ANN, and other machine learning models. Then examined our proposed CNN model as well as other models including ANN on the test dataset to check how well they recognize ASL alphabets correctly. The traditional classifiers such as Linear Regression, Logistic Regression, Random Forest, SVM, and ANN were able to achieve an accuracy of 71.94%, 90.16%, 98.63%, 97.92%, 82.96% respectively whereas the proposed CNN model achieved 100 % of accuracy on the unseen test data.","PeriodicalId":221211,"journal":{"name":"2022 IEEE Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation (IATMSI)","volume":"39 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Effective Recognition System of American Sign Language Alphabets using Machine Learning Classifiers, ANN and CNN\",\"authors\":\"Diponkor Bala, Mohammad Alamgir Hossain, Mohammad Anwarul Islam, Mohammed Mynuddin, Md Shamim Hossain, M. Abdullah\",\"doi\":\"10.1109/IATMSI56455.2022.10119336\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"People who cannot talk are called audibly impaired, and they communicate with others through other means. The most popular method of communication is through sign language. American Sign Language (ASL) is the de-facto standard for sign languages taught globally. Automated sign language recognition tries to bridge the gap. Convolutional neural networks are the method of choice these days when it comes to the classification of multiclass images. To recognize ASL alphabets, we used a CNN, traditional machine learning classifiers, and an artificial neural network. The Sign Language MNIST dataset has a total of 34,627 image data, of which 27,455 and 7172 are training and test data respectively. Except for J and Z, the dataset comprises 24 alphabets. We used the training dataset to train our CNN, ANN, and other machine learning models. Then examined our proposed CNN model as well as other models including ANN on the test dataset to check how well they recognize ASL alphabets correctly. The traditional classifiers such as Linear Regression, Logistic Regression, Random Forest, SVM, and ANN were able to achieve an accuracy of 71.94%, 90.16%, 98.63%, 97.92%, 82.96% respectively whereas the proposed CNN model achieved 100 % of accuracy on the unseen test data.\",\"PeriodicalId\":221211,\"journal\":{\"name\":\"2022 IEEE Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation (IATMSI)\",\"volume\":\"39 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation (IATMSI)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/IATMSI56455.2022.10119336\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation (IATMSI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IATMSI56455.2022.10119336","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

不能说话的人被称为听觉障碍,他们通过其他方式与他人交流。最流行的交流方式是通过手语。美国手语(ASL)是全球手语教学的事实标准。自动手语识别试图弥补这一差距。当涉及到多类图像的分类时,卷积神经网络是目前的首选方法。为了识别美国手语字母,我们使用了CNN、传统的机器学习分类器和人工神经网络。手语MNIST数据集共有34,627张图像数据,其中训练数据27,455张,测试数据7172张。除了J和Z,数据集包含24个字母。我们使用训练数据集来训练我们的CNN、ANN和其他机器学习模型。然后在测试数据集上检查我们提出的CNN模型以及包括ANN在内的其他模型,以检查它们对美国手语字母的正确识别程度。传统的分类器如线性回归、逻辑回归、随机森林、支持向量机和人工神经网络的准确率分别为71.94%、90.16%、98.63%、97.92%和82.96%,而本文提出的CNN模型在未见过的测试数据上达到了100%的准确率。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Effective Recognition System of American Sign Language Alphabets using Machine Learning Classifiers, ANN and CNN
People who cannot talk are called audibly impaired, and they communicate with others through other means. The most popular method of communication is through sign language. American Sign Language (ASL) is the de-facto standard for sign languages taught globally. Automated sign language recognition tries to bridge the gap. Convolutional neural networks are the method of choice these days when it comes to the classification of multiclass images. To recognize ASL alphabets, we used a CNN, traditional machine learning classifiers, and an artificial neural network. The Sign Language MNIST dataset has a total of 34,627 image data, of which 27,455 and 7172 are training and test data respectively. Except for J and Z, the dataset comprises 24 alphabets. We used the training dataset to train our CNN, ANN, and other machine learning models. Then examined our proposed CNN model as well as other models including ANN on the test dataset to check how well they recognize ASL alphabets correctly. The traditional classifiers such as Linear Regression, Logistic Regression, Random Forest, SVM, and ANN were able to achieve an accuracy of 71.94%, 90.16%, 98.63%, 97.92%, 82.96% respectively whereas the proposed CNN model achieved 100 % of accuracy on the unseen test data.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信