Classification Of Indian Sign Language Characters Utilizing Convolutional Neural Networks And Transfer Learning Models With Different Image Processing Techniques
{"title":"Classification Of Indian Sign Language Characters Utilizing Convolutional Neural Networks And Transfer Learning Models With Different Image Processing Techniques","authors":"Atharva Dumbre, Shrenik Jangada, Shreyas Gosavi, Jaya Gupta","doi":"10.1109/AIC55036.2022.9848930","DOIUrl":null,"url":null,"abstract":"In terms of visual-spatial modality, the sign language is considered to be a natural as well as a full-fledged language. It has all of the linguistic characteristics of spoken language (from phonology to syntax). Sign language is a form of communication in which the hands are used instead of words. It uses a variety of signs to convey thoughts and concepts. For ISL static character recognition, we propose a Convolutional Neural Network (CNN) architecture in this paper. Comparison of different feature extraction techniques tested on CNN architecture is done in this particular paper. We hand-crafted the dataset used to train the CNN model in order to come as near to the real-life scenario in which the model’s viability would be assessed as possible. The proposed method was successfully implemented with a 99.90 percent accuracy, which is better than the majority of currently available methods.","PeriodicalId":433590,"journal":{"name":"2022 IEEE World Conference on Applied Intelligence and Computing (AIC)","volume":"133 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE World Conference on Applied Intelligence and Computing (AIC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/AIC55036.2022.9848930","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
Abstract
In terms of visual-spatial modality, the sign language is considered to be a natural as well as a full-fledged language. It has all of the linguistic characteristics of spoken language (from phonology to syntax). Sign language is a form of communication in which the hands are used instead of words. It uses a variety of signs to convey thoughts and concepts. For ISL static character recognition, we propose a Convolutional Neural Network (CNN) architecture in this paper. Comparison of different feature extraction techniques tested on CNN architecture is done in this particular paper. We hand-crafted the dataset used to train the CNN model in order to come as near to the real-life scenario in which the model’s viability would be assessed as possible. The proposed method was successfully implemented with a 99.90 percent accuracy, which is better than the majority of currently available methods.