Ilya Makarov, Nikolay Veldyaykin, M. Chertkov, Aleksei Pokoev
{"title":"美国和俄罗斯手语的长短格识别","authors":"Ilya Makarov, Nikolay Veldyaykin, M. Chertkov, Aleksei Pokoev","doi":"10.1145/3316782.3316786","DOIUrl":null,"url":null,"abstract":"Sign languages are the main way for people from deaf community to communicate with other people. In this paper, we have compared several real-time sign language dactyl recognition systems using deep convolutional neural networks. Our system is able to recognize words from natural language gestured using signs for each letter. We evaluate our approach on American (ASL) and Russian (RSL) sign languages. For ASL, we trained on dataset prepared by Massey University, Institute of Information and Mathematical Sciences, for RSL we collect our own dataset, which we aim to enlarge together with RSL community in Russia. The results showed 100% accuracy for ASL Massey dataset, while RSL recognition quality is behind sufficient quality due to much more complex nature of real-world RSL dataset.","PeriodicalId":264425,"journal":{"name":"Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments","volume":"36 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"13","resultStr":"{\"title\":\"American and russian sign language dactyl recognition\",\"authors\":\"Ilya Makarov, Nikolay Veldyaykin, M. Chertkov, Aleksei Pokoev\",\"doi\":\"10.1145/3316782.3316786\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Sign languages are the main way for people from deaf community to communicate with other people. In this paper, we have compared several real-time sign language dactyl recognition systems using deep convolutional neural networks. Our system is able to recognize words from natural language gestured using signs for each letter. We evaluate our approach on American (ASL) and Russian (RSL) sign languages. For ASL, we trained on dataset prepared by Massey University, Institute of Information and Mathematical Sciences, for RSL we collect our own dataset, which we aim to enlarge together with RSL community in Russia. The results showed 100% accuracy for ASL Massey dataset, while RSL recognition quality is behind sufficient quality due to much more complex nature of real-world RSL dataset.\",\"PeriodicalId\":264425,\"journal\":{\"name\":\"Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments\",\"volume\":\"36 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-06-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"13\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3316782.3316786\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3316782.3316786","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
American and russian sign language dactyl recognition
Sign languages are the main way for people from deaf community to communicate with other people. In this paper, we have compared several real-time sign language dactyl recognition systems using deep convolutional neural networks. Our system is able to recognize words from natural language gestured using signs for each letter. We evaluate our approach on American (ASL) and Russian (RSL) sign languages. For ASL, we trained on dataset prepared by Massey University, Institute of Information and Mathematical Sciences, for RSL we collect our own dataset, which we aim to enlarge together with RSL community in Russia. The results showed 100% accuracy for ASL Massey dataset, while RSL recognition quality is behind sufficient quality due to much more complex nature of real-world RSL dataset.