多传感器手套在印尼语手语辅助翻译中的应用评价

Dwisainstia Aponno, A. Arifin, M. Fatoni, M. Nuh, Takashi Watanabe
{"title":"多传感器手套在印尼语手语辅助翻译中的应用评价","authors":"Dwisainstia Aponno, A. Arifin, M. Fatoni, M. Nuh, Takashi Watanabe","doi":"10.1109/CENIM56801.2022.10037541","DOIUrl":null,"url":null,"abstract":"Individuals who suffer in speaking and hearing are known as people with hearing and speech impairment. Sign language is used by them to communicate. Nevertheless, the general public does not fully comprehend sign language. In this study, assistive technology for the Indonesian Sign Language Interpretation System was developed to convert the alphabet sign into text. The system incorporates the usage of flex sensors, pressure sensor, and MPU6050 module. After the development, the evaluation for this interpreter is carried out. The classifier was able to identify 24 out of 26 alphabets with detection error frequently occurring in the letters N and R with an accuracy of 94% in the second experiment. By using a specific classification and including more test data, this study expected outcome can be heightened. The results show that the classification method, along with the tool, may be used effectively as a speech and hearing aid.","PeriodicalId":118934,"journal":{"name":"2022 International Conference on Computer Engineering, Network, and Intelligent Multimedia (CENIM)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Evaluation of Multi-Sensor Gloves Development as an Assistive Interpreter for Indonesian Sign Language\",\"authors\":\"Dwisainstia Aponno, A. Arifin, M. Fatoni, M. Nuh, Takashi Watanabe\",\"doi\":\"10.1109/CENIM56801.2022.10037541\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Individuals who suffer in speaking and hearing are known as people with hearing and speech impairment. Sign language is used by them to communicate. Nevertheless, the general public does not fully comprehend sign language. In this study, assistive technology for the Indonesian Sign Language Interpretation System was developed to convert the alphabet sign into text. The system incorporates the usage of flex sensors, pressure sensor, and MPU6050 module. After the development, the evaluation for this interpreter is carried out. The classifier was able to identify 24 out of 26 alphabets with detection error frequently occurring in the letters N and R with an accuracy of 94% in the second experiment. By using a specific classification and including more test data, this study expected outcome can be heightened. The results show that the classification method, along with the tool, may be used effectively as a speech and hearing aid.\",\"PeriodicalId\":118934,\"journal\":{\"name\":\"2022 International Conference on Computer Engineering, Network, and Intelligent Multimedia (CENIM)\",\"volume\":\"19 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-11-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 International Conference on Computer Engineering, Network, and Intelligent Multimedia (CENIM)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CENIM56801.2022.10037541\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 International Conference on Computer Engineering, Network, and Intelligent Multimedia (CENIM)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CENIM56801.2022.10037541","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

说话和听力受损的人被称为听力和语言障碍患者。他们用手语进行交流。然而,一般公众并不完全理解手语。在本研究中,开发了印尼手语翻译系统的辅助技术,将字母符号转换为文本。该系统包含了柔性传感器、压力传感器和MPU6050模块的使用。开发完成后,对该解释器进行了评价。在第二次实验中,分类器能够识别出26个字母中的24个,其中N和R经常出现检测错误,准确率为94%。通过使用特定的分类和纳入更多的测试数据,可以提高本研究的预期结果。结果表明,该分类方法和工具可以有效地用作语音和助听器。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Evaluation of Multi-Sensor Gloves Development as an Assistive Interpreter for Indonesian Sign Language
Individuals who suffer in speaking and hearing are known as people with hearing and speech impairment. Sign language is used by them to communicate. Nevertheless, the general public does not fully comprehend sign language. In this study, assistive technology for the Indonesian Sign Language Interpretation System was developed to convert the alphabet sign into text. The system incorporates the usage of flex sensors, pressure sensor, and MPU6050 module. After the development, the evaluation for this interpreter is carried out. The classifier was able to identify 24 out of 26 alphabets with detection error frequently occurring in the letters N and R with an accuracy of 94% in the second experiment. By using a specific classification and including more test data, this study expected outcome can be heightened. The results show that the classification method, along with the tool, may be used effectively as a speech and hearing aid.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信