一种轻便可穿戴的美国手语翻译装置

Oguz Yetkin, Karmina Calderon, P. Krishna Moorthy, Thao Thu Nguyen, Jennifer Tran, Taylor Terry, Anthony Vigil, Anne Alsup, Aaron Tekleab, Danielle Sancillo, Nosisa Ncube, J. Baptist
{"title":"一种轻便可穿戴的美国手语翻译装置","authors":"Oguz Yetkin, Karmina Calderon, P. Krishna Moorthy, Thao Thu Nguyen, Jennifer Tran, Taylor Terry, Anthony Vigil, Anne Alsup, Aaron Tekleab, Danielle Sancillo, Nosisa Ncube, J. Baptist","doi":"10.1115/dmd2022-1053","DOIUrl":null,"url":null,"abstract":"\n A lightweight wearable American Sign Language translation device is presented consisting of optically communicating rings worn on each finger and wireless devices worn on each fingernail. The device is similar in principle to glove based sign language translation devices except it does not require the user to wear an entire glove. Each ring is constructed from optically clear resin containing three infrared transponders, controlled by a microcontroller unit worn on the wrist. The fingernail units are also cast in clear resin and contain circuitry to receive and respond to infrared light, and house three small SR60 watch batteries. The system uses a microcontroller to flash all LEDs in succession and create matrix sensor readings from each LED, resulting in a 15x15 matrix corresponding to a signed gesture, recognized by an Artificial Neural Network. This system is expected to be able to recognize 24 of the 26 letters of the ASL alphabet and be extended to recognize arbitrary ASL signs with the integration of an accelerometer. The system currently recognizes 9 letters (A, B, D, F, K, N, O, T, X) with intention to build on this novel method of gesture recognition to construct a full-fledged ASL translator. The system is currently useable as a low-encumbrance gesture-based input system for arbitrary device control.","PeriodicalId":236105,"journal":{"name":"2022 Design of Medical Devices Conference","volume":"96 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Lightweight Wearable American Sign Language Translation Device\",\"authors\":\"Oguz Yetkin, Karmina Calderon, P. Krishna Moorthy, Thao Thu Nguyen, Jennifer Tran, Taylor Terry, Anthony Vigil, Anne Alsup, Aaron Tekleab, Danielle Sancillo, Nosisa Ncube, J. Baptist\",\"doi\":\"10.1115/dmd2022-1053\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\n A lightweight wearable American Sign Language translation device is presented consisting of optically communicating rings worn on each finger and wireless devices worn on each fingernail. The device is similar in principle to glove based sign language translation devices except it does not require the user to wear an entire glove. Each ring is constructed from optically clear resin containing three infrared transponders, controlled by a microcontroller unit worn on the wrist. The fingernail units are also cast in clear resin and contain circuitry to receive and respond to infrared light, and house three small SR60 watch batteries. The system uses a microcontroller to flash all LEDs in succession and create matrix sensor readings from each LED, resulting in a 15x15 matrix corresponding to a signed gesture, recognized by an Artificial Neural Network. This system is expected to be able to recognize 24 of the 26 letters of the ASL alphabet and be extended to recognize arbitrary ASL signs with the integration of an accelerometer. The system currently recognizes 9 letters (A, B, D, F, K, N, O, T, X) with intention to build on this novel method of gesture recognition to construct a full-fledged ASL translator. The system is currently useable as a low-encumbrance gesture-based input system for arbitrary device control.\",\"PeriodicalId\":236105,\"journal\":{\"name\":\"2022 Design of Medical Devices Conference\",\"volume\":\"96 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-04-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 Design of Medical Devices Conference\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1115/dmd2022-1053\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 Design of Medical Devices Conference","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1115/dmd2022-1053","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

介绍了一种轻型可穿戴美国手语翻译设备,该设备由每个手指上佩戴的光通信环和每个指甲上佩戴的无线设备组成。该设备在原理上类似于基于手套的手语翻译设备,除了它不需要用户戴上整个手套。每个环由光学透明树脂制成,包含三个红外转发器,由佩戴在手腕上的微控制器单元控制。指甲单元也用透明树脂铸造,包含接收和响应红外光的电路,并容纳三个小型SR60手表电池。该系统使用微控制器连续闪烁所有LED,并从每个LED创建矩阵传感器读数,从而产生与签名手势对应的15x15矩阵,由人工神经网络识别。该系统预计能够识别26个美国手语字母中的24个,并通过集成加速度计扩展到识别任意美国手语符号。该系统目前可以识别9个字母(A, B, D, F, K, N, O, T, X),并打算在这种新颖的手势识别方法的基础上构建一个完整的美国手语翻译。该系统目前可作为一种低障碍的基于手势的输入系统,用于任意设备控制。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A Lightweight Wearable American Sign Language Translation Device
A lightweight wearable American Sign Language translation device is presented consisting of optically communicating rings worn on each finger and wireless devices worn on each fingernail. The device is similar in principle to glove based sign language translation devices except it does not require the user to wear an entire glove. Each ring is constructed from optically clear resin containing three infrared transponders, controlled by a microcontroller unit worn on the wrist. The fingernail units are also cast in clear resin and contain circuitry to receive and respond to infrared light, and house three small SR60 watch batteries. The system uses a microcontroller to flash all LEDs in succession and create matrix sensor readings from each LED, resulting in a 15x15 matrix corresponding to a signed gesture, recognized by an Artificial Neural Network. This system is expected to be able to recognize 24 of the 26 letters of the ASL alphabet and be extended to recognize arbitrary ASL signs with the integration of an accelerometer. The system currently recognizes 9 letters (A, B, D, F, K, N, O, T, X) with intention to build on this novel method of gesture recognition to construct a full-fledged ASL translator. The system is currently useable as a low-encumbrance gesture-based input system for arbitrary device control.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信