Smart Glasses Application System for Visually Impaired People Based on Deep Learning

Jyun-You Lin, Chi-Lin Chiang, Meng-Jin Wu, Chih-Chiung Yao, Ming-Chiao Chen
{"title":"Smart Glasses Application System for Visually Impaired People Based on Deep Learning","authors":"Jyun-You Lin, Chi-Lin Chiang, Meng-Jin Wu, Chih-Chiung Yao, Ming-Chiao Chen","doi":"10.1109/Indo-TaiwanICAN48429.2020.9181366","DOIUrl":null,"url":null,"abstract":"The recent development of deep learning has promoted object detection to make rapid progress. In recent years, smart wearable technology is rapidly becoming part of everyday life, including watches, glasses and many other wearable items have been enriched with technology. In this study, we propose a smart glasses application system for visually impaired people based on deep learning. The system can use voice response to visually impaired people about the objects in front of them by uploading the photos to our backend object detection system through the camera function of smart glasses, and then download the text descriptions of the result and then use the text-to-speech function. According to the experimental results, the proposed system takes 3.788 seconds from uploading photos to making voice results, and the success rate of object detection is 96.3%. We hope that this application system can assistant visually impaired people to understand the surrounding environment and interact more closely with the people around them to improve the quality of life of them.","PeriodicalId":171125,"journal":{"name":"2020 Indo – Taiwan 2nd International Conference on Computing, Analytics and Networks (Indo-Taiwan ICAN)","volume":"16 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 Indo – Taiwan 2nd International Conference on Computing, Analytics and Networks (Indo-Taiwan ICAN)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/Indo-TaiwanICAN48429.2020.9181366","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4

Abstract

The recent development of deep learning has promoted object detection to make rapid progress. In recent years, smart wearable technology is rapidly becoming part of everyday life, including watches, glasses and many other wearable items have been enriched with technology. In this study, we propose a smart glasses application system for visually impaired people based on deep learning. The system can use voice response to visually impaired people about the objects in front of them by uploading the photos to our backend object detection system through the camera function of smart glasses, and then download the text descriptions of the result and then use the text-to-speech function. According to the experimental results, the proposed system takes 3.788 seconds from uploading photos to making voice results, and the success rate of object detection is 96.3%. We hope that this application system can assistant visually impaired people to understand the surrounding environment and interact more closely with the people around them to improve the quality of life of them.
基于深度学习的视障人士智能眼镜应用系统
近年来深度学习的发展促进了目标检测的快速发展。近年来,智能可穿戴技术正迅速成为人们日常生活的一部分,包括手表、眼镜等许多可穿戴物品都被技术所丰富。在本研究中,我们提出了一种基于深度学习的视障人士智能眼镜应用系统。本系统通过智能眼镜的摄像功能,将视障人士的照片上传到我们的后端物体检测系统,然后下载结果的文字描述,然后使用文字转语音功能,对视障人士对眼前的物体进行语音响应。实验结果表明,该系统从上传照片到生成语音结果耗时3.788秒,目标检测成功率为96.3%。我们希望这个应用系统能够帮助视障人士了解周围的环境,与周围的人进行更紧密的互动,提高视障人士的生活质量。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信