An Intelligent Voice Assistance System for Visually Impaired using Deep Learning

Renju Rachel Varghese, Pramod Mathew Jacob, Midhun Shaji, A. R, E. John, Sebin Beebi Philip
{"title":"An Intelligent Voice Assistance System for Visually Impaired using Deep Learning","authors":"Renju Rachel Varghese, Pramod Mathew Jacob, Midhun Shaji, A. R, E. John, Sebin Beebi Philip","doi":"10.1109/DASA54658.2022.9765171","DOIUrl":null,"url":null,"abstract":"Unassisted navigation, object recognition, obstacle avoidance, and reading activities are extremely difficult for people who are completely blind. For those who are visually impaired, we present a new form of assistive technology. Raspberry Pi 3 Model B+ was selected to illustrate the proposed prototype's capability because of its inexpensive price, compact size, and ease of integration. Incorporated within the design is a camera, sensors for obstacle avoidance, and powerful image processing algorithms for detecting and classifying objects. Both the camera and the ultrasonic sensors are used to determine the user's distance from the impediment. The image-to-text converter, followed by audio feedback, is integrated into the system. A typical pair of eyeglasses can be used to mount the entire system, which is small, light, and simple to use. Using 60 completely blind people, researchers compare the suggested device to the classic white cane in terms of performance. Controlled environments based on real-world scenarios are used to conduct the evaluations. In comparison to a white cane, the proposed device provides higher accessibility and comfort, as well as simplicity of navigation for visually impaired people.","PeriodicalId":231066,"journal":{"name":"2022 International Conference on Decision Aid Sciences and Applications (DASA)","volume":"189 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-03-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 International Conference on Decision Aid Sciences and Applications (DASA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/DASA54658.2022.9765171","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

Unassisted navigation, object recognition, obstacle avoidance, and reading activities are extremely difficult for people who are completely blind. For those who are visually impaired, we present a new form of assistive technology. Raspberry Pi 3 Model B+ was selected to illustrate the proposed prototype's capability because of its inexpensive price, compact size, and ease of integration. Incorporated within the design is a camera, sensors for obstacle avoidance, and powerful image processing algorithms for detecting and classifying objects. Both the camera and the ultrasonic sensors are used to determine the user's distance from the impediment. The image-to-text converter, followed by audio feedback, is integrated into the system. A typical pair of eyeglasses can be used to mount the entire system, which is small, light, and simple to use. Using 60 completely blind people, researchers compare the suggested device to the classic white cane in terms of performance. Controlled environments based on real-world scenarios are used to conduct the evaluations. In comparison to a white cane, the proposed device provides higher accessibility and comfort, as well as simplicity of navigation for visually impaired people.
基于深度学习的视障人士智能语音辅助系统
对于完全失明的人来说,无辅助导航、物体识别、避障和阅读活动都是极其困难的。对于那些视力受损的人,我们提出了一种新的辅助技术。树莓派3模型B+被选择来说明所提出的原型的能力,因为它的价格便宜,体积小,易于集成。该设计包含一个摄像头、用于避障的传感器,以及用于检测和分类物体的强大图像处理算法。摄像头和超声波传感器都用来确定用户与障碍物的距离。图像到文本的转换器,接着是音频反馈,被集成到系统中。一副典型的眼镜就可以安装整个系统,该系统体积小,重量轻,使用简单。研究人员对60名完全失明的人进行了研究,并将该设备与传统的白色手杖在性能方面进行了比较。基于真实场景的受控环境用于进行评估。与白色手杖相比,该装置为视障人士提供了更高的可访问性和舒适性,并且导航简单。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信