The Deep Learning based Smart Navigational Stick for Blind People

Muhammad Sulaman, S.U.Bazai, Muhammad AKram, Muhammad Akram Khan
{"title":"The Deep Learning based Smart Navigational Stick for Blind People","authors":"Muhammad Sulaman, S.U.Bazai, Muhammad AKram, Muhammad Akram Khan","doi":"10.32350/umtair.22.05","DOIUrl":null,"url":null,"abstract":"Blind and visually impaired people find difficulty in detecting obstacles and recognizing people in their way, which makes it dangerous for them to walk, to work, or to go in a crowded area/place. They have to be cautious all the time to move, while avoiding any solid obstacles in their way. Typically, they use different aid devices to reach their destination or to accomplish their daily task. The normal stick is useless for blind and visually impaired people since it cannot detect barriers or people's faces. Visually impaired individuals are unable to distinguish between different types of objects in front of them. They are unable to gauge the size of an object or its distance from them. Several works have been done by public individuals and scientific investigators but their work is dearth in technological aspect. This technological aspect need to be addressed by adding artificial intelligence (AI). This prototype aims to help blind and visually impaired individuals in several aspects to simply obtain/perform everyday tasks and help these individuals to live with the same confidence as sighted people live.Therefore, this study inclined deep learning Mobile-Net Single Shot MultiBox detection (SSD) algorithm for object recognition and Dlib library for face recognition. Subsequently, the proposed solution is using an Open CV and Python. Additionally, Ultrasonic sensors are used for distance measurement, which can be a great help for visually impaired people. These components are grouped together to work effectively and efficiently for the development of visually impaired people. The recognition procedure was revealed through headphones, which notifies the visually impaired when face or any object get recognized. Inclusively, the innovative solution would be a great aid for the blind and visually impaired individuals. As a result, to test and validate the accuracy of the smart navigational stick, several experiments have been conducted on a range of objects and faces. Hence, this study’s modified navigational system was adequate and valid for visually impaired people.","PeriodicalId":198719,"journal":{"name":"UMT Artificial Intelligence Review","volume":"21 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"UMT Artificial Intelligence Review","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.32350/umtair.22.05","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Blind and visually impaired people find difficulty in detecting obstacles and recognizing people in their way, which makes it dangerous for them to walk, to work, or to go in a crowded area/place. They have to be cautious all the time to move, while avoiding any solid obstacles in their way. Typically, they use different aid devices to reach their destination or to accomplish their daily task. The normal stick is useless for blind and visually impaired people since it cannot detect barriers or people's faces. Visually impaired individuals are unable to distinguish between different types of objects in front of them. They are unable to gauge the size of an object or its distance from them. Several works have been done by public individuals and scientific investigators but their work is dearth in technological aspect. This technological aspect need to be addressed by adding artificial intelligence (AI). This prototype aims to help blind and visually impaired individuals in several aspects to simply obtain/perform everyday tasks and help these individuals to live with the same confidence as sighted people live.Therefore, this study inclined deep learning Mobile-Net Single Shot MultiBox detection (SSD) algorithm for object recognition and Dlib library for face recognition. Subsequently, the proposed solution is using an Open CV and Python. Additionally, Ultrasonic sensors are used for distance measurement, which can be a great help for visually impaired people. These components are grouped together to work effectively and efficiently for the development of visually impaired people. The recognition procedure was revealed through headphones, which notifies the visually impaired when face or any object get recognized. Inclusively, the innovative solution would be a great aid for the blind and visually impaired individuals. As a result, to test and validate the accuracy of the smart navigational stick, several experiments have been conducted on a range of objects and faces. Hence, this study’s modified navigational system was adequate and valid for visually impaired people.
基于深度学习的盲人智能导航棒
盲人和视障人士在发现障碍物和识别挡在他们面前的人方面存在困难,这使得他们在行走、工作或进入拥挤的区域/地方时很危险。他们必须一直小心翼翼地移动,同时避开路上的任何坚实障碍物。通常,他们使用不同的辅助设备到达目的地或完成日常任务。普通手杖对于盲人和视障人士来说是无用的,因为它无法识别障碍物或人脸。视力受损的人无法区分他们面前不同类型的物体。他们无法测量物体的大小或物体与他们的距离。公众个人和科学研究者已经做了一些工作,但他们的工作在技术方面还很缺乏。这一技术层面需要通过添加人工智能(AI)来解决。这个原型旨在从几个方面帮助盲人和视障人士简单地获得/执行日常任务,并帮助这些人像正常人一样自信地生活。因此,本研究倾向于使用深度学习Mobile-Net Single Shot MultiBox detection (SSD)算法进行对象识别,使用Dlib库进行人脸识别。随后,提出的解决方案是使用Open CV和Python。此外,超声波传感器用于距离测量,这可以为视障人士提供很大的帮助。这些组成部分组合在一起,为视障人士的发展有效和高效地工作。识别过程通过耳机展示,当识别人脸或物体时,会通知视障人士。这个创新的解决方案对盲人和视障人士来说是一个很大的帮助。因此,为了测试和验证智能导航棒的准确性,我们在一系列物体和人脸上进行了多次实验。因此,本研究改进的导航系统对于视障人士来说是足够和有效的。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信