Muhammad Sulaman, S.U.Bazai, Muhammad AKram, Muhammad Akram Khan
{"title":"基于深度学习的盲人智能导航棒","authors":"Muhammad Sulaman, S.U.Bazai, Muhammad AKram, Muhammad Akram Khan","doi":"10.32350/umtair.22.05","DOIUrl":null,"url":null,"abstract":"Blind and visually impaired people find difficulty in detecting obstacles and recognizing people in their way, which makes it dangerous for them to walk, to work, or to go in a crowded area/place. They have to be cautious all the time to move, while avoiding any solid obstacles in their way. Typically, they use different aid devices to reach their destination or to accomplish their daily task. The normal stick is useless for blind and visually impaired people since it cannot detect barriers or people's faces. Visually impaired individuals are unable to distinguish between different types of objects in front of them. They are unable to gauge the size of an object or its distance from them. Several works have been done by public individuals and scientific investigators but their work is dearth in technological aspect. This technological aspect need to be addressed by adding artificial intelligence (AI). This prototype aims to help blind and visually impaired individuals in several aspects to simply obtain/perform everyday tasks and help these individuals to live with the same confidence as sighted people live.Therefore, this study inclined deep learning Mobile-Net Single Shot MultiBox detection (SSD) algorithm for object recognition and Dlib library for face recognition. Subsequently, the proposed solution is using an Open CV and Python. Additionally, Ultrasonic sensors are used for distance measurement, which can be a great help for visually impaired people. These components are grouped together to work effectively and efficiently for the development of visually impaired people. The recognition procedure was revealed through headphones, which notifies the visually impaired when face or any object get recognized. Inclusively, the innovative solution would be a great aid for the blind and visually impaired individuals. As a result, to test and validate the accuracy of the smart navigational stick, several experiments have been conducted on a range of objects and faces. Hence, this study’s modified navigational system was adequate and valid for visually impaired people.","PeriodicalId":198719,"journal":{"name":"UMT Artificial Intelligence Review","volume":"21 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The Deep Learning based Smart Navigational Stick for Blind People\",\"authors\":\"Muhammad Sulaman, S.U.Bazai, Muhammad AKram, Muhammad Akram Khan\",\"doi\":\"10.32350/umtair.22.05\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Blind and visually impaired people find difficulty in detecting obstacles and recognizing people in their way, which makes it dangerous for them to walk, to work, or to go in a crowded area/place. They have to be cautious all the time to move, while avoiding any solid obstacles in their way. Typically, they use different aid devices to reach their destination or to accomplish their daily task. The normal stick is useless for blind and visually impaired people since it cannot detect barriers or people's faces. Visually impaired individuals are unable to distinguish between different types of objects in front of them. They are unable to gauge the size of an object or its distance from them. Several works have been done by public individuals and scientific investigators but their work is dearth in technological aspect. This technological aspect need to be addressed by adding artificial intelligence (AI). This prototype aims to help blind and visually impaired individuals in several aspects to simply obtain/perform everyday tasks and help these individuals to live with the same confidence as sighted people live.Therefore, this study inclined deep learning Mobile-Net Single Shot MultiBox detection (SSD) algorithm for object recognition and Dlib library for face recognition. Subsequently, the proposed solution is using an Open CV and Python. Additionally, Ultrasonic sensors are used for distance measurement, which can be a great help for visually impaired people. These components are grouped together to work effectively and efficiently for the development of visually impaired people. The recognition procedure was revealed through headphones, which notifies the visually impaired when face or any object get recognized. Inclusively, the innovative solution would be a great aid for the blind and visually impaired individuals. As a result, to test and validate the accuracy of the smart navigational stick, several experiments have been conducted on a range of objects and faces. Hence, this study’s modified navigational system was adequate and valid for visually impaired people.\",\"PeriodicalId\":198719,\"journal\":{\"name\":\"UMT Artificial Intelligence Review\",\"volume\":\"21 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-03-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"UMT Artificial Intelligence Review\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.32350/umtair.22.05\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"UMT Artificial Intelligence Review","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.32350/umtair.22.05","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
盲人和视障人士在发现障碍物和识别挡在他们面前的人方面存在困难,这使得他们在行走、工作或进入拥挤的区域/地方时很危险。他们必须一直小心翼翼地移动,同时避开路上的任何坚实障碍物。通常,他们使用不同的辅助设备到达目的地或完成日常任务。普通手杖对于盲人和视障人士来说是无用的,因为它无法识别障碍物或人脸。视力受损的人无法区分他们面前不同类型的物体。他们无法测量物体的大小或物体与他们的距离。公众个人和科学研究者已经做了一些工作,但他们的工作在技术方面还很缺乏。这一技术层面需要通过添加人工智能(AI)来解决。这个原型旨在从几个方面帮助盲人和视障人士简单地获得/执行日常任务,并帮助这些人像正常人一样自信地生活。因此,本研究倾向于使用深度学习Mobile-Net Single Shot MultiBox detection (SSD)算法进行对象识别,使用Dlib库进行人脸识别。随后,提出的解决方案是使用Open CV和Python。此外,超声波传感器用于距离测量,这可以为视障人士提供很大的帮助。这些组成部分组合在一起,为视障人士的发展有效和高效地工作。识别过程通过耳机展示,当识别人脸或物体时,会通知视障人士。这个创新的解决方案对盲人和视障人士来说是一个很大的帮助。因此,为了测试和验证智能导航棒的准确性,我们在一系列物体和人脸上进行了多次实验。因此,本研究改进的导航系统对于视障人士来说是足够和有效的。
The Deep Learning based Smart Navigational Stick for Blind People
Blind and visually impaired people find difficulty in detecting obstacles and recognizing people in their way, which makes it dangerous for them to walk, to work, or to go in a crowded area/place. They have to be cautious all the time to move, while avoiding any solid obstacles in their way. Typically, they use different aid devices to reach their destination or to accomplish their daily task. The normal stick is useless for blind and visually impaired people since it cannot detect barriers or people's faces. Visually impaired individuals are unable to distinguish between different types of objects in front of them. They are unable to gauge the size of an object or its distance from them. Several works have been done by public individuals and scientific investigators but their work is dearth in technological aspect. This technological aspect need to be addressed by adding artificial intelligence (AI). This prototype aims to help blind and visually impaired individuals in several aspects to simply obtain/perform everyday tasks and help these individuals to live with the same confidence as sighted people live.Therefore, this study inclined deep learning Mobile-Net Single Shot MultiBox detection (SSD) algorithm for object recognition and Dlib library for face recognition. Subsequently, the proposed solution is using an Open CV and Python. Additionally, Ultrasonic sensors are used for distance measurement, which can be a great help for visually impaired people. These components are grouped together to work effectively and efficiently for the development of visually impaired people. The recognition procedure was revealed through headphones, which notifies the visually impaired when face or any object get recognized. Inclusively, the innovative solution would be a great aid for the blind and visually impaired individuals. As a result, to test and validate the accuracy of the smart navigational stick, several experiments have been conducted on a range of objects and faces. Hence, this study’s modified navigational system was adequate and valid for visually impaired people.