基于视觉的室内导航多功能智能电子眼镜

2021 6th IEEE International Conference on Advanced Robotics and Mechatronics (ICARM) Pub Date : 2021-07-03 DOI:10.1109/ICARM52023.2021.9536084

Jiaqi Xu, H. Xia, Yueyue Liu, Zhijun Li

{"title":"基于视觉的室内导航多功能智能电子眼镜","authors":"Jiaqi Xu, H. Xia, Yueyue Liu, Zhijun Li","doi":"10.1109/ICARM52023.2021.9536084","DOIUrl":null,"url":null,"abstract":"Wearable sensing and feedback device could provide useful information for the people with visual impairments. In this paper, we develop a real-time, multifunctional electronic eyeglasses (E-Glasses) for vision-based indoor navigation. Our proposed E-glasses has two main functions, which are indoor navigation through navigation algorithm, and object of interest detection through deep learning technology. The safe motion trajectory and the object information are summarized and feedback will be given to the people with visual impairments. The system can run at 39 fps and achieve mean average precision of 84.77% in the test set of images we collected. Detailed experiments of \"Navigation\" and \"Find the target\" had an overall success rate above 91%, demonstrating the feasibility of E-Glasses.","PeriodicalId":367307,"journal":{"name":"2021 6th IEEE International Conference on Advanced Robotics and Mechatronics (ICARM)","volume":"102 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Multi-functional Smart E-Glasses for Vision-Based Indoor Navigation\",\"authors\":\"Jiaqi Xu, H. Xia, Yueyue Liu, Zhijun Li\",\"doi\":\"10.1109/ICARM52023.2021.9536084\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Wearable sensing and feedback device could provide useful information for the people with visual impairments. In this paper, we develop a real-time, multifunctional electronic eyeglasses (E-Glasses) for vision-based indoor navigation. Our proposed E-glasses has two main functions, which are indoor navigation through navigation algorithm, and object of interest detection through deep learning technology. The safe motion trajectory and the object information are summarized and feedback will be given to the people with visual impairments. The system can run at 39 fps and achieve mean average precision of 84.77% in the test set of images we collected. Detailed experiments of \\\"Navigation\\\" and \\\"Find the target\\\" had an overall success rate above 91%, demonstrating the feasibility of E-Glasses.\",\"PeriodicalId\":367307,\"journal\":{\"name\":\"2021 6th IEEE International Conference on Advanced Robotics and Mechatronics (ICARM)\",\"volume\":\"102 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-07-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 6th IEEE International Conference on Advanced Robotics and Mechatronics (ICARM)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICARM52023.2021.9536084\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 6th IEEE International Conference on Advanced Robotics and Mechatronics (ICARM)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICARM52023.2021.9536084","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 2

摘要

可穿戴式传感和反馈装置可以为视障人士提供有用的信息。在本文中，我们开发了一种实时，多功能的电子眼镜(E-Glasses)，用于基于视觉的室内导航。我们提出的电子眼镜主要有两个功能，通过导航算法进行室内导航，通过深度学习技术进行感兴趣对象检测。将安全运动轨迹和目标信息进行汇总并反馈给视障人士。系统运行速度为39 fps，在采集的测试集图像中，平均精度达到84.77%。“导航”和“寻找目标”的详细实验总体成功率在91%以上，证明了E-Glasses的可行性。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Multi-functional Smart E-Glasses for Vision-Based Indoor Navigation

Wearable sensing and feedback device could provide useful information for the people with visual impairments. In this paper, we develop a real-time, multifunctional electronic eyeglasses (E-Glasses) for vision-based indoor navigation. Our proposed E-glasses has two main functions, which are indoor navigation through navigation algorithm, and object of interest detection through deep learning technology. The safe motion trajectory and the object information are summarized and feedback will be given to the people with visual impairments. The system can run at 39 fps and achieve mean average precision of 84.77% in the test set of images we collected. Detailed experiments of "Navigation" and "Find the target" had an overall success rate above 91%, demonstrating the feasibility of E-Glasses.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

2021 6th IEEE International Conference on Advanced Robotics and Mechatronics (ICARM)

自引率

0.00%

发文量