利用人工智能技术为视障人士提供户外障碍物检测服务

Loubna Bougheloum, M. B. Salah, M. Bettayeb
{"title":"利用人工智能技术为视障人士提供户外障碍物检测服务","authors":"Loubna Bougheloum, M. B. Salah, M. Bettayeb","doi":"10.1109/ICETSIS61505.2024.10459374","DOIUrl":null,"url":null,"abstract":"Obstacle detection is a crucial factor in ensuring the safety and mobility of visually impaired individuals. This paper introduces a comprehensive system designed to support individuals with visual impairments in outdoor environments, employing recent advancements in artificial intelligence (AI). The core of the system involves the use of YOLOv5 for efficient object recognition and Google Text-to-Speech (GTTS) for the conversion of detection results into clear and informative audio feedback. The model is trained on a customized dataset encompassing 10 specific outdoor object categories, in addition with the widely used MS COCO dataset. This strategic combination allows the system to attain heigh accuracy in obstacle detection, surpassing the performance of previous techniques. The model's ability to accurately identify and classify outdoor objects contributes to its efficacy in real-world scenarios. To ensure user accessibility, the system transforms output labels into text, which is then converted into an audio format. This audio feedback is seamlessly delivered to visually impaired users via earphones, providing real-time information about their surroundings. This approach represents a significant advancement in AI-driven outdoor obstacle detection, promising not only improved accuracy but also enhanced usability for individuals with visual impairments. By addressing the challenges of outdoor navigation, this new approach has the capacity to significantly enhance the autonomy and well-being of people with visual impairments in their everyday activities.","PeriodicalId":518932,"journal":{"name":"2024 ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS)","volume":"354 7-8","pages":"628-633"},"PeriodicalIF":0.0000,"publicationDate":"2024-01-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Outdoor Obstacle Detection for Visually Impaired using AI Technique\",\"authors\":\"Loubna Bougheloum, M. B. Salah, M. Bettayeb\",\"doi\":\"10.1109/ICETSIS61505.2024.10459374\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Obstacle detection is a crucial factor in ensuring the safety and mobility of visually impaired individuals. This paper introduces a comprehensive system designed to support individuals with visual impairments in outdoor environments, employing recent advancements in artificial intelligence (AI). The core of the system involves the use of YOLOv5 for efficient object recognition and Google Text-to-Speech (GTTS) for the conversion of detection results into clear and informative audio feedback. The model is trained on a customized dataset encompassing 10 specific outdoor object categories, in addition with the widely used MS COCO dataset. This strategic combination allows the system to attain heigh accuracy in obstacle detection, surpassing the performance of previous techniques. The model's ability to accurately identify and classify outdoor objects contributes to its efficacy in real-world scenarios. To ensure user accessibility, the system transforms output labels into text, which is then converted into an audio format. This audio feedback is seamlessly delivered to visually impaired users via earphones, providing real-time information about their surroundings. This approach represents a significant advancement in AI-driven outdoor obstacle detection, promising not only improved accuracy but also enhanced usability for individuals with visual impairments. By addressing the challenges of outdoor navigation, this new approach has the capacity to significantly enhance the autonomy and well-being of people with visual impairments in their everyday activities.\",\"PeriodicalId\":518932,\"journal\":{\"name\":\"2024 ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS)\",\"volume\":\"354 7-8\",\"pages\":\"628-633\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-01-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2024 ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICETSIS61505.2024.10459374\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2024 ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICETSIS61505.2024.10459374","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

障碍物检测是确保视障人士安全和行动能力的关键因素。本文介绍了一个综合系统,该系统旨在利用人工智能(AI)的最新进展,为户外环境中的视障人士提供支持。该系统的核心包括使用 YOLOv5 进行高效的物体识别,以及使用谷歌文本到语音(GTTS)将检测结果转换为清晰翔实的音频反馈。除广泛使用的 MS COCO 数据集外,该模型还在包含 10 个特定户外物体类别的定制数据集上进行了训练。这种策略性组合使系统在障碍物检测方面达到了很高的精度,超越了以往技术的性能。该模型能够准确识别和分类室外物体,因此在实际应用中非常有效。为确保用户无障碍使用,该系统将输出标签转换为文本,然后再转换为音频格式。这种音频反馈可通过耳机无缝传送给视障用户,为他们提供周围环境的实时信息。这种方法代表了人工智能驱动的户外障碍物检测技术的重大进步,不仅有望提高准确性,还能增强视障人士的可用性。通过应对户外导航的挑战,这种新方法能够显著提高视障人士在日常活动中的自主性和幸福感。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Outdoor Obstacle Detection for Visually Impaired using AI Technique
Obstacle detection is a crucial factor in ensuring the safety and mobility of visually impaired individuals. This paper introduces a comprehensive system designed to support individuals with visual impairments in outdoor environments, employing recent advancements in artificial intelligence (AI). The core of the system involves the use of YOLOv5 for efficient object recognition and Google Text-to-Speech (GTTS) for the conversion of detection results into clear and informative audio feedback. The model is trained on a customized dataset encompassing 10 specific outdoor object categories, in addition with the widely used MS COCO dataset. This strategic combination allows the system to attain heigh accuracy in obstacle detection, surpassing the performance of previous techniques. The model's ability to accurately identify and classify outdoor objects contributes to its efficacy in real-world scenarios. To ensure user accessibility, the system transforms output labels into text, which is then converted into an audio format. This audio feedback is seamlessly delivered to visually impaired users via earphones, providing real-time information about their surroundings. This approach represents a significant advancement in AI-driven outdoor obstacle detection, promising not only improved accuracy but also enhanced usability for individuals with visual impairments. By addressing the challenges of outdoor navigation, this new approach has the capacity to significantly enhance the autonomy and well-being of people with visual impairments in their everyday activities.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信