J. Sykes, Randy St. Fleur, Daler Norkulov, Z. Dong, R. Amineh
{"title":"Conscious GPS: A System to Aid the Visually Impaired to Navigate Public Transportation","authors":"J. Sykes, Randy St. Fleur, Daler Norkulov, Z. Dong, R. Amineh","doi":"10.1109/Sarnoff47838.2019.9067826","DOIUrl":null,"url":null,"abstract":"Using public transportation can be a major challenge for individuals with visual impairments. To navigate a mass transit system independently and safely, one needs to be able to gather information about their surroundings. We propose a Conscious GPS system to assist a user with visual impairment to navigate the public transit system. The system utilizes computer vision to autonomously record the users surroundings by taking various pictures in sequence and leveraging image processing techniques and machine learning to identify and extract information about key objects around the user. Our target object is the circular bus sign on an NYC MTA bus stop. We use Haar Cascade computer vision techniques to detect and locate the sign in an image through feature-based image classification. The proposed system experiences no misclassification after training the Haar Cascade classifier with a minimum hit rate of 0.99 and a maximum false alarm rate of 0.20 when navigating the daily city landscape and can accurately detect a bus stop sign.","PeriodicalId":306134,"journal":{"name":"2019 IEEE 40th Sarnoff Symposium","volume":"28 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 IEEE 40th Sarnoff Symposium","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/Sarnoff47838.2019.9067826","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Using public transportation can be a major challenge for individuals with visual impairments. To navigate a mass transit system independently and safely, one needs to be able to gather information about their surroundings. We propose a Conscious GPS system to assist a user with visual impairment to navigate the public transit system. The system utilizes computer vision to autonomously record the users surroundings by taking various pictures in sequence and leveraging image processing techniques and machine learning to identify and extract information about key objects around the user. Our target object is the circular bus sign on an NYC MTA bus stop. We use Haar Cascade computer vision techniques to detect and locate the sign in an image through feature-based image classification. The proposed system experiences no misclassification after training the Haar Cascade classifier with a minimum hit rate of 0.99 and a maximum false alarm rate of 0.20 when navigating the daily city landscape and can accurately detect a bus stop sign.