Elizabeth Hofer, Taufiq Rahman, Ryan Myers, Ismail Hamieh
{"title":"Training a Neural Network for Lane Demarcation Detection in the Infrared Spectrum","authors":"Elizabeth Hofer, Taufiq Rahman, Ryan Myers, Ismail Hamieh","doi":"10.1109/CCECE47787.2020.9255732","DOIUrl":null,"url":null,"abstract":"The retro-reflective characteristics of lane demarcations on roadways can potentially provide robust detection in the infrared spectrum even in poor lighting and weather conditions. This paper explores this idea by training a convolutional neural network using Darknet with YOLO to detect 9 classes of road lines from the Berkeley Deep Drive Dataset (BDD). Although BDD is composed of conventional colour images, they were converted to greyscale prior to training as a solution to the scarcity of datasets in the infrared spectrum. The trained model was evaluated on road scenes acquired by the infrared sensor of an Intel-Realsense camera. From the experimental results, it is concluded that object detection techniques primarily developed for localization and classification of objects in the form of bounding boxes are inherently unsuitable for detecting line shaped objects such roadway lane demarcations. In addition, despite the sub-optimal training and detection approach, the performance showed potential for robust lane detection using infrared images.","PeriodicalId":296506,"journal":{"name":"2020 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE)","volume":"1048 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CCECE47787.2020.9255732","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2
Abstract
The retro-reflective characteristics of lane demarcations on roadways can potentially provide robust detection in the infrared spectrum even in poor lighting and weather conditions. This paper explores this idea by training a convolutional neural network using Darknet with YOLO to detect 9 classes of road lines from the Berkeley Deep Drive Dataset (BDD). Although BDD is composed of conventional colour images, they were converted to greyscale prior to training as a solution to the scarcity of datasets in the infrared spectrum. The trained model was evaluated on road scenes acquired by the infrared sensor of an Intel-Realsense camera. From the experimental results, it is concluded that object detection techniques primarily developed for localization and classification of objects in the form of bounding boxes are inherently unsuitable for detecting line shaped objects such roadway lane demarcations. In addition, despite the sub-optimal training and detection approach, the performance showed potential for robust lane detection using infrared images.
即使在恶劣的照明和天气条件下,道路上车道边界的反向反射特性也可能提供强大的红外光谱检测。本文通过使用带有YOLO的Darknet训练卷积神经网络来检测来自Berkeley Deep Drive Dataset (BDD)的9类道路线来探索这一想法。虽然BDD由传统的彩色图像组成,但为了解决红外光谱数据集稀缺的问题,在训练之前将它们转换为灰度图像。用Intel-Realsense摄像机红外传感器采集的道路场景对训练后的模型进行了评估。从实验结果中可以得出结论,主要针对边界框形式的目标定位和分类而开发的目标检测技术本质上不适合检测道路车道划分等线形目标。此外,尽管训练和检测方法不是最优的,但该性能显示了使用红外图像进行鲁棒车道检测的潜力。