Zikai Yao;Qiang Liu;Zhangzhen Zhao;Yuliang Qin;Jinglong Zhu;Tianzhi Xia;Bo Li;Lipo Wang
{"title":"Night-Time Traffic Light Recognition Based on Enhancement-Guided Object Detection","authors":"Zikai Yao;Qiang Liu;Zhangzhen Zhao;Yuliang Qin;Jinglong Zhu;Tianzhi Xia;Bo Li;Lipo Wang","doi":"10.1109/TSMC.2025.3552621","DOIUrl":null,"url":null,"abstract":"Traffic light recognition is crucial for autonomous driving. While significant progress has been made in favorable conditions, recognition performance in night-time scenes remains a challenge. One straightforward approach is to apply enhancement methods that improve degraded images prior to object detection. However, since most enhancement methods are tailored for human perception; they may not consistently improve recognition accuracy for machine learning techniques. To address this, we propose an enhancement-guided framework for night-time traffic light recognition, called EG-TLR. EG-TLR consists of a residual denoising module (RDM) and a mixed attention traffic light detection module (MATLDM). The RDM reduces noise in degraded night-time images while preserving essential traffic light features by extracting sparsity information and performing context aggregation. The MATLDM improves feature extraction and recognition performance in complex night-time scenes by incorporating a shadow detection layer (SDL) and a mixed attention module (MAM). Moreover, to address the lack of a dedicated night-time traffic light dataset, we construct the Night-TL dataset utilizing publicly available images. Extensive experiments on Night-TL and LISA datasets demonstrate that EG-TLR achieves an AP50 of 79.83% and an AP50:95 of 36.62%, with an inference speed of 5.9 ms and 16.9 GFLOPs, outperforming other state-of-the-art methods. Furthermore, ablation studies and visualization results validate the effectiveness of our proposed method. The Night-TL dataset can be downloaded from: <uri>https://github.com/feiqinaqian/Night-TL-dataset</uri>.","PeriodicalId":48915,"journal":{"name":"IEEE Transactions on Systems Man Cybernetics-Systems","volume":"55 6","pages":"4410-4422"},"PeriodicalIF":8.6000,"publicationDate":"2025-04-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Systems Man Cybernetics-Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10947628/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Traffic light recognition is crucial for autonomous driving. While significant progress has been made in favorable conditions, recognition performance in night-time scenes remains a challenge. One straightforward approach is to apply enhancement methods that improve degraded images prior to object detection. However, since most enhancement methods are tailored for human perception; they may not consistently improve recognition accuracy for machine learning techniques. To address this, we propose an enhancement-guided framework for night-time traffic light recognition, called EG-TLR. EG-TLR consists of a residual denoising module (RDM) and a mixed attention traffic light detection module (MATLDM). The RDM reduces noise in degraded night-time images while preserving essential traffic light features by extracting sparsity information and performing context aggregation. The MATLDM improves feature extraction and recognition performance in complex night-time scenes by incorporating a shadow detection layer (SDL) and a mixed attention module (MAM). Moreover, to address the lack of a dedicated night-time traffic light dataset, we construct the Night-TL dataset utilizing publicly available images. Extensive experiments on Night-TL and LISA datasets demonstrate that EG-TLR achieves an AP50 of 79.83% and an AP50:95 of 36.62%, with an inference speed of 5.9 ms and 16.9 GFLOPs, outperforming other state-of-the-art methods. Furthermore, ablation studies and visualization results validate the effectiveness of our proposed method. The Night-TL dataset can be downloaded from: https://github.com/feiqinaqian/Night-TL-dataset.
期刊介绍:
The IEEE Transactions on Systems, Man, and Cybernetics: Systems encompasses the fields of systems engineering, covering issue formulation, analysis, and modeling throughout the systems engineering lifecycle phases. It addresses decision-making, issue interpretation, systems management, processes, and various methods such as optimization, modeling, and simulation in the development and deployment of large systems.