SAAM-ReflectNet: Sign-aware attention-based multitasking framework for integrated traffic sign detection and retroreflectivity estimation

IF 7.5 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Joshua Kofi Asamoah , Blessing Agyei Kyem , Nathan David Obeng-Amoako , Armstrong Aboah
{"title":"SAAM-ReflectNet: Sign-aware attention-based multitasking framework for integrated traffic sign detection and retroreflectivity estimation","authors":"Joshua Kofi Asamoah ,&nbsp;Blessing Agyei Kyem ,&nbsp;Nathan David Obeng-Amoako ,&nbsp;Armstrong Aboah","doi":"10.1016/j.eswa.2025.128003","DOIUrl":null,"url":null,"abstract":"<div><div>Traffic sign retroreflectivity is essential for roadway safety, particularly in low-light and adverse weather conditions. Traditional methods, such as handheld retroreflectometers and nighttime inspections, are labor-intensive, costly, and unsuitable for large-scale implementation. To address these limitations, we developed SAAM-ReflectNet, a deep learning framework that unifies traffic sign detection, classification, and retroreflectivity estimation into a single automated pipeline. Our RetroNet backbone, developed as part of this study, extracts robust spatial and semantic features to enhance feature representation. The Sign-Aware Attention Module we designed prioritizes critical traffic sign regions, improving detection and classification accuracy by focusing on the most relevant areas. Additionally, our multimodal fusion layers seamlessly integrate RGB imagery with LiDAR intensity data, enabling reliable retroreflectivity estimation. ReflectNet achieved a mean Average Precision (mAP) of 0.635 at IoU=0.5 and 0.522 across IoU thresholds from 0.5 to 0.95, alongside Root Mean Squared Errors (RMSE) of 0.169 for foreground and 0.147 for background reflectivity. Across 15 evaluation runs, performance improvements were statistically significant compared to all baselines (p &lt; 0.05), underscoring the consistency and reliability of ReflectNet.These findings underscore the reliability, scalability, and transferability of our approach, establishing ReflectNet as a transformative tool for intelligent transportation systems and proactive traffic sign maintenance.</div></div>","PeriodicalId":50461,"journal":{"name":"Expert Systems with Applications","volume":"286 ","pages":"Article 128003"},"PeriodicalIF":7.5000,"publicationDate":"2025-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems with Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957417425016240","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Traffic sign retroreflectivity is essential for roadway safety, particularly in low-light and adverse weather conditions. Traditional methods, such as handheld retroreflectometers and nighttime inspections, are labor-intensive, costly, and unsuitable for large-scale implementation. To address these limitations, we developed SAAM-ReflectNet, a deep learning framework that unifies traffic sign detection, classification, and retroreflectivity estimation into a single automated pipeline. Our RetroNet backbone, developed as part of this study, extracts robust spatial and semantic features to enhance feature representation. The Sign-Aware Attention Module we designed prioritizes critical traffic sign regions, improving detection and classification accuracy by focusing on the most relevant areas. Additionally, our multimodal fusion layers seamlessly integrate RGB imagery with LiDAR intensity data, enabling reliable retroreflectivity estimation. ReflectNet achieved a mean Average Precision (mAP) of 0.635 at IoU=0.5 and 0.522 across IoU thresholds from 0.5 to 0.95, alongside Root Mean Squared Errors (RMSE) of 0.169 for foreground and 0.147 for background reflectivity. Across 15 evaluation runs, performance improvements were statistically significant compared to all baselines (p < 0.05), underscoring the consistency and reliability of ReflectNet.These findings underscore the reliability, scalability, and transferability of our approach, establishing ReflectNet as a transformative tool for intelligent transportation systems and proactive traffic sign maintenance.
SAAM-ReflectNet:用于综合交通标志检测和反射率估计的基于注意的多任务处理框架
交通标志的反射率对道路安全至关重要,特别是在光线不足和恶劣天气条件下。传统的方法,如手持式反射仪和夜间检查,是劳动密集型的,昂贵的,不适合大规模实施。为了解决这些限制,我们开发了SAAM-ReflectNet,这是一个深度学习框架,将交通标志检测、分类和反反射率估计统一到一个自动化管道中。作为本研究的一部分,我们开发的RetroNet主干提取鲁棒的空间和语义特征以增强特征表示。我们设计的标志感知注意力模块对关键的交通标志区域进行优先排序,通过关注最相关的区域来提高检测和分类的准确性。此外,我们的多模态融合层将RGB图像与LiDAR强度数据无缝集成,从而实现可靠的反射率估计。在IoU=0.5时,ReflectNet的平均平均精度(mAP)为0.635,在IoU阈值从0.5到0.95的范围内为0.522,前景反射率的均方根误差(RMSE)为0.169,背景反射率为0.147。在15次评估运行中,与所有基线相比,性能改进具有统计学意义(p <;0.05),强调了ReflectNet的一致性和可靠性。这些发现强调了我们的方法的可靠性、可扩展性和可移植性,将ReflectNet建立为智能交通系统和主动交通标志维护的变革工具。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Expert Systems with Applications
Expert Systems with Applications 工程技术-工程:电子与电气
CiteScore
13.80
自引率
10.60%
发文量
2045
审稿时长
8.7 months
期刊介绍: Expert Systems With Applications is an international journal dedicated to the exchange of information on expert and intelligent systems used globally in industry, government, and universities. The journal emphasizes original papers covering the design, development, testing, implementation, and management of these systems, offering practical guidelines. It spans various sectors such as finance, engineering, marketing, law, project management, information management, medicine, and more. The journal also welcomes papers on multi-agent systems, knowledge management, neural networks, knowledge discovery, data mining, and other related areas, excluding applications to military/defense systems.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信