TSD-DETR: A lightweight real-time detection transformer of traffic sign detection for long-range perception of autonomous driving

IF 7.5 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS
{"title":"TSD-DETR: A lightweight real-time detection transformer of traffic sign detection for long-range perception of autonomous driving","authors":"","doi":"10.1016/j.engappai.2024.109536","DOIUrl":null,"url":null,"abstract":"<div><div>The key to accurate perception and efficient decision making of autonomous driving is the long-range detection of traffic signs. Long-range detection of traffic signs has the problems of small traffic sign size and complex background. In order to solve these problems, this paper proposes a lightweight model for traffic sign detection based on real-time detection transformer (TSD-DETR). Firstly, the feature extraction module is constructed using multiple types of convolutional modules. The model extracts multi-scale features of different levels to enhance feature extraction ability. Then, small object detection module and detection head are designed to extract and detect shallow features. It can improve the detection of small traffic signs. Finally, Efficient Multi-Scale Attention is introduced to adjust the channel weights. It aggregates the output features of three parallel branches interactively. TSD-DETR achieves a mean average precision (mAp) of 96.8% on Tsinghua-Tencent 100K dataset. It is improved by 2.5% compared with real-time detection transformer. In small object detection, mAp improved by 9%. TSD-DETR achieves 99.4% mAp on the Changsha University of Science and Technology Chinese Traffic Sign Detection Benchmark dataset, with an improvement of 0.6%. The experimental results show that TSD-DETR reduces the number of parameters by 9.06M by optimizing the model structure. On the premise of ensuring the real-time performance of the model, the detection accuracy of the model is improved greatly. The results of ablation experiments show that the feature extraction module and small object detection module proposed in this paper are conducive to improving the detection accuracy.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":null,"pages":null},"PeriodicalIF":7.5000,"publicationDate":"2024-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197624016944","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

The key to accurate perception and efficient decision making of autonomous driving is the long-range detection of traffic signs. Long-range detection of traffic signs has the problems of small traffic sign size and complex background. In order to solve these problems, this paper proposes a lightweight model for traffic sign detection based on real-time detection transformer (TSD-DETR). Firstly, the feature extraction module is constructed using multiple types of convolutional modules. The model extracts multi-scale features of different levels to enhance feature extraction ability. Then, small object detection module and detection head are designed to extract and detect shallow features. It can improve the detection of small traffic signs. Finally, Efficient Multi-Scale Attention is introduced to adjust the channel weights. It aggregates the output features of three parallel branches interactively. TSD-DETR achieves a mean average precision (mAp) of 96.8% on Tsinghua-Tencent 100K dataset. It is improved by 2.5% compared with real-time detection transformer. In small object detection, mAp improved by 9%. TSD-DETR achieves 99.4% mAp on the Changsha University of Science and Technology Chinese Traffic Sign Detection Benchmark dataset, with an improvement of 0.6%. The experimental results show that TSD-DETR reduces the number of parameters by 9.06M by optimizing the model structure. On the premise of ensuring the real-time performance of the model, the detection accuracy of the model is improved greatly. The results of ablation experiments show that the feature extraction module and small object detection module proposed in this paper are conducive to improving the detection accuracy.
TSD-DETR:用于自动驾驶远距离感知的轻量级交通标志检测实时检测变换器
自动驾驶的准确感知和高效决策关键在于交通标志的远距离探测。交通标志的远距离检测存在交通标志尺寸小、背景复杂等问题。为了解决这些问题,本文提出了一种基于实时检测变换器(TSD-DETR)的轻量级交通标志检测模型。首先,利用多种卷积模块构建特征提取模块。该模型提取不同层次的多尺度特征,以增强特征提取能力。然后,设计了小目标检测模块和检测头,用于提取和检测浅层特征。它可以提高对小型交通标志的检测能力。最后,引入高效多尺度关注来调整通道权重。它将三个并行分支的输出特性进行交互式聚合。在清华-腾讯 100K 数据集上,TSD-DETR 的平均精度 (mAp) 达到 96.8%。与实时检测转换器相比,提高了 2.5%。在小物体检测方面,mAp 提高了 9%。在长沙理工大学中国交通标志检测基准数据集上,TSD-DETR 的 mAp 达到 99.4%,提高了 0.6%。实验结果表明,TSD-DETR 通过优化模型结构,减少了 9.06M 的参数数量。在保证模型实时性的前提下,大大提高了模型的检测精度。烧蚀实验结果表明,本文提出的特征提取模块和小目标检测模块有利于提高检测精度。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Engineering Applications of Artificial Intelligence
Engineering Applications of Artificial Intelligence 工程技术-工程:电子与电气
CiteScore
9.60
自引率
10.00%
发文量
505
审稿时长
68 days
期刊介绍: Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信