自动驾驶场景中目标检测的两阶段模型压缩框架

IF 4.3 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Qiyi He;Ao Xu;Zhiwei Ye;Wen Zhou;Yifan Zhang;Ruijie Xi
{"title":"自动驾驶场景中目标检测的两阶段模型压缩框架","authors":"Qiyi He;Ao Xu;Zhiwei Ye;Wen Zhou;Yifan Zhang;Ruijie Xi","doi":"10.1109/JSEN.2024.3498910","DOIUrl":null,"url":null,"abstract":"Recently, object detection, as a critical technology to improve the autonomous perception capabilities of optical sensors in autonomous driving systems (ADSs), has become a primary research focus in the field of ADS perception. However, the practical implementation of these networks can be challenging due to their scale and complexity, making it difficult to implement them directly on devices with limited resources. To address this issue, a universal two-stage model compression approach has been implemented. During the initial phase, ShuffDet (SD) is introduced as a lightweight network architecture to reduce the structural parameters within the network effectively. During the second phase, probability distribution distillation (PDD) techniques are applied to the network post-lightweighting to mitigate the impact of structural lightening on network precision. The algorithm was tested using two public datasets, BDD100K and KITTI. The experimental outcomes demonstrate that this method enhances precision while substantially lowering the model’s complexity. To demonstrate its universality, we replaced the base network with YOLOX, which produced satisfactory results. To determine the effectiveness of the method in real-world deployment settings, we deployed the model on an NVIDIA Jetson Nano chip. The experimental outcomes confirmed the effectiveness of our proposed approach, achieving real-time detection standards. When compared to alternative lightweighting techniques, this method is more advantageous for deployment in ADSs.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 2","pages":"3735-3749"},"PeriodicalIF":4.3000,"publicationDate":"2024-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Two-Stage Model Compression Framework for Object Detection in Autonomous Driving Scenarios\",\"authors\":\"Qiyi He;Ao Xu;Zhiwei Ye;Wen Zhou;Yifan Zhang;Ruijie Xi\",\"doi\":\"10.1109/JSEN.2024.3498910\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Recently, object detection, as a critical technology to improve the autonomous perception capabilities of optical sensors in autonomous driving systems (ADSs), has become a primary research focus in the field of ADS perception. However, the practical implementation of these networks can be challenging due to their scale and complexity, making it difficult to implement them directly on devices with limited resources. To address this issue, a universal two-stage model compression approach has been implemented. During the initial phase, ShuffDet (SD) is introduced as a lightweight network architecture to reduce the structural parameters within the network effectively. During the second phase, probability distribution distillation (PDD) techniques are applied to the network post-lightweighting to mitigate the impact of structural lightening on network precision. The algorithm was tested using two public datasets, BDD100K and KITTI. The experimental outcomes demonstrate that this method enhances precision while substantially lowering the model’s complexity. To demonstrate its universality, we replaced the base network with YOLOX, which produced satisfactory results. To determine the effectiveness of the method in real-world deployment settings, we deployed the model on an NVIDIA Jetson Nano chip. The experimental outcomes confirmed the effectiveness of our proposed approach, achieving real-time detection standards. When compared to alternative lightweighting techniques, this method is more advantageous for deployment in ADSs.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"25 2\",\"pages\":\"3735-3749\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-12-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10791416/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10791416/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

近年来,目标检测作为提高自动驾驶系统光学传感器自主感知能力的关键技术,已成为自动驾驶系统感知领域的研究热点。然而,由于其规模和复杂性,这些网络的实际实现可能具有挑战性,使得难以在资源有限的设备上直接实现它们。为了解决这个问题,实现了一种通用的两阶段模型压缩方法。在初始阶段,引入SD (ShuffDet)作为一种轻量级网络架构,有效地减少了网络内部的结构参数。在第二阶段,将概率分布蒸馏(PDD)技术应用于网络轻量化后,以减轻结构轻量化对网络精度的影响。使用BDD100K和KITTI两个公共数据集对该算法进行了测试。实验结果表明,该方法在大大降低模型复杂度的同时,提高了模型的精度。为了证明它的通用性,我们用YOLOX代替了基础网络,取得了令人满意的效果。为了确定该方法在实际部署设置中的有效性,我们将该模型部署在NVIDIA Jetson Nano芯片上。实验结果证实了我们提出的方法的有效性,达到了实时检测标准。与其他轻量化技术相比,该方法更适合部署在ads中。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A Two-Stage Model Compression Framework for Object Detection in Autonomous Driving Scenarios
Recently, object detection, as a critical technology to improve the autonomous perception capabilities of optical sensors in autonomous driving systems (ADSs), has become a primary research focus in the field of ADS perception. However, the practical implementation of these networks can be challenging due to their scale and complexity, making it difficult to implement them directly on devices with limited resources. To address this issue, a universal two-stage model compression approach has been implemented. During the initial phase, ShuffDet (SD) is introduced as a lightweight network architecture to reduce the structural parameters within the network effectively. During the second phase, probability distribution distillation (PDD) techniques are applied to the network post-lightweighting to mitigate the impact of structural lightening on network precision. The algorithm was tested using two public datasets, BDD100K and KITTI. The experimental outcomes demonstrate that this method enhances precision while substantially lowering the model’s complexity. To demonstrate its universality, we replaced the base network with YOLOX, which produced satisfactory results. To determine the effectiveness of the method in real-world deployment settings, we deployed the model on an NVIDIA Jetson Nano chip. The experimental outcomes confirmed the effectiveness of our proposed approach, achieving real-time detection standards. When compared to alternative lightweighting techniques, this method is more advantageous for deployment in ADSs.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Sensors Journal
IEEE Sensors Journal 工程技术-工程:电子与电气
CiteScore
7.70
自引率
14.00%
发文量
2058
审稿时长
5.2 months
期刊介绍: The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following: -Sensor Phenomenology, Modelling, and Evaluation -Sensor Materials, Processing, and Fabrication -Chemical and Gas Sensors -Microfluidics and Biosensors -Optical Sensors -Physical Sensors: Temperature, Mechanical, Magnetic, and others -Acoustic and Ultrasonic Sensors -Sensor Packaging -Sensor Networks -Sensor Applications -Sensor Systems: Signals, Processing, and Interfaces -Actuators and Sensor Power Systems -Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting -Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data) -Sensors in Industrial Practice
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信