Qiyi He;Ao Xu;Zhiwei Ye;Wen Zhou;Yifan Zhang;Ruijie Xi
{"title":"自动驾驶场景中目标检测的两阶段模型压缩框架","authors":"Qiyi He;Ao Xu;Zhiwei Ye;Wen Zhou;Yifan Zhang;Ruijie Xi","doi":"10.1109/JSEN.2024.3498910","DOIUrl":null,"url":null,"abstract":"Recently, object detection, as a critical technology to improve the autonomous perception capabilities of optical sensors in autonomous driving systems (ADSs), has become a primary research focus in the field of ADS perception. However, the practical implementation of these networks can be challenging due to their scale and complexity, making it difficult to implement them directly on devices with limited resources. To address this issue, a universal two-stage model compression approach has been implemented. During the initial phase, ShuffDet (SD) is introduced as a lightweight network architecture to reduce the structural parameters within the network effectively. During the second phase, probability distribution distillation (PDD) techniques are applied to the network post-lightweighting to mitigate the impact of structural lightening on network precision. The algorithm was tested using two public datasets, BDD100K and KITTI. The experimental outcomes demonstrate that this method enhances precision while substantially lowering the model’s complexity. To demonstrate its universality, we replaced the base network with YOLOX, which produced satisfactory results. To determine the effectiveness of the method in real-world deployment settings, we deployed the model on an NVIDIA Jetson Nano chip. The experimental outcomes confirmed the effectiveness of our proposed approach, achieving real-time detection standards. When compared to alternative lightweighting techniques, this method is more advantageous for deployment in ADSs.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 2","pages":"3735-3749"},"PeriodicalIF":4.3000,"publicationDate":"2024-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Two-Stage Model Compression Framework for Object Detection in Autonomous Driving Scenarios\",\"authors\":\"Qiyi He;Ao Xu;Zhiwei Ye;Wen Zhou;Yifan Zhang;Ruijie Xi\",\"doi\":\"10.1109/JSEN.2024.3498910\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Recently, object detection, as a critical technology to improve the autonomous perception capabilities of optical sensors in autonomous driving systems (ADSs), has become a primary research focus in the field of ADS perception. However, the practical implementation of these networks can be challenging due to their scale and complexity, making it difficult to implement them directly on devices with limited resources. To address this issue, a universal two-stage model compression approach has been implemented. During the initial phase, ShuffDet (SD) is introduced as a lightweight network architecture to reduce the structural parameters within the network effectively. During the second phase, probability distribution distillation (PDD) techniques are applied to the network post-lightweighting to mitigate the impact of structural lightening on network precision. The algorithm was tested using two public datasets, BDD100K and KITTI. The experimental outcomes demonstrate that this method enhances precision while substantially lowering the model’s complexity. To demonstrate its universality, we replaced the base network with YOLOX, which produced satisfactory results. To determine the effectiveness of the method in real-world deployment settings, we deployed the model on an NVIDIA Jetson Nano chip. The experimental outcomes confirmed the effectiveness of our proposed approach, achieving real-time detection standards. When compared to alternative lightweighting techniques, this method is more advantageous for deployment in ADSs.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"25 2\",\"pages\":\"3735-3749\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-12-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10791416/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10791416/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
A Two-Stage Model Compression Framework for Object Detection in Autonomous Driving Scenarios
Recently, object detection, as a critical technology to improve the autonomous perception capabilities of optical sensors in autonomous driving systems (ADSs), has become a primary research focus in the field of ADS perception. However, the practical implementation of these networks can be challenging due to their scale and complexity, making it difficult to implement them directly on devices with limited resources. To address this issue, a universal two-stage model compression approach has been implemented. During the initial phase, ShuffDet (SD) is introduced as a lightweight network architecture to reduce the structural parameters within the network effectively. During the second phase, probability distribution distillation (PDD) techniques are applied to the network post-lightweighting to mitigate the impact of structural lightening on network precision. The algorithm was tested using two public datasets, BDD100K and KITTI. The experimental outcomes demonstrate that this method enhances precision while substantially lowering the model’s complexity. To demonstrate its universality, we replaced the base network with YOLOX, which produced satisfactory results. To determine the effectiveness of the method in real-world deployment settings, we deployed the model on an NVIDIA Jetson Nano chip. The experimental outcomes confirmed the effectiveness of our proposed approach, achieving real-time detection standards. When compared to alternative lightweighting techniques, this method is more advantageous for deployment in ADSs.
期刊介绍:
The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following:
-Sensor Phenomenology, Modelling, and Evaluation
-Sensor Materials, Processing, and Fabrication
-Chemical and Gas Sensors
-Microfluidics and Biosensors
-Optical Sensors
-Physical Sensors: Temperature, Mechanical, Magnetic, and others
-Acoustic and Ultrasonic Sensors
-Sensor Packaging
-Sensor Networks
-Sensor Applications
-Sensor Systems: Signals, Processing, and Interfaces
-Actuators and Sensor Power Systems
-Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting
-Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data)
-Sensors in Industrial Practice