{"title":"复杂多变光照条件下轨道小障碍物特征的多摄像机检测算法","authors":"Yefeng Qiu;Deqiang He;Zhenzhen Jin;Yanjun Chen;Sheng Shan","doi":"10.1109/JSEN.2024.3502664","DOIUrl":null,"url":null,"abstract":"In addressing the challenges of false positives and missed detections of small-scale obstacles within low-illumination orbital environments, a multiscale detection algorithm MTD R-CNN based on multicamera is proposed. The proposed model contains three stages. In stage 1, the LCSwin Transformer is proposed to complete aggregating detailed features and global relationships. In stage 2, the SAFPN is proposed to realize hierarchical feature interaction at different scales. In stage 3, dynamic instance interactive head multiplexing and multiple loss sets are used to obtain more decadent detection boxes. The test results of the track scene under different illumination conditions show that 1) the accuracy of the MTD R-CNN is 95.2%, surpassing the performance of existing models; 2) the detection accuracy of small obstacles is improved by 3.7%-26.4%, thereby highlighting the model's superior perceptual capabilities for detecting such obstacles; and 3) the operation speed of the model is 36.63 ms to meet the real-time processing criteria. In summary, the model effectively improves the detection performance of small obstacles under low-light light conditions and has been applied in Nanning Metro Line 5.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 2","pages":"3772-3781"},"PeriodicalIF":4.3000,"publicationDate":"2024-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Multicamera Detection Algorithm for Small Obstacle Characteristics in the Rail Under Complex and Variable Illumination Conditions\",\"authors\":\"Yefeng Qiu;Deqiang He;Zhenzhen Jin;Yanjun Chen;Sheng Shan\",\"doi\":\"10.1109/JSEN.2024.3502664\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In addressing the challenges of false positives and missed detections of small-scale obstacles within low-illumination orbital environments, a multiscale detection algorithm MTD R-CNN based on multicamera is proposed. The proposed model contains three stages. In stage 1, the LCSwin Transformer is proposed to complete aggregating detailed features and global relationships. In stage 2, the SAFPN is proposed to realize hierarchical feature interaction at different scales. In stage 3, dynamic instance interactive head multiplexing and multiple loss sets are used to obtain more decadent detection boxes. The test results of the track scene under different illumination conditions show that 1) the accuracy of the MTD R-CNN is 95.2%, surpassing the performance of existing models; 2) the detection accuracy of small obstacles is improved by 3.7%-26.4%, thereby highlighting the model's superior perceptual capabilities for detecting such obstacles; and 3) the operation speed of the model is 36.63 ms to meet the real-time processing criteria. In summary, the model effectively improves the detection performance of small obstacles under low-light light conditions and has been applied in Nanning Metro Line 5.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"25 2\",\"pages\":\"3772-3781\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-12-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10785546/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10785546/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
A Multicamera Detection Algorithm for Small Obstacle Characteristics in the Rail Under Complex and Variable Illumination Conditions
In addressing the challenges of false positives and missed detections of small-scale obstacles within low-illumination orbital environments, a multiscale detection algorithm MTD R-CNN based on multicamera is proposed. The proposed model contains three stages. In stage 1, the LCSwin Transformer is proposed to complete aggregating detailed features and global relationships. In stage 2, the SAFPN is proposed to realize hierarchical feature interaction at different scales. In stage 3, dynamic instance interactive head multiplexing and multiple loss sets are used to obtain more decadent detection boxes. The test results of the track scene under different illumination conditions show that 1) the accuracy of the MTD R-CNN is 95.2%, surpassing the performance of existing models; 2) the detection accuracy of small obstacles is improved by 3.7%-26.4%, thereby highlighting the model's superior perceptual capabilities for detecting such obstacles; and 3) the operation speed of the model is 36.63 ms to meet the real-time processing criteria. In summary, the model effectively improves the detection performance of small obstacles under low-light light conditions and has been applied in Nanning Metro Line 5.
期刊介绍:
The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following:
-Sensor Phenomenology, Modelling, and Evaluation
-Sensor Materials, Processing, and Fabrication
-Chemical and Gas Sensors
-Microfluidics and Biosensors
-Optical Sensors
-Physical Sensors: Temperature, Mechanical, Magnetic, and others
-Acoustic and Ultrasonic Sensors
-Sensor Packaging
-Sensor Networks
-Sensor Applications
-Sensor Systems: Signals, Processing, and Interfaces
-Actuators and Sensor Power Systems
-Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting
-Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data)
-Sensors in Industrial Practice