复杂多变光照条件下轨道小障碍物特征的多摄像机检测算法

IF 4.3 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Yefeng Qiu;Deqiang He;Zhenzhen Jin;Yanjun Chen;Sheng Shan
{"title":"复杂多变光照条件下轨道小障碍物特征的多摄像机检测算法","authors":"Yefeng Qiu;Deqiang He;Zhenzhen Jin;Yanjun Chen;Sheng Shan","doi":"10.1109/JSEN.2024.3502664","DOIUrl":null,"url":null,"abstract":"In addressing the challenges of false positives and missed detections of small-scale obstacles within low-illumination orbital environments, a multiscale detection algorithm MTD R-CNN based on multicamera is proposed. The proposed model contains three stages. In stage 1, the LCSwin Transformer is proposed to complete aggregating detailed features and global relationships. In stage 2, the SAFPN is proposed to realize hierarchical feature interaction at different scales. In stage 3, dynamic instance interactive head multiplexing and multiple loss sets are used to obtain more decadent detection boxes. The test results of the track scene under different illumination conditions show that 1) the accuracy of the MTD R-CNN is 95.2%, surpassing the performance of existing models; 2) the detection accuracy of small obstacles is improved by 3.7%-26.4%, thereby highlighting the model's superior perceptual capabilities for detecting such obstacles; and 3) the operation speed of the model is 36.63 ms to meet the real-time processing criteria. In summary, the model effectively improves the detection performance of small obstacles under low-light light conditions and has been applied in Nanning Metro Line 5.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 2","pages":"3772-3781"},"PeriodicalIF":4.3000,"publicationDate":"2024-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Multicamera Detection Algorithm for Small Obstacle Characteristics in the Rail Under Complex and Variable Illumination Conditions\",\"authors\":\"Yefeng Qiu;Deqiang He;Zhenzhen Jin;Yanjun Chen;Sheng Shan\",\"doi\":\"10.1109/JSEN.2024.3502664\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In addressing the challenges of false positives and missed detections of small-scale obstacles within low-illumination orbital environments, a multiscale detection algorithm MTD R-CNN based on multicamera is proposed. The proposed model contains three stages. In stage 1, the LCSwin Transformer is proposed to complete aggregating detailed features and global relationships. In stage 2, the SAFPN is proposed to realize hierarchical feature interaction at different scales. In stage 3, dynamic instance interactive head multiplexing and multiple loss sets are used to obtain more decadent detection boxes. The test results of the track scene under different illumination conditions show that 1) the accuracy of the MTD R-CNN is 95.2%, surpassing the performance of existing models; 2) the detection accuracy of small obstacles is improved by 3.7%-26.4%, thereby highlighting the model's superior perceptual capabilities for detecting such obstacles; and 3) the operation speed of the model is 36.63 ms to meet the real-time processing criteria. In summary, the model effectively improves the detection performance of small obstacles under low-light light conditions and has been applied in Nanning Metro Line 5.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"25 2\",\"pages\":\"3772-3781\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-12-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10785546/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10785546/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

针对低照度轨道环境中小尺度障碍物的误报和漏检问题,提出了一种基于多摄像机的MTD R-CNN多尺度检测算法。该模型包含三个阶段。在阶段1中,提出LCSwin Transformer来完成详细特征和全局关系的聚合。第二阶段,提出SAFPN,实现不同尺度的层次化特征交互。在第三阶段,采用动态实例交互头复用和多损失集来获得更多的颓废检测盒。不同光照条件下的轨道场景测试结果表明:1)MTD R-CNN的准确率达到95.2%,优于现有模型;2)小障碍物检测精度提高3.7% ~ 26.4%,突出了模型在小障碍物检测方面的优越感知能力;3)模型运行速度为36.63 ms,满足实时处理要求。综上所述,该模型有效提高了弱光条件下小障碍物的检测性能,并已在南宁地铁5号线中得到应用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A Multicamera Detection Algorithm for Small Obstacle Characteristics in the Rail Under Complex and Variable Illumination Conditions
In addressing the challenges of false positives and missed detections of small-scale obstacles within low-illumination orbital environments, a multiscale detection algorithm MTD R-CNN based on multicamera is proposed. The proposed model contains three stages. In stage 1, the LCSwin Transformer is proposed to complete aggregating detailed features and global relationships. In stage 2, the SAFPN is proposed to realize hierarchical feature interaction at different scales. In stage 3, dynamic instance interactive head multiplexing and multiple loss sets are used to obtain more decadent detection boxes. The test results of the track scene under different illumination conditions show that 1) the accuracy of the MTD R-CNN is 95.2%, surpassing the performance of existing models; 2) the detection accuracy of small obstacles is improved by 3.7%-26.4%, thereby highlighting the model's superior perceptual capabilities for detecting such obstacles; and 3) the operation speed of the model is 36.63 ms to meet the real-time processing criteria. In summary, the model effectively improves the detection performance of small obstacles under low-light light conditions and has been applied in Nanning Metro Line 5.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Sensors Journal
IEEE Sensors Journal 工程技术-工程:电子与电气
CiteScore
7.70
自引率
14.00%
发文量
2058
审稿时长
5.2 months
期刊介绍: The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following: -Sensor Phenomenology, Modelling, and Evaluation -Sensor Materials, Processing, and Fabrication -Chemical and Gas Sensors -Microfluidics and Biosensors -Optical Sensors -Physical Sensors: Temperature, Mechanical, Magnetic, and others -Acoustic and Ultrasonic Sensors -Sensor Packaging -Sensor Networks -Sensor Applications -Sensor Systems: Signals, Processing, and Interfaces -Actuators and Sensor Power Systems -Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting -Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data) -Sensors in Industrial Practice
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信