{"title":"基于YOLOv5和Deepsort的夜间建筑工人视觉跟踪方法","authors":"Guofeng Ma, Yiqin Jing, Zihao Huang, Jing Xu, Houzhuang Zhu","doi":"10.36680/j.itcon.2023.038","DOIUrl":null,"url":null,"abstract":"Due to poor visibility and fatigue factors, although nighttime construction has been widely used, its safety problems like struck-by accidents have also become increasingly prominent. Most of the current tracking methods of workers are not suitable for direct application in nighttime construction scenarios, so this research proposes a vision-based method, which integrates low-light image enhancement technology, YOLOv5 and Deepsort to track nighttime workers. The proposed method is mainly composed of four modules, including illumination enhancement module, detection module, the Kalman filter and matching module. In the experiment based on nine test videos, the method achieved the average multiple-object tracking accuracy (MOTA) of 89.93% and multiple-object tracking precision (MOTP) of 97.07%. At the same time, the experimental results also show that the method is robust to the common tracking challenges of occlusions, scale variations and posture variations. The proposed method has practical application potential in the monitoring task in nighttime construction, which makes the nighttime construction activities safer and more efficient.","PeriodicalId":51624,"journal":{"name":"Journal of Information Technology in Construction","volume":"19 S27","pages":"0"},"PeriodicalIF":3.6000,"publicationDate":"2023-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Vision-based tracking method of nighttime construction workers by integrating YOLOv5 and Deepsort\",\"authors\":\"Guofeng Ma, Yiqin Jing, Zihao Huang, Jing Xu, Houzhuang Zhu\",\"doi\":\"10.36680/j.itcon.2023.038\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Due to poor visibility and fatigue factors, although nighttime construction has been widely used, its safety problems like struck-by accidents have also become increasingly prominent. Most of the current tracking methods of workers are not suitable for direct application in nighttime construction scenarios, so this research proposes a vision-based method, which integrates low-light image enhancement technology, YOLOv5 and Deepsort to track nighttime workers. The proposed method is mainly composed of four modules, including illumination enhancement module, detection module, the Kalman filter and matching module. In the experiment based on nine test videos, the method achieved the average multiple-object tracking accuracy (MOTA) of 89.93% and multiple-object tracking precision (MOTP) of 97.07%. At the same time, the experimental results also show that the method is robust to the common tracking challenges of occlusions, scale variations and posture variations. The proposed method has practical application potential in the monitoring task in nighttime construction, which makes the nighttime construction activities safer and more efficient.\",\"PeriodicalId\":51624,\"journal\":{\"name\":\"Journal of Information Technology in Construction\",\"volume\":\"19 S27\",\"pages\":\"0\"},\"PeriodicalIF\":3.6000,\"publicationDate\":\"2023-11-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Information Technology in Construction\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.36680/j.itcon.2023.038\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, CIVIL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Information Technology in Construction","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.36680/j.itcon.2023.038","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CIVIL","Score":null,"Total":0}
Vision-based tracking method of nighttime construction workers by integrating YOLOv5 and Deepsort
Due to poor visibility and fatigue factors, although nighttime construction has been widely used, its safety problems like struck-by accidents have also become increasingly prominent. Most of the current tracking methods of workers are not suitable for direct application in nighttime construction scenarios, so this research proposes a vision-based method, which integrates low-light image enhancement technology, YOLOv5 and Deepsort to track nighttime workers. The proposed method is mainly composed of four modules, including illumination enhancement module, detection module, the Kalman filter and matching module. In the experiment based on nine test videos, the method achieved the average multiple-object tracking accuracy (MOTA) of 89.93% and multiple-object tracking precision (MOTP) of 97.07%. At the same time, the experimental results also show that the method is robust to the common tracking challenges of occlusions, scale variations and posture variations. The proposed method has practical application potential in the monitoring task in nighttime construction, which makes the nighttime construction activities safer and more efficient.