Hanbo Zheng;Shiqi Xu;Jinheng Li;Fang Gao;Zhimei Cui
{"title":"A Lightweight Method Integrating Keypoint Detection and Perspective Geometry for Substation Safety Distance Monitoring","authors":"Hanbo Zheng;Shiqi Xu;Jinheng Li;Fang Gao;Zhimei Cui","doi":"10.1109/TPWRD.2024.3522808","DOIUrl":null,"url":null,"abstract":"In the high-voltage environment of substations, due to the lack of effective monitoring methods, personnel may fail to maintain a safe distance from the equipment due to subjective factors, leading to electric shock accidents. To more effectively reduce the occurrence of such accidents, this paper proposes a monocular vision-based method for monitoring the safety distance between personnel and live equipment. Firstly, this paper makes lightweight improvements to the YOLOv8 (You Only Look Once) keypoint detection model by introducing the proposed dense feature fusion (DFF) module and adaptive channel cross (ACC) module into the backbone and neck, respectively, and replacing the network's original path aggregation network (PAN) structure with the bi-directional feature pyramid network (BiFPN) structure. Subsequently, based on the principles of camera imaging and perspective geometry, this paper calculates the mapping relationship between two-dimensional pixel coordinates and three-dimensional world coordinates. Finally, based on the detected keypoints and the obtained mapping relationship, the distance between personnel and live equipment is monitored. Experiments conducted in a substation scenario show that the improved keypoint detection model increases AP from 0.718 to 0.771, reduces parameters from 3.09M to 2.10M, and lowers FLOPs from 8.48G to 7.01G, and the maximum distance measurement error is only 3.778%.","PeriodicalId":13498,"journal":{"name":"IEEE Transactions on Power Delivery","volume":"40 2","pages":"810-821"},"PeriodicalIF":3.8000,"publicationDate":"2024-12-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Power Delivery","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10816303/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
In the high-voltage environment of substations, due to the lack of effective monitoring methods, personnel may fail to maintain a safe distance from the equipment due to subjective factors, leading to electric shock accidents. To more effectively reduce the occurrence of such accidents, this paper proposes a monocular vision-based method for monitoring the safety distance between personnel and live equipment. Firstly, this paper makes lightweight improvements to the YOLOv8 (You Only Look Once) keypoint detection model by introducing the proposed dense feature fusion (DFF) module and adaptive channel cross (ACC) module into the backbone and neck, respectively, and replacing the network's original path aggregation network (PAN) structure with the bi-directional feature pyramid network (BiFPN) structure. Subsequently, based on the principles of camera imaging and perspective geometry, this paper calculates the mapping relationship between two-dimensional pixel coordinates and three-dimensional world coordinates. Finally, based on the detected keypoints and the obtained mapping relationship, the distance between personnel and live equipment is monitored. Experiments conducted in a substation scenario show that the improved keypoint detection model increases AP from 0.718 to 0.771, reduces parameters from 3.09M to 2.10M, and lowers FLOPs from 8.48G to 7.01G, and the maximum distance measurement error is only 3.778%.
期刊介绍:
The scope of the Society embraces planning, research, development, design, application, construction, installation and operation of apparatus, equipment, structures, materials and systems for the safe, reliable and economic generation, transmission, distribution, conversion, measurement and control of electric energy. It includes the developing of engineering standards, the providing of information and instruction to the public and to legislators, as well as technical scientific, literary, educational and other activities that contribute to the electric power discipline or utilize the techniques or products within this discipline.