Ke Zhang;Ruiheng Zhou;Jiacun Wang;Yangjie Xiao;Xiwang Guo;Chaojun Shi
{"title":"基于无人机巡检图像的输电线路组件缺陷检测:一种自监督 HC-ViT 方法","authors":"Ke Zhang;Ruiheng Zhou;Jiacun Wang;Yangjie Xiao;Xiwang Guo;Chaojun Shi","doi":"10.1109/TSMC.2024.3386873","DOIUrl":null,"url":null,"abstract":"The unmanned aerial vehicle (UAV) patrol inspection has become an efficient method to ensure the operation condition of transmission lines. The detection of key components with defects in transmission lines is a critical task in maintaining a power system’s stability. However, the complex inspection environment and the imbalance between the number of normal component samples and that of defect samples significantly affect the detection accuracy. In this article, we present a novel method for defect detection in UAV patrol images, based on a hierarchical convolutional vision transformer (HC-ViT) and a simple contrastive masked autoencoder (SC-MAE). The HC-ViT backbone integrates the advantages of vision transformer and convolution, while the SC-MAE is a self-supervised learning method that extracts useful features from normal samples. By introducing the normal features into the backbone, we enhance the performance of the defect detection task. We demonstrate the effectiveness of our method through experiments, and show that it can leverage a large amount of unlabeled normal images, reducing the need for manual annotation. Our method offers a new way to exploit the potential features of patrol inspection images.","PeriodicalId":48915,"journal":{"name":"IEEE Transactions on Systems Man Cybernetics-Systems","volume":"54 11","pages":"6510-6521"},"PeriodicalIF":8.6000,"publicationDate":"2024-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Transmission Line Component Defect Detection Based on UAV Patrol Images: A Self-Supervised HC-ViT Method\",\"authors\":\"Ke Zhang;Ruiheng Zhou;Jiacun Wang;Yangjie Xiao;Xiwang Guo;Chaojun Shi\",\"doi\":\"10.1109/TSMC.2024.3386873\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The unmanned aerial vehicle (UAV) patrol inspection has become an efficient method to ensure the operation condition of transmission lines. The detection of key components with defects in transmission lines is a critical task in maintaining a power system’s stability. However, the complex inspection environment and the imbalance between the number of normal component samples and that of defect samples significantly affect the detection accuracy. In this article, we present a novel method for defect detection in UAV patrol images, based on a hierarchical convolutional vision transformer (HC-ViT) and a simple contrastive masked autoencoder (SC-MAE). The HC-ViT backbone integrates the advantages of vision transformer and convolution, while the SC-MAE is a self-supervised learning method that extracts useful features from normal samples. By introducing the normal features into the backbone, we enhance the performance of the defect detection task. We demonstrate the effectiveness of our method through experiments, and show that it can leverage a large amount of unlabeled normal images, reducing the need for manual annotation. Our method offers a new way to exploit the potential features of patrol inspection images.\",\"PeriodicalId\":48915,\"journal\":{\"name\":\"IEEE Transactions on Systems Man Cybernetics-Systems\",\"volume\":\"54 11\",\"pages\":\"6510-6521\"},\"PeriodicalIF\":8.6000,\"publicationDate\":\"2024-04-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Systems Man Cybernetics-Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10509861/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Systems Man Cybernetics-Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10509861/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Transmission Line Component Defect Detection Based on UAV Patrol Images: A Self-Supervised HC-ViT Method
The unmanned aerial vehicle (UAV) patrol inspection has become an efficient method to ensure the operation condition of transmission lines. The detection of key components with defects in transmission lines is a critical task in maintaining a power system’s stability. However, the complex inspection environment and the imbalance between the number of normal component samples and that of defect samples significantly affect the detection accuracy. In this article, we present a novel method for defect detection in UAV patrol images, based on a hierarchical convolutional vision transformer (HC-ViT) and a simple contrastive masked autoencoder (SC-MAE). The HC-ViT backbone integrates the advantages of vision transformer and convolution, while the SC-MAE is a self-supervised learning method that extracts useful features from normal samples. By introducing the normal features into the backbone, we enhance the performance of the defect detection task. We demonstrate the effectiveness of our method through experiments, and show that it can leverage a large amount of unlabeled normal images, reducing the need for manual annotation. Our method offers a new way to exploit the potential features of patrol inspection images.
期刊介绍:
The IEEE Transactions on Systems, Man, and Cybernetics: Systems encompasses the fields of systems engineering, covering issue formulation, analysis, and modeling throughout the systems engineering lifecycle phases. It addresses decision-making, issue interpretation, systems management, processes, and various methods such as optimization, modeling, and simulation in the development and deployment of large systems.