Hang Liu, Ben Niu, Zhijian Liu, Ming Li, Zhiyu Shi
{"title":"基于三级轻量级残差神经网络的变压器故障诊断方法","authors":"Hang Liu, Ben Niu, Zhijian Liu, Ming Li, Zhiyu Shi","doi":"10.1016/j.epsr.2024.111142","DOIUrl":null,"url":null,"abstract":"<div><div>The fault diagnosis method for dissolved gas in transformer oil based on deep learning has the problems of complex structure, over-parameterization, and high resolution in practical application. This paper presents a three-stage lightweight residual neural network method for transformer fault diagnosis. In the first stage, based on the 50-layer residual networks, the residual block is enhanced using the inverted bottleneck idea, and the Swish activation function and a simple, parameter-free attention module are incorporated to optimize the model structure and performance. In the second stage, an adaptive channel pruning method is proposed, selectively eliminating redundant filters and channels based on the fault data complexity during the training process, thereby realizing network lightweight. In the third stage, a quantization-aware method is introduced, which converts all 32-bit floating point parameters in the network to 8-bit integers, reduces the bit width of each parameter, and accomplishes a reduction in parameter size. The experimental results for the transformer oil dissolved gas fault dataset indicate that the three-stage lightweight model, sizing at 2.20 MB—only 1.51 % of the original—achieves a fault diagnosis accuracy of 97.64 %, 1.49 % higher than the original, achieving a well-balanced between accuracy and complexity.</div></div>","PeriodicalId":50547,"journal":{"name":"Electric Power Systems Research","volume":"238 ","pages":"Article 111142"},"PeriodicalIF":3.3000,"publicationDate":"2024-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Transformer fault diagnosis method based on the three-stage lightweight residual neural network\",\"authors\":\"Hang Liu, Ben Niu, Zhijian Liu, Ming Li, Zhiyu Shi\",\"doi\":\"10.1016/j.epsr.2024.111142\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The fault diagnosis method for dissolved gas in transformer oil based on deep learning has the problems of complex structure, over-parameterization, and high resolution in practical application. This paper presents a three-stage lightweight residual neural network method for transformer fault diagnosis. In the first stage, based on the 50-layer residual networks, the residual block is enhanced using the inverted bottleneck idea, and the Swish activation function and a simple, parameter-free attention module are incorporated to optimize the model structure and performance. In the second stage, an adaptive channel pruning method is proposed, selectively eliminating redundant filters and channels based on the fault data complexity during the training process, thereby realizing network lightweight. In the third stage, a quantization-aware method is introduced, which converts all 32-bit floating point parameters in the network to 8-bit integers, reduces the bit width of each parameter, and accomplishes a reduction in parameter size. The experimental results for the transformer oil dissolved gas fault dataset indicate that the three-stage lightweight model, sizing at 2.20 MB—only 1.51 % of the original—achieves a fault diagnosis accuracy of 97.64 %, 1.49 % higher than the original, achieving a well-balanced between accuracy and complexity.</div></div>\",\"PeriodicalId\":50547,\"journal\":{\"name\":\"Electric Power Systems Research\",\"volume\":\"238 \",\"pages\":\"Article 111142\"},\"PeriodicalIF\":3.3000,\"publicationDate\":\"2024-10-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Electric Power Systems Research\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0378779624010289\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Electric Power Systems Research","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0378779624010289","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Transformer fault diagnosis method based on the three-stage lightweight residual neural network
The fault diagnosis method for dissolved gas in transformer oil based on deep learning has the problems of complex structure, over-parameterization, and high resolution in practical application. This paper presents a three-stage lightweight residual neural network method for transformer fault diagnosis. In the first stage, based on the 50-layer residual networks, the residual block is enhanced using the inverted bottleneck idea, and the Swish activation function and a simple, parameter-free attention module are incorporated to optimize the model structure and performance. In the second stage, an adaptive channel pruning method is proposed, selectively eliminating redundant filters and channels based on the fault data complexity during the training process, thereby realizing network lightweight. In the third stage, a quantization-aware method is introduced, which converts all 32-bit floating point parameters in the network to 8-bit integers, reduces the bit width of each parameter, and accomplishes a reduction in parameter size. The experimental results for the transformer oil dissolved gas fault dataset indicate that the three-stage lightweight model, sizing at 2.20 MB—only 1.51 % of the original—achieves a fault diagnosis accuracy of 97.64 %, 1.49 % higher than the original, achieving a well-balanced between accuracy and complexity.
期刊介绍:
Electric Power Systems Research is an international medium for the publication of original papers concerned with the generation, transmission, distribution and utilization of electrical energy. The journal aims at presenting important results of work in this field, whether in the form of applied research, development of new procedures or components, orginal application of existing knowledge or new designapproaches. The scope of Electric Power Systems Research is broad, encompassing all aspects of electric power systems. The following list of topics is not intended to be exhaustive, but rather to indicate topics that fall within the journal purview.
• Generation techniques ranging from advances in conventional electromechanical methods, through nuclear power generation, to renewable energy generation.
• Transmission, spanning the broad area from UHV (ac and dc) to network operation and protection, line routing and design.
• Substation work: equipment design, protection and control systems.
• Distribution techniques, equipment development, and smart grids.
• The utilization area from energy efficiency to distributed load levelling techniques.
• Systems studies including control techniques, planning, optimization methods, stability, security assessment and insulation coordination.