{"title":"Prediction model optimization of gas turbine remaining useful life based on transfer learning and simultaneous distillation pruning algorithm","authors":"Yu Zheng, Liang Chen, Xiangyu Bao, Fei Zhao, Jingshu Zhong, Chenhan Wang","doi":"10.1016/j.ress.2024.110562","DOIUrl":null,"url":null,"abstract":"<div><div>For the application of deep learning (DL) models in the field of remaining useful life (RUL) prediction and predictive maintenance (PdM) of complex equipment, the insufficient training data and large model are the two major problems. To address these issues, a model training method based on transfer learning and a simultaneous distillation pruning algorithm were proposed. By introducing prior knowledge, three transfer learning modes are devised to reduce the demand of training data. Additionally, the simultaneous distillation pruning algorithm was devised to make the model lightweight, and an iterative pruning method was adopted to trim the large neural network model. By analyzing the performance of different transfer learning modes, the effectiveness of the proposed method can be demonstrated. The number of model parameters and the performance before and after pruning were compared. The results demonstrated that, without significant alterations to the prediction performance, the proposed model exhibited the capability to markedly reduce the number of model parameters. Based on the proposed methods, the challenges of insufficient data and efficiency encountered by DL models could be effectively addressed.</div></div>","PeriodicalId":54500,"journal":{"name":"Reliability Engineering & System Safety","volume":null,"pages":null},"PeriodicalIF":9.4000,"publicationDate":"2024-10-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Reliability Engineering & System Safety","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0951832024006343","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, INDUSTRIAL","Score":null,"Total":0}
引用次数: 0
Abstract
For the application of deep learning (DL) models in the field of remaining useful life (RUL) prediction and predictive maintenance (PdM) of complex equipment, the insufficient training data and large model are the two major problems. To address these issues, a model training method based on transfer learning and a simultaneous distillation pruning algorithm were proposed. By introducing prior knowledge, three transfer learning modes are devised to reduce the demand of training data. Additionally, the simultaneous distillation pruning algorithm was devised to make the model lightweight, and an iterative pruning method was adopted to trim the large neural network model. By analyzing the performance of different transfer learning modes, the effectiveness of the proposed method can be demonstrated. The number of model parameters and the performance before and after pruning were compared. The results demonstrated that, without significant alterations to the prediction performance, the proposed model exhibited the capability to markedly reduce the number of model parameters. Based on the proposed methods, the challenges of insufficient data and efficiency encountered by DL models could be effectively addressed.
期刊介绍:
Elsevier publishes Reliability Engineering & System Safety in association with the European Safety and Reliability Association and the Safety Engineering and Risk Analysis Division. The international journal is devoted to developing and applying methods to enhance the safety and reliability of complex technological systems, like nuclear power plants, chemical plants, hazardous waste facilities, space systems, offshore and maritime systems, transportation systems, constructed infrastructure, and manufacturing plants. The journal normally publishes only articles that involve the analysis of substantive problems related to the reliability of complex systems or present techniques and/or theoretical results that have a discernable relationship to the solution of such problems. An important aim is to balance academic material and practical applications.