基于迁移学习和同步蒸馏剪枝算法的燃气轮机剩余使用寿命预测模型优化

IF 9.4 1区 工程技术 Q1 ENGINEERING, INDUSTRIAL
Yu Zheng, Liang Chen, Xiangyu Bao, Fei Zhao, Jingshu Zhong, Chenhan Wang
{"title":"基于迁移学习和同步蒸馏剪枝算法的燃气轮机剩余使用寿命预测模型优化","authors":"Yu Zheng,&nbsp;Liang Chen,&nbsp;Xiangyu Bao,&nbsp;Fei Zhao,&nbsp;Jingshu Zhong,&nbsp;Chenhan Wang","doi":"10.1016/j.ress.2024.110562","DOIUrl":null,"url":null,"abstract":"<div><div>For the application of deep learning (DL) models in the field of remaining useful life (RUL) prediction and predictive maintenance (PdM) of complex equipment, the insufficient training data and large model are the two major problems. To address these issues, a model training method based on transfer learning and a simultaneous distillation pruning algorithm were proposed. By introducing prior knowledge, three transfer learning modes are devised to reduce the demand of training data. Additionally, the simultaneous distillation pruning algorithm was devised to make the model lightweight, and an iterative pruning method was adopted to trim the large neural network model. By analyzing the performance of different transfer learning modes, the effectiveness of the proposed method can be demonstrated. The number of model parameters and the performance before and after pruning were compared. The results demonstrated that, without significant alterations to the prediction performance, the proposed model exhibited the capability to markedly reduce the number of model parameters. Based on the proposed methods, the challenges of insufficient data and efficiency encountered by DL models could be effectively addressed.</div></div>","PeriodicalId":54500,"journal":{"name":"Reliability Engineering & System Safety","volume":"253 ","pages":"Article 110562"},"PeriodicalIF":9.4000,"publicationDate":"2024-10-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Prediction model optimization of gas turbine remaining useful life based on transfer learning and simultaneous distillation pruning algorithm\",\"authors\":\"Yu Zheng,&nbsp;Liang Chen,&nbsp;Xiangyu Bao,&nbsp;Fei Zhao,&nbsp;Jingshu Zhong,&nbsp;Chenhan Wang\",\"doi\":\"10.1016/j.ress.2024.110562\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>For the application of deep learning (DL) models in the field of remaining useful life (RUL) prediction and predictive maintenance (PdM) of complex equipment, the insufficient training data and large model are the two major problems. To address these issues, a model training method based on transfer learning and a simultaneous distillation pruning algorithm were proposed. By introducing prior knowledge, three transfer learning modes are devised to reduce the demand of training data. Additionally, the simultaneous distillation pruning algorithm was devised to make the model lightweight, and an iterative pruning method was adopted to trim the large neural network model. By analyzing the performance of different transfer learning modes, the effectiveness of the proposed method can be demonstrated. The number of model parameters and the performance before and after pruning were compared. The results demonstrated that, without significant alterations to the prediction performance, the proposed model exhibited the capability to markedly reduce the number of model parameters. Based on the proposed methods, the challenges of insufficient data and efficiency encountered by DL models could be effectively addressed.</div></div>\",\"PeriodicalId\":54500,\"journal\":{\"name\":\"Reliability Engineering & System Safety\",\"volume\":\"253 \",\"pages\":\"Article 110562\"},\"PeriodicalIF\":9.4000,\"publicationDate\":\"2024-10-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Reliability Engineering & System Safety\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0951832024006343\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, INDUSTRIAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Reliability Engineering & System Safety","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0951832024006343","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, INDUSTRIAL","Score":null,"Total":0}
引用次数: 0

摘要

对于深度学习(DL)模型在复杂设备剩余使用寿命(RUL)预测和预测性维护(PdM)领域的应用,训练数据不足和模型庞大是两个主要问题。针对这些问题,提出了一种基于迁移学习的模型训练方法和同步蒸馏剪枝算法。通过引入先验知识,设计了三种迁移学习模式,以减少对训练数据的需求。此外,还设计了同步蒸馏剪枝算法使模型轻量化,并采用迭代剪枝方法修剪大型神经网络模型。通过分析不同迁移学习模式的性能,可以证明所提方法的有效性。比较了剪枝前后的模型参数数量和性能。结果表明,在不明显改变预测性能的情况下,所提出的模型具有明显减少模型参数数量的能力。基于所提出的方法,可以有效解决 DL 模型所遇到的数据不足和效率问题。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Prediction model optimization of gas turbine remaining useful life based on transfer learning and simultaneous distillation pruning algorithm
For the application of deep learning (DL) models in the field of remaining useful life (RUL) prediction and predictive maintenance (PdM) of complex equipment, the insufficient training data and large model are the two major problems. To address these issues, a model training method based on transfer learning and a simultaneous distillation pruning algorithm were proposed. By introducing prior knowledge, three transfer learning modes are devised to reduce the demand of training data. Additionally, the simultaneous distillation pruning algorithm was devised to make the model lightweight, and an iterative pruning method was adopted to trim the large neural network model. By analyzing the performance of different transfer learning modes, the effectiveness of the proposed method can be demonstrated. The number of model parameters and the performance before and after pruning were compared. The results demonstrated that, without significant alterations to the prediction performance, the proposed model exhibited the capability to markedly reduce the number of model parameters. Based on the proposed methods, the challenges of insufficient data and efficiency encountered by DL models could be effectively addressed.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Reliability Engineering & System Safety
Reliability Engineering & System Safety 管理科学-工程:工业
CiteScore
15.20
自引率
39.50%
发文量
621
审稿时长
67 days
期刊介绍: Elsevier publishes Reliability Engineering & System Safety in association with the European Safety and Reliability Association and the Safety Engineering and Risk Analysis Division. The international journal is devoted to developing and applying methods to enhance the safety and reliability of complex technological systems, like nuclear power plants, chemical plants, hazardous waste facilities, space systems, offshore and maritime systems, transportation systems, constructed infrastructure, and manufacturing plants. The journal normally publishes only articles that involve the analysis of substantive problems related to the reliability of complex systems or present techniques and/or theoretical results that have a discernable relationship to the solution of such problems. An important aim is to balance academic material and practical applications.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信