Mutual-learning based self-supervised knowledge distillation framework for remaining useful life prediction under variable working condition-induced domain shift scenarios
Zhuohang Chen , Jinglong Chen , Zijun Liu , Yulang Liu
{"title":"Mutual-learning based self-supervised knowledge distillation framework for remaining useful life prediction under variable working condition-induced domain shift scenarios","authors":"Zhuohang Chen , Jinglong Chen , Zijun Liu , Yulang Liu","doi":"10.1016/j.ress.2025.111359","DOIUrl":null,"url":null,"abstract":"<div><div>Domain shifts induced by variable working conditions, including both multiple steady and time-varying working conditions, result in inconsistent degradation patterns and pose significant challenges for remaining useful life (RUL) prediction. To address the above issue, we propose a self-supervised knowledge distillation framework based on mutual learning for RUL prediction under variable working conditions. The proposed framework employs a teacher-student architecture, facilitating knowledge transfer through self-supervised pseudo-labels. A mutual learning-based training strategy is developed to prevent over-adaptation to the source domain and promote domain generalization. Additionally, during student model training, a feature-level domain adversarial training strategy is implemented to improve cross-domain feature decoupling and ensure the learning of domain-invariant features. The above two components complement each other: adversarial learning aligns marginal distributions (variable working conditions), while pseudo-label learning refines conditional alignment (normal and fast degradation stages), allowing the model to adapt more effectively to complex degradation scenarios. Furthermore, we incorporate a sparse attention mechanism for efficient feature extraction, significantly reducing computational complexity while maintaining robust performance. The RUL prediction experiments under multi steady conditions and time-varying conditions are carried out on two life-cycle bearing datasets respectively. Comparative results demonstrate the superiority and practicality of our proposed method.</div></div>","PeriodicalId":54500,"journal":{"name":"Reliability Engineering & System Safety","volume":"264 ","pages":"Article 111359"},"PeriodicalIF":11.0000,"publicationDate":"2025-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Reliability Engineering & System Safety","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0951832025005605","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, INDUSTRIAL","Score":null,"Total":0}
引用次数: 0
Abstract
Domain shifts induced by variable working conditions, including both multiple steady and time-varying working conditions, result in inconsistent degradation patterns and pose significant challenges for remaining useful life (RUL) prediction. To address the above issue, we propose a self-supervised knowledge distillation framework based on mutual learning for RUL prediction under variable working conditions. The proposed framework employs a teacher-student architecture, facilitating knowledge transfer through self-supervised pseudo-labels. A mutual learning-based training strategy is developed to prevent over-adaptation to the source domain and promote domain generalization. Additionally, during student model training, a feature-level domain adversarial training strategy is implemented to improve cross-domain feature decoupling and ensure the learning of domain-invariant features. The above two components complement each other: adversarial learning aligns marginal distributions (variable working conditions), while pseudo-label learning refines conditional alignment (normal and fast degradation stages), allowing the model to adapt more effectively to complex degradation scenarios. Furthermore, we incorporate a sparse attention mechanism for efficient feature extraction, significantly reducing computational complexity while maintaining robust performance. The RUL prediction experiments under multi steady conditions and time-varying conditions are carried out on two life-cycle bearing datasets respectively. Comparative results demonstrate the superiority and practicality of our proposed method.
期刊介绍:
Elsevier publishes Reliability Engineering & System Safety in association with the European Safety and Reliability Association and the Safety Engineering and Risk Analysis Division. The international journal is devoted to developing and applying methods to enhance the safety and reliability of complex technological systems, like nuclear power plants, chemical plants, hazardous waste facilities, space systems, offshore and maritime systems, transportation systems, constructed infrastructure, and manufacturing plants. The journal normally publishes only articles that involve the analysis of substantive problems related to the reliability of complex systems or present techniques and/or theoretical results that have a discernable relationship to the solution of such problems. An important aim is to balance academic material and practical applications.