Hewei Gao , Xin Huo , Chao Zhu , Changchun He , Jiao Meng
{"title":"基于任务相似度的多阶段连续学习及其在小故障诊断中的应用","authors":"Hewei Gao , Xin Huo , Chao Zhu , Changchun He , Jiao Meng","doi":"10.1016/j.ymssp.2025.112862","DOIUrl":null,"url":null,"abstract":"<div><div>During the operation of industrial machinery, few-shot faults that are difficult to diagnose due to data scarcity and task heterogeneity are frequently encountered. Traditional deep learning methods struggle with these challenges, as they require large labeled datasets and lack adaptability to evolving fault patterns. Continual learning provides a promising solution by enabling models to learn sequentially while mitigating catastrophic forgetting. A task similarity-based continual learning (TSCL) fault diagnosis framework that incorporates feature replay and loss allocation strategies is proposed, enhancing knowledge retention and transfer across tasks in multi-phase environments. The feature replay mechanism identifies key samples from the previous phase based on feature similarity and replays them, projecting all samples into the feature space of the same probability distribution. Additionally, a loss allocation mechanism based on parameter importance is proposed that evaluates the significance of each parameter in previous phases and assigns appropriate update magnitudes, thereby enhancing the ability to retain previous task knowledge of the model. Experimental validations on four public datasets demonstrate that, in few-shot learning and multi-stage scenarios, the proposed method outperforms mainstream comparative approaches. In particular, on the excavator dataset from an industrial application, TSCL exhibits excellent stability and high accuracy in multi-phase learning, with a marked improvement in memory retention for previous tasks.</div></div>","PeriodicalId":51124,"journal":{"name":"Mechanical Systems and Signal Processing","volume":"235 ","pages":"Article 112862"},"PeriodicalIF":7.9000,"publicationDate":"2025-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Task similarity-based continual learning for multi-phase environments and its application in few-shot fault diagnosis\",\"authors\":\"Hewei Gao , Xin Huo , Chao Zhu , Changchun He , Jiao Meng\",\"doi\":\"10.1016/j.ymssp.2025.112862\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>During the operation of industrial machinery, few-shot faults that are difficult to diagnose due to data scarcity and task heterogeneity are frequently encountered. Traditional deep learning methods struggle with these challenges, as they require large labeled datasets and lack adaptability to evolving fault patterns. Continual learning provides a promising solution by enabling models to learn sequentially while mitigating catastrophic forgetting. A task similarity-based continual learning (TSCL) fault diagnosis framework that incorporates feature replay and loss allocation strategies is proposed, enhancing knowledge retention and transfer across tasks in multi-phase environments. The feature replay mechanism identifies key samples from the previous phase based on feature similarity and replays them, projecting all samples into the feature space of the same probability distribution. Additionally, a loss allocation mechanism based on parameter importance is proposed that evaluates the significance of each parameter in previous phases and assigns appropriate update magnitudes, thereby enhancing the ability to retain previous task knowledge of the model. Experimental validations on four public datasets demonstrate that, in few-shot learning and multi-stage scenarios, the proposed method outperforms mainstream comparative approaches. In particular, on the excavator dataset from an industrial application, TSCL exhibits excellent stability and high accuracy in multi-phase learning, with a marked improvement in memory retention for previous tasks.</div></div>\",\"PeriodicalId\":51124,\"journal\":{\"name\":\"Mechanical Systems and Signal Processing\",\"volume\":\"235 \",\"pages\":\"Article 112862\"},\"PeriodicalIF\":7.9000,\"publicationDate\":\"2025-06-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Mechanical Systems and Signal Processing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0888327025005631\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MECHANICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Mechanical Systems and Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0888327025005631","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MECHANICAL","Score":null,"Total":0}
Task similarity-based continual learning for multi-phase environments and its application in few-shot fault diagnosis
During the operation of industrial machinery, few-shot faults that are difficult to diagnose due to data scarcity and task heterogeneity are frequently encountered. Traditional deep learning methods struggle with these challenges, as they require large labeled datasets and lack adaptability to evolving fault patterns. Continual learning provides a promising solution by enabling models to learn sequentially while mitigating catastrophic forgetting. A task similarity-based continual learning (TSCL) fault diagnosis framework that incorporates feature replay and loss allocation strategies is proposed, enhancing knowledge retention and transfer across tasks in multi-phase environments. The feature replay mechanism identifies key samples from the previous phase based on feature similarity and replays them, projecting all samples into the feature space of the same probability distribution. Additionally, a loss allocation mechanism based on parameter importance is proposed that evaluates the significance of each parameter in previous phases and assigns appropriate update magnitudes, thereby enhancing the ability to retain previous task knowledge of the model. Experimental validations on four public datasets demonstrate that, in few-shot learning and multi-stage scenarios, the proposed method outperforms mainstream comparative approaches. In particular, on the excavator dataset from an industrial application, TSCL exhibits excellent stability and high accuracy in multi-phase learning, with a marked improvement in memory retention for previous tasks.
期刊介绍:
Journal Name: Mechanical Systems and Signal Processing (MSSP)
Interdisciplinary Focus:
Mechanical, Aerospace, and Civil Engineering
Purpose:Reporting scientific advancements of the highest quality
Arising from new techniques in sensing, instrumentation, signal processing, modelling, and control of dynamic systems