{"title":"SFDA-T: A novel source-free domain adaptation method with strong generalization ability for fault diagnosis","authors":"Jie Wang , Haidong Shao , Yiming Xiao , Bin Liu","doi":"10.1016/j.aei.2024.102903","DOIUrl":null,"url":null,"abstract":"<div><div>Currently, source free domain adaptation (SFDA) methods are employed to address the issue of inaccessible source domain data (SDD) in transfer learning. However, existing SFDA methods often suffer from overfitting to specific domains, leading to poor generalization ability in the target domain. To address these challenges, this paper proposes a novel SFDA method named SFDA-T for fault diagnosis. Specifically, a Transformer-CNN-based feature extractor is constructed, to mine the transferable feature knowledge of faults in the SDD. The approach reduces the overfitting of the model to domain-specific information and improves model’s generalization ability. In addition, the feature attention loss is designed to calculate attention weights of the sample features to increase the model’s attention to the crucial feature regions in the target domain. A source similarity guided exponential loss is developed to guide target samples based on the decision boundaries of the source domain, facilitating cluster alignment of target sample categories and expanding distances between different categories. Furthermore, a self-training pseudo-labeling constraint is employed to reduce the effect of incorrect label matching and further constrain the model. The results of the experiments on gearboxes and bearings indicate that the proposed method achieves high fault diagnosis accuracy while effectively decoupling from SDD.</div></div>","PeriodicalId":50941,"journal":{"name":"Advanced Engineering Informatics","volume":"62 ","pages":"Article 102903"},"PeriodicalIF":8.0000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Engineering Informatics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1474034624005548","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Currently, source free domain adaptation (SFDA) methods are employed to address the issue of inaccessible source domain data (SDD) in transfer learning. However, existing SFDA methods often suffer from overfitting to specific domains, leading to poor generalization ability in the target domain. To address these challenges, this paper proposes a novel SFDA method named SFDA-T for fault diagnosis. Specifically, a Transformer-CNN-based feature extractor is constructed, to mine the transferable feature knowledge of faults in the SDD. The approach reduces the overfitting of the model to domain-specific information and improves model’s generalization ability. In addition, the feature attention loss is designed to calculate attention weights of the sample features to increase the model’s attention to the crucial feature regions in the target domain. A source similarity guided exponential loss is developed to guide target samples based on the decision boundaries of the source domain, facilitating cluster alignment of target sample categories and expanding distances between different categories. Furthermore, a self-training pseudo-labeling constraint is employed to reduce the effect of incorrect label matching and further constrain the model. The results of the experiments on gearboxes and bearings indicate that the proposed method achieves high fault diagnosis accuracy while effectively decoupling from SDD.
期刊介绍:
Advanced Engineering Informatics is an international Journal that solicits research papers with an emphasis on 'knowledge' and 'engineering applications'. The Journal seeks original papers that report progress in applying methods of engineering informatics. These papers should have engineering relevance and help provide a scientific base for more reliable, spontaneous, and creative engineering decision-making. Additionally, papers should demonstrate the science of supporting knowledge-intensive engineering tasks and validate the generality, power, and scalability of new methods through rigorous evaluation, preferably both qualitatively and quantitatively. Abstracting and indexing for Advanced Engineering Informatics include Science Citation Index Expanded, Scopus and INSPEC.