Yixiang Huang , Kaiwen Zhang , Pengcheng Xia , Zhilin Wang , Yanming Li , Chengliang Liu
{"title":"跨注意子域适应与选择性知识提炼,用于多变工作条件下的电机故障诊断","authors":"Yixiang Huang , Kaiwen Zhang , Pengcheng Xia , Zhilin Wang , Yanming Li , Chengliang Liu","doi":"10.1016/j.aei.2024.102948","DOIUrl":null,"url":null,"abstract":"<div><div>Motor fault diagnosis under variable working conditions is an open challenge for practical application. Domain adaptation has been explored for reducing feature distribution discrepancy across working conditions. However, existing methods overlook the relations and the domain-related features among individual sample pairs across different domains, and the quality of pseudo labels significantly limits the subdomain adaptation performance. To tackle these limitations, a cross-attentional subdomain adaptation (CroAttSA) method with clustering-based selective knowledge distillation for motor fault diagnosis under variable working conditions is proposed. A triple-branch transformer with self-attention and cross-domain-attention is designed for domain-specific and domain-correlated feature extraction. Additionally, a correlated local maximum mean discrepancy (CLMMD) loss is introduced for more fine-grained and fault-related subdomain adaptation. A clustering-based selective knowledge distillation strategy is also proposed to improve the quality of the pseudo labels for enhanced model performance. Extensive experiments on motor fault diagnosis under variable loads and rotating speeds are conducted, and the comparison and ablation study results have verified the model effectiveness.</div></div>","PeriodicalId":50941,"journal":{"name":"Advanced Engineering Informatics","volume":"62 ","pages":"Article 102948"},"PeriodicalIF":8.0000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Cross-attentional subdomain adaptation with selective knowledge distillation for motor fault diagnosis under variable working conditions\",\"authors\":\"Yixiang Huang , Kaiwen Zhang , Pengcheng Xia , Zhilin Wang , Yanming Li , Chengliang Liu\",\"doi\":\"10.1016/j.aei.2024.102948\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Motor fault diagnosis under variable working conditions is an open challenge for practical application. Domain adaptation has been explored for reducing feature distribution discrepancy across working conditions. However, existing methods overlook the relations and the domain-related features among individual sample pairs across different domains, and the quality of pseudo labels significantly limits the subdomain adaptation performance. To tackle these limitations, a cross-attentional subdomain adaptation (CroAttSA) method with clustering-based selective knowledge distillation for motor fault diagnosis under variable working conditions is proposed. A triple-branch transformer with self-attention and cross-domain-attention is designed for domain-specific and domain-correlated feature extraction. Additionally, a correlated local maximum mean discrepancy (CLMMD) loss is introduced for more fine-grained and fault-related subdomain adaptation. A clustering-based selective knowledge distillation strategy is also proposed to improve the quality of the pseudo labels for enhanced model performance. Extensive experiments on motor fault diagnosis under variable loads and rotating speeds are conducted, and the comparison and ablation study results have verified the model effectiveness.</div></div>\",\"PeriodicalId\":50941,\"journal\":{\"name\":\"Advanced Engineering Informatics\",\"volume\":\"62 \",\"pages\":\"Article 102948\"},\"PeriodicalIF\":8.0000,\"publicationDate\":\"2024-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Advanced Engineering Informatics\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1474034624005998\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Engineering Informatics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1474034624005998","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Cross-attentional subdomain adaptation with selective knowledge distillation for motor fault diagnosis under variable working conditions
Motor fault diagnosis under variable working conditions is an open challenge for practical application. Domain adaptation has been explored for reducing feature distribution discrepancy across working conditions. However, existing methods overlook the relations and the domain-related features among individual sample pairs across different domains, and the quality of pseudo labels significantly limits the subdomain adaptation performance. To tackle these limitations, a cross-attentional subdomain adaptation (CroAttSA) method with clustering-based selective knowledge distillation for motor fault diagnosis under variable working conditions is proposed. A triple-branch transformer with self-attention and cross-domain-attention is designed for domain-specific and domain-correlated feature extraction. Additionally, a correlated local maximum mean discrepancy (CLMMD) loss is introduced for more fine-grained and fault-related subdomain adaptation. A clustering-based selective knowledge distillation strategy is also proposed to improve the quality of the pseudo labels for enhanced model performance. Extensive experiments on motor fault diagnosis under variable loads and rotating speeds are conducted, and the comparison and ablation study results have verified the model effectiveness.
期刊介绍:
Advanced Engineering Informatics is an international Journal that solicits research papers with an emphasis on 'knowledge' and 'engineering applications'. The Journal seeks original papers that report progress in applying methods of engineering informatics. These papers should have engineering relevance and help provide a scientific base for more reliable, spontaneous, and creative engineering decision-making. Additionally, papers should demonstrate the science of supporting knowledge-intensive engineering tasks and validate the generality, power, and scalability of new methods through rigorous evaluation, preferably both qualitatively and quantitatively. Abstracting and indexing for Advanced Engineering Informatics include Science Citation Index Expanded, Scopus and INSPEC.