Cross-attentional subdomain adaptation with selective knowledge distillation for motor fault diagnosis under variable working conditions

Abstract

Motor fault diagnosis under variable working conditions is an open challenge for practical application. Domain adaptation has been explored for reducing feature distribution discrepancy across working conditions. However, existing methods overlook the relations and the domain-related features among individual sample pairs across different domains, and the quality of pseudo labels significantly limits the subdomain adaptation performance. To tackle these limitations, a cross-attentional subdomain adaptation (CroAttSA) method with clustering-based selective knowledge distillation for motor fault diagnosis under variable working conditions is proposed. A triple-branch transformer with self-attention and cross-domain-attention is designed for domain-specific and domain-correlated feature extraction. Additionally, a correlated local maximum mean discrepancy (CLMMD) loss is introduced for more fine-grained and fault-related subdomain adaptation. A clustering-based selective knowledge distillation strategy is also proposed to improve the quality of the pseudo labels for enhanced model performance. Extensive experiments on motor fault diagnosis under variable loads and rotating speeds are conducted, and the comparison and ablation study results have verified the model effectiveness.