Diffusion Model and Vision Transformer for Intelligent Fault Diagnosis under Small Samples

Abstract

The existing deep learning models can achieve a high level of fault diagnosis accuracy in the case of a large number of samples. However, in actual production, data is often limited due to the difficulty of data collection and labeling. For small sample fault diagnosis, a fault diagnosis method called Diffusion Model-Overlapping-Patch Vision Transformer (DM-OVT) is proposed in this paper. The method adds Coordinate Attention (CA) to the diffusion model, so that it can consider both channel information and spatial information. In the patch embedding part of Vision Transformer (ViT), features are first extracted using convolutional layers, and then overlapping patch divisions are used to improve the correlation between each patch. To be specific, DM-OVT first uses short-time Fourier transform (STFT) to convert the one-dimensional signals into the time-frequency maps. And then inputs them into the diffusion model (DM) to generate different classes of fault data according to labels. Finally, Overlapping-Patch Vision Transformer (OVT) is used to classify the expanded data. The effectiveness of the proposed method was tested on data sets from laboratory multistage centrifugal fans and Case Western Reserve University, and the highest accuracy was achieved in the comparison experiments.