{"title":"Multimodal fusion fault diagnosis method under noise interference","authors":"Zhi Qiu , Shanfei Fan , Haibo Liang, Jincai Liu","doi":"10.1016/j.apacoust.2024.110301","DOIUrl":null,"url":null,"abstract":"<div><div>In practical industrial production environments, the collection of fault signals is often accompanied by significant background noise. The presence of substantial noise makes feature extraction from fault signals very challenging, thereby reducing fault diagnosis performance. To address this issue, this paper proposes a multimodal fusion fault diagnosis method based on a multiscale stacked denoising autoencoder and dual-branch feature fusion network (MSSDAE-DBFFN). First, the noisy vibration signals are denoised using the MSSDAE. Then, the denoised vibration signals are divided into two branches for feature extraction and fusion. In one branch, the vibration signals are converted into gramian angular summation field (GASF) images using the GASF, and feature extraction is performed with a multiscale convolutional network. In the other branch, the waveforms are subjected to feature extraction using a wavelet scattering network. Finally, the fused features are sent to a classifier to complete the fault diagnosis task. To demonstrate the effectiveness of the proposed method, it is compared with four different denoising methods and five different classification methods across two datasets. The experimental results show that MSSDAE-DBFFN outperforms the other methods in both denoising and classification across five different signal-to-noise ratios (SNR). At an SNR of −10 dB, the SNRs after denoising are 4.582 dB and 5.489 dB, respectively, while the accuracy rates are 89.33 % and 91.67 %, respectively.</div></div>","PeriodicalId":55506,"journal":{"name":"Applied Acoustics","volume":null,"pages":null},"PeriodicalIF":3.4000,"publicationDate":"2024-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Acoustics","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0003682X24004523","RegionNum":2,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ACOUSTICS","Score":null,"Total":0}
引用次数: 0
Abstract
In practical industrial production environments, the collection of fault signals is often accompanied by significant background noise. The presence of substantial noise makes feature extraction from fault signals very challenging, thereby reducing fault diagnosis performance. To address this issue, this paper proposes a multimodal fusion fault diagnosis method based on a multiscale stacked denoising autoencoder and dual-branch feature fusion network (MSSDAE-DBFFN). First, the noisy vibration signals are denoised using the MSSDAE. Then, the denoised vibration signals are divided into two branches for feature extraction and fusion. In one branch, the vibration signals are converted into gramian angular summation field (GASF) images using the GASF, and feature extraction is performed with a multiscale convolutional network. In the other branch, the waveforms are subjected to feature extraction using a wavelet scattering network. Finally, the fused features are sent to a classifier to complete the fault diagnosis task. To demonstrate the effectiveness of the proposed method, it is compared with four different denoising methods and five different classification methods across two datasets. The experimental results show that MSSDAE-DBFFN outperforms the other methods in both denoising and classification across five different signal-to-noise ratios (SNR). At an SNR of −10 dB, the SNRs after denoising are 4.582 dB and 5.489 dB, respectively, while the accuracy rates are 89.33 % and 91.67 %, respectively.
期刊介绍:
Since its launch in 1968, Applied Acoustics has been publishing high quality research papers providing state-of-the-art coverage of research findings for engineers and scientists involved in applications of acoustics in the widest sense.
Applied Acoustics looks not only at recent developments in the understanding of acoustics but also at ways of exploiting that understanding. The Journal aims to encourage the exchange of practical experience through publication and in so doing creates a fund of technological information that can be used for solving related problems. The presentation of information in graphical or tabular form is especially encouraged. If a report of a mathematical development is a necessary part of a paper it is important to ensure that it is there only as an integral part of a practical solution to a problem and is supported by data. Applied Acoustics encourages the exchange of practical experience in the following ways: • Complete Papers • Short Technical Notes • Review Articles; and thereby provides a wealth of technological information that can be used to solve related problems.
Manuscripts that address all fields of applications of acoustics ranging from medicine and NDT to the environment and buildings are welcome.