{"title":"基于小波辅助叠加图像融合和双分支CNN的多故障诊断","authors":"Rismaya Kumar Mishra , Anurag Choudhary , S. Fatima , A.R. Mohanty , B.K. Panigrahi","doi":"10.1016/j.asoc.2025.113183","DOIUrl":null,"url":null,"abstract":"<div><div>The rotating machine components are interconnected. If the machines are not monitored properly, it causes damage to the connected parts, causing catastrophic failure. Dependability on a single sensor or sensors of the same modality for multi-fault diagnosis influences decision-making. Therefore, multi-modality multi-sensor fusion has been used to gather distinct information. This work proposes a Wavelet Assisted Stacked Image Fusion (WASIF) with Dual Branch Convolutional Neural Network (DBCNN) to effectively diagnose multi-faults. At first, various multi-fault conditions in a test rig are introduced, which consist of conditions like faulty motor, faulty bearing, mechanical unbalance, shaft misalignment and their combinations. Thereafter, vibration and acoustic data are acquired at a varying speed condition. The acquired signatures are pre-processed and converted into time-frequency spectrums using Fourier Synchrosqueezed Transform (FSST). The vibration and acoustic spectrums are fused into vibro-acoustic spectrums using the WASIF technique. The generated spectrums are used for DBCNN training for multi-fault classification, and 98.8 % overall classification accuracy is achieved. In this paper, a separate ablation experiment is done along with a published literature comparison to justify the effectiveness of the selected parameters. The proposed fusion-based multi-fault diagnosis strategy would be helpful to the industries for incipient fault detection, inventory management and workforce allocation.</div></div>","PeriodicalId":50737,"journal":{"name":"Applied Soft Computing","volume":"176 ","pages":"Article 113183"},"PeriodicalIF":7.2000,"publicationDate":"2025-04-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Multi-fault diagnosis with wavelet assisted stacked image fusion and dual branch CNN\",\"authors\":\"Rismaya Kumar Mishra , Anurag Choudhary , S. Fatima , A.R. Mohanty , B.K. Panigrahi\",\"doi\":\"10.1016/j.asoc.2025.113183\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The rotating machine components are interconnected. If the machines are not monitored properly, it causes damage to the connected parts, causing catastrophic failure. Dependability on a single sensor or sensors of the same modality for multi-fault diagnosis influences decision-making. Therefore, multi-modality multi-sensor fusion has been used to gather distinct information. This work proposes a Wavelet Assisted Stacked Image Fusion (WASIF) with Dual Branch Convolutional Neural Network (DBCNN) to effectively diagnose multi-faults. At first, various multi-fault conditions in a test rig are introduced, which consist of conditions like faulty motor, faulty bearing, mechanical unbalance, shaft misalignment and their combinations. Thereafter, vibration and acoustic data are acquired at a varying speed condition. The acquired signatures are pre-processed and converted into time-frequency spectrums using Fourier Synchrosqueezed Transform (FSST). The vibration and acoustic spectrums are fused into vibro-acoustic spectrums using the WASIF technique. The generated spectrums are used for DBCNN training for multi-fault classification, and 98.8 % overall classification accuracy is achieved. In this paper, a separate ablation experiment is done along with a published literature comparison to justify the effectiveness of the selected parameters. The proposed fusion-based multi-fault diagnosis strategy would be helpful to the industries for incipient fault detection, inventory management and workforce allocation.</div></div>\",\"PeriodicalId\":50737,\"journal\":{\"name\":\"Applied Soft Computing\",\"volume\":\"176 \",\"pages\":\"Article 113183\"},\"PeriodicalIF\":7.2000,\"publicationDate\":\"2025-04-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Soft Computing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1568494625004946\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Soft Computing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1568494625004946","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Multi-fault diagnosis with wavelet assisted stacked image fusion and dual branch CNN
The rotating machine components are interconnected. If the machines are not monitored properly, it causes damage to the connected parts, causing catastrophic failure. Dependability on a single sensor or sensors of the same modality for multi-fault diagnosis influences decision-making. Therefore, multi-modality multi-sensor fusion has been used to gather distinct information. This work proposes a Wavelet Assisted Stacked Image Fusion (WASIF) with Dual Branch Convolutional Neural Network (DBCNN) to effectively diagnose multi-faults. At first, various multi-fault conditions in a test rig are introduced, which consist of conditions like faulty motor, faulty bearing, mechanical unbalance, shaft misalignment and their combinations. Thereafter, vibration and acoustic data are acquired at a varying speed condition. The acquired signatures are pre-processed and converted into time-frequency spectrums using Fourier Synchrosqueezed Transform (FSST). The vibration and acoustic spectrums are fused into vibro-acoustic spectrums using the WASIF technique. The generated spectrums are used for DBCNN training for multi-fault classification, and 98.8 % overall classification accuracy is achieved. In this paper, a separate ablation experiment is done along with a published literature comparison to justify the effectiveness of the selected parameters. The proposed fusion-based multi-fault diagnosis strategy would be helpful to the industries for incipient fault detection, inventory management and workforce allocation.
期刊介绍:
Applied Soft Computing is an international journal promoting an integrated view of soft computing to solve real life problems.The focus is to publish the highest quality research in application and convergence of the areas of Fuzzy Logic, Neural Networks, Evolutionary Computing, Rough Sets and other similar techniques to address real world complexities.
Applied Soft Computing is a rolling publication: articles are published as soon as the editor-in-chief has accepted them. Therefore, the web site will continuously be updated with new articles and the publication time will be short.