A novel sparse-aware contrastive learning network with adaptive gating neurons for extreme class imbalance diagnosis scenarios

IF 7.9 1区 工程技术 Q1 ENGINEERING, MECHANICAL
Panpan Guo , Weiguo Huang , Chuancang Ding , Juanjuan Shi , Zhongkui Zhu
{"title":"A novel sparse-aware contrastive learning network with adaptive gating neurons for extreme class imbalance diagnosis scenarios","authors":"Panpan Guo ,&nbsp;Weiguo Huang ,&nbsp;Chuancang Ding ,&nbsp;Juanjuan Shi ,&nbsp;Zhongkui Zhu","doi":"10.1016/j.ymssp.2025.112895","DOIUrl":null,"url":null,"abstract":"<div><div>The intelligent diagnosis model can exhibit excellent diagnostic performance with sufficient training samples and under ideal conditions. However, in engineering environments, it is difficult to obtain balanced fault samples from equipment, and the interference from noise components in signals makes it challenging for deep learning models to extract fault features, posing significant challenges for intelligent diagnosis. To address these issues, this paper proposes a novel sparse perception contrastive learning network with adaptive gating neurons for extreme class imbalance diagnosis scenarios. Specifically, we first propose an adaptive gating neurons residual network, derive and establish a mathematical relationship between the adaptive gating neuron and learnable weighted autocorrelation functions, demonstrating the model’s ability to extract relevant features from vibration signals and perform adaptive noise reduction. Building upon this, we propose a Sparse Perception Cross-entropy Loss (SPCL) function, which focuses on tail-class fault samples that are difficult to cluster based on class sparsity in the feature space. Furthermore, to further enhance the diagnostic performance of the contrastive learning model in class-imbalanced bearing faults, we propose a Center Contrastive Loss (CCL) function. CCL calculates the centers of each class using classifier weights optimized by SPCL function, ensuring that all fault classes are represented in each mini-batch during learning, thereby enabling effective contrastive learning. The efficacy of the introduced methodologies is confirmed through experimental outcomes obtained from both publicly accessible and proprietary datasets. Experimental results demonstrate that our proposed method significantly outperforms other methods in the intelligent diagnosis of bearing faults in scenarios with extreme class imbalance.</div></div>","PeriodicalId":51124,"journal":{"name":"Mechanical Systems and Signal Processing","volume":"235 ","pages":"Article 112895"},"PeriodicalIF":7.9000,"publicationDate":"2025-06-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Mechanical Systems and Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0888327025005965","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MECHANICAL","Score":null,"Total":0}
引用次数: 0

Abstract

The intelligent diagnosis model can exhibit excellent diagnostic performance with sufficient training samples and under ideal conditions. However, in engineering environments, it is difficult to obtain balanced fault samples from equipment, and the interference from noise components in signals makes it challenging for deep learning models to extract fault features, posing significant challenges for intelligent diagnosis. To address these issues, this paper proposes a novel sparse perception contrastive learning network with adaptive gating neurons for extreme class imbalance diagnosis scenarios. Specifically, we first propose an adaptive gating neurons residual network, derive and establish a mathematical relationship between the adaptive gating neuron and learnable weighted autocorrelation functions, demonstrating the model’s ability to extract relevant features from vibration signals and perform adaptive noise reduction. Building upon this, we propose a Sparse Perception Cross-entropy Loss (SPCL) function, which focuses on tail-class fault samples that are difficult to cluster based on class sparsity in the feature space. Furthermore, to further enhance the diagnostic performance of the contrastive learning model in class-imbalanced bearing faults, we propose a Center Contrastive Loss (CCL) function. CCL calculates the centers of each class using classifier weights optimized by SPCL function, ensuring that all fault classes are represented in each mini-batch during learning, thereby enabling effective contrastive learning. The efficacy of the introduced methodologies is confirmed through experimental outcomes obtained from both publicly accessible and proprietary datasets. Experimental results demonstrate that our proposed method significantly outperforms other methods in the intelligent diagnosis of bearing faults in scenarios with extreme class imbalance.
基于自适应门控神经元的稀疏感知对比学习网络
在训练样本充足、条件理想的情况下,该智能诊断模型能够表现出优异的诊断性能。然而,在工程环境中,很难从设备中获得平衡的故障样本,并且信号中噪声成分的干扰给深度学习模型提取故障特征带来了挑战,给智能诊断带来了重大挑战。为了解决这些问题,本文提出了一种新的带有自适应门控神经元的稀疏感知对比学习网络,用于极端类失衡诊断场景。具体而言,我们首先提出了一个自适应门控神经元残差网络,推导并建立了自适应门控神经元与可学习加权自相关函数之间的数学关系,证明了该模型从振动信号中提取相关特征并进行自适应降噪的能力。在此基础上,我们提出了一个稀疏感知交叉熵损失(SPCL)函数,该函数专注于基于特征空间中的类稀疏性难以聚类的尾类故障样本。此外,为了进一步提高对比学习模型对类不平衡轴承故障的诊断性能,我们提出了中心对比损失(CCL)函数。CCL使用SPCL函数优化的分类器权值计算每个类的中心,确保在学习过程中所有的故障类都被表示在每个mini-batch中,从而实现有效的对比学习。引入的方法的有效性通过从公开访问和专有数据集获得的实验结果得到证实。实验结果表明,该方法在极端类不平衡情况下的轴承故障智能诊断方面明显优于其他方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Mechanical Systems and Signal Processing
Mechanical Systems and Signal Processing 工程技术-工程:机械
CiteScore
14.80
自引率
13.10%
发文量
1183
审稿时长
5.4 months
期刊介绍: Journal Name: Mechanical Systems and Signal Processing (MSSP) Interdisciplinary Focus: Mechanical, Aerospace, and Civil Engineering Purpose:Reporting scientific advancements of the highest quality Arising from new techniques in sensing, instrumentation, signal processing, modelling, and control of dynamic systems
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信