A two-stage learning framework for imbalanced semi-supervised domain generalization fault diagnosis under unknown operating conditions

IF 8 1区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Chuanxia Jian, Heen Chen, Yinhui Ao, Xiaobo Zhang
{"title":"A two-stage learning framework for imbalanced semi-supervised domain generalization fault diagnosis under unknown operating conditions","authors":"Chuanxia Jian,&nbsp;Heen Chen,&nbsp;Yinhui Ao,&nbsp;Xiaobo Zhang","doi":"10.1016/j.aei.2024.102878","DOIUrl":null,"url":null,"abstract":"<div><div>The diagnosis of mechanical faults under unknown operating conditions has been extensively investigated. In real industrial scenarios, fault diagnosis often faces challenges such as class imbalance, scarcity of class labels, and domain shifts. Existing methods cannot simultaneously address these issues. Therefore, this study proposes an imbalanced semi-supervised domain generalization-based fault diagnosis (ISDGFD) learning paradigm and develops a two-stage learning framework to tackle these issues. In the first stage, labeled data is preprocessed to address class imbalance, key features are extracted using a multi-scale convolutional neural network with a self-attention mechanism, and domain-invariant and class-aware features are initially learned through multi-domain adversarial learning and supervised learning, respectively. In the second stage, reliable pseudo-labeled samples are selected and a weighted pseudo-labeled loss is used to retrain the model, further enhancing generalization capability. Extensive experiments were conducted on the CWRU and HUST datasets. The proposed method achieved average scores of 0.85 in <em>Recall</em>, 0.87 in <em>F-score</em>, and 0.92 in <em>Accuracy</em> on the CWRU dataset, and 0.8052 in <em>Recall</em>, 0.7747 in <em>F-score</em>, and 0.8398 in <em>Accuracy</em> on the HUST dataset. These results outperform those of existing state-of-the-art semi-supervised Domain Generalization-based Fault Diagnosis (DGFD) methods and are comparable to the results of fully-supervised imbalanced DGFD methods, demonstrating its effectiveness for ISDGFD under unknown operating conditions.</div></div>","PeriodicalId":50941,"journal":{"name":"Advanced Engineering Informatics","volume":"62 ","pages":"Article 102878"},"PeriodicalIF":8.0000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Engineering Informatics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1474034624005263","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

The diagnosis of mechanical faults under unknown operating conditions has been extensively investigated. In real industrial scenarios, fault diagnosis often faces challenges such as class imbalance, scarcity of class labels, and domain shifts. Existing methods cannot simultaneously address these issues. Therefore, this study proposes an imbalanced semi-supervised domain generalization-based fault diagnosis (ISDGFD) learning paradigm and develops a two-stage learning framework to tackle these issues. In the first stage, labeled data is preprocessed to address class imbalance, key features are extracted using a multi-scale convolutional neural network with a self-attention mechanism, and domain-invariant and class-aware features are initially learned through multi-domain adversarial learning and supervised learning, respectively. In the second stage, reliable pseudo-labeled samples are selected and a weighted pseudo-labeled loss is used to retrain the model, further enhancing generalization capability. Extensive experiments were conducted on the CWRU and HUST datasets. The proposed method achieved average scores of 0.85 in Recall, 0.87 in F-score, and 0.92 in Accuracy on the CWRU dataset, and 0.8052 in Recall, 0.7747 in F-score, and 0.8398 in Accuracy on the HUST dataset. These results outperform those of existing state-of-the-art semi-supervised Domain Generalization-based Fault Diagnosis (DGFD) methods and are comparable to the results of fully-supervised imbalanced DGFD methods, demonstrating its effectiveness for ISDGFD under unknown operating conditions.
用于未知运行条件下不平衡半监督领域泛化故障诊断的两阶段学习框架
人们对未知运行条件下的机械故障诊断进行了广泛研究。在实际工业场景中,故障诊断往往面临类别不平衡、类别标签稀缺和领域偏移等挑战。现有方法无法同时解决这些问题。因此,本研究提出了一种基于不平衡半监督领域泛化的故障诊断(ISDGFD)学习范式,并开发了一个两阶段学习框架来解决这些问题。在第一阶段,对标记数据进行预处理以解决类不平衡问题,使用具有自注意机制的多尺度卷积神经网络提取关键特征,并分别通过多域对抗学习和监督学习初步学习域不变特征和类感知特征。在第二阶段,选择可靠的伪标记样本,利用加权伪标记损失对模型进行再训练,进一步提高泛化能力。在 CWRU 和 HUST 数据集上进行了广泛的实验。所提方法在 CWRU 数据集上的平均召回率为 0.85,F-score 为 0.87,准确率为 0.92;在 HUST 数据集上的平均召回率为 0.8052,F-score 为 0.7747,准确率为 0.8398。这些结果优于现有最先进的基于领域泛化的半监督故障诊断(DGFD)方法,并与全监督不平衡 DGFD 方法的结果相当,证明了它在未知运行条件下进行 ISDGFD 的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Advanced Engineering Informatics
Advanced Engineering Informatics 工程技术-工程:综合
CiteScore
12.40
自引率
18.20%
发文量
292
审稿时长
45 days
期刊介绍: Advanced Engineering Informatics is an international Journal that solicits research papers with an emphasis on 'knowledge' and 'engineering applications'. The Journal seeks original papers that report progress in applying methods of engineering informatics. These papers should have engineering relevance and help provide a scientific base for more reliable, spontaneous, and creative engineering decision-making. Additionally, papers should demonstrate the science of supporting knowledge-intensive engineering tasks and validate the generality, power, and scalability of new methods through rigorous evaluation, preferably both qualitatively and quantitatively. Abstracting and indexing for Advanced Engineering Informatics include Science Citation Index Expanded, Scopus and INSPEC.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信