Minjie Feng , Haidong Shao , Minghui Shao , Yiming Xiao , Jie Wang , Bin Liu
{"title":"Utilizing Bayesian generalization network for reliable fault diagnosis of machinery with limited data","authors":"Minjie Feng , Haidong Shao , Minghui Shao , Yiming Xiao , Jie Wang , Bin Liu","doi":"10.1016/j.knosys.2024.112628","DOIUrl":null,"url":null,"abstract":"<div><div>To address the issues of overfitting, domain generalization challenges, and lack of credibility brought by limited data samples in mechanical fault diagnosis in practical engineering, this paper proposes a reliable Bayesian generalization network (BGNet). A Bayesian convolutional layer is constructed based on variational inference, treating all parameters in the convolutional layer as random variables. This approach makes a single model function similar to an ensemble of an infinite number of models, and thus enhancing the model's capability of overfitting resistance and domain generalization. The parameters of the variational distribution are updated to approximate the posterior distribution by local reparametrization and Monte Carlo sampling to optimize the evidence lower bound (ELBO) loss. Confidence information is extracted from the model results and, uncertainty estimation and decomposition schemes are designed to provide interpretability. The proposed method is applied to analyze the experimental data of bearing and gearbox faults. The results show that in a multi-source domain scenario with limited samples, the proposed method demonstrates high diagnostic accuracy, effectively describes the relationship between domain variability and uncertainty, and significantly outperforms several benchmark and state-of-the-art models.</div></div>","PeriodicalId":49939,"journal":{"name":"Knowledge-Based Systems","volume":null,"pages":null},"PeriodicalIF":7.2000,"publicationDate":"2024-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knowledge-Based Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950705124012620","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
To address the issues of overfitting, domain generalization challenges, and lack of credibility brought by limited data samples in mechanical fault diagnosis in practical engineering, this paper proposes a reliable Bayesian generalization network (BGNet). A Bayesian convolutional layer is constructed based on variational inference, treating all parameters in the convolutional layer as random variables. This approach makes a single model function similar to an ensemble of an infinite number of models, and thus enhancing the model's capability of overfitting resistance and domain generalization. The parameters of the variational distribution are updated to approximate the posterior distribution by local reparametrization and Monte Carlo sampling to optimize the evidence lower bound (ELBO) loss. Confidence information is extracted from the model results and, uncertainty estimation and decomposition schemes are designed to provide interpretability. The proposed method is applied to analyze the experimental data of bearing and gearbox faults. The results show that in a multi-source domain scenario with limited samples, the proposed method demonstrates high diagnostic accuracy, effectively describes the relationship between domain variability and uncertainty, and significantly outperforms several benchmark and state-of-the-art models.
期刊介绍:
Knowledge-Based Systems, an international and interdisciplinary journal in artificial intelligence, publishes original, innovative, and creative research results in the field. It focuses on knowledge-based and other artificial intelligence techniques-based systems. The journal aims to support human prediction and decision-making through data science and computation techniques, provide a balanced coverage of theory and practical study, and encourage the development and implementation of knowledge-based intelligence models, methods, systems, and software tools. Applications in business, government, education, engineering, and healthcare are emphasized.