Unified Low-Dimensional Subspace Analysis of Continuous and Binary Variables for Industrial Process Monitoring

IF 9.4 1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS
Junhao Chen;Chunhui Zhao;Pengyu Song;Min Xie
{"title":"Unified Low-Dimensional Subspace Analysis of Continuous and Binary Variables for Industrial Process Monitoring","authors":"Junhao Chen;Chunhui Zhao;Pengyu Song;Min Xie","doi":"10.1109/TCYB.2024.3524827","DOIUrl":null,"url":null,"abstract":"Industrial data often consist of continuous variables (CVs) and binary variables (BVs), both of which provide crucial information about process operating conditions. Due to the coupling between industrial systems or equipment, these hybrid variables are usually high-dimensional and highly correlated. However, existing methods generally model hybrid variables directly in the observation space and assume independence between the variables to overcome the curse of dimensionality. Thus, they are ineffective at capturing dependencies among hybrid variables, and the effectiveness of process monitoring will be compromised. To overcome the limitations, this study proposes to seek a unified subspace for hybrid variables using the probabilistic latent variable (LV) model. By introducing a low-dimensional continuous LV, the proposed method can avoid the curse of dimensionality while capturing the dependencies between hybrid variables. Nevertheless, the inference of LV is analytically intractable and thus time-consuming due to the heterogeneity of CVs and BVs. To accelerate offline learning and online inference procedures, this study originally derives an analytical Gaussian distribution to approximate the true posterior distribution of the LV, based on which an efficient expectation-maximization algorithm is developed for parameter estimation. The Gaussian approximation is simultaneously optimized with the latest parameters to achieve a high approximation accuracy. The LV is then estimated by the posterior mean of the Gaussian approximation. By mapping the heterogeneous variables into a unified subspace, the proposed method defines three monitoring statistics, which are physically interpretable and thoroughly evaluate the probability of hybrid variables being normal. The effectiveness of the proposed method in detecting anomalies in CVs and BVs is shown through a numerically simulated case and a real industrial case.","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"55 3","pages":"1135-1146"},"PeriodicalIF":9.4000,"publicationDate":"2025-01-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Cybernetics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10852343/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Industrial data often consist of continuous variables (CVs) and binary variables (BVs), both of which provide crucial information about process operating conditions. Due to the coupling between industrial systems or equipment, these hybrid variables are usually high-dimensional and highly correlated. However, existing methods generally model hybrid variables directly in the observation space and assume independence between the variables to overcome the curse of dimensionality. Thus, they are ineffective at capturing dependencies among hybrid variables, and the effectiveness of process monitoring will be compromised. To overcome the limitations, this study proposes to seek a unified subspace for hybrid variables using the probabilistic latent variable (LV) model. By introducing a low-dimensional continuous LV, the proposed method can avoid the curse of dimensionality while capturing the dependencies between hybrid variables. Nevertheless, the inference of LV is analytically intractable and thus time-consuming due to the heterogeneity of CVs and BVs. To accelerate offline learning and online inference procedures, this study originally derives an analytical Gaussian distribution to approximate the true posterior distribution of the LV, based on which an efficient expectation-maximization algorithm is developed for parameter estimation. The Gaussian approximation is simultaneously optimized with the latest parameters to achieve a high approximation accuracy. The LV is then estimated by the posterior mean of the Gaussian approximation. By mapping the heterogeneous variables into a unified subspace, the proposed method defines three monitoring statistics, which are physically interpretable and thoroughly evaluate the probability of hybrid variables being normal. The effectiveness of the proposed method in detecting anomalies in CVs and BVs is shown through a numerically simulated case and a real industrial case.
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Cybernetics
IEEE Transactions on Cybernetics COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE-COMPUTER SCIENCE, CYBERNETICS
CiteScore
25.40
自引率
11.00%
发文量
1869
期刊介绍: The scope of the IEEE Transactions on Cybernetics includes computational approaches to the field of cybernetics. Specifically, the transactions welcomes papers on communication and control across machines or machine, human, and organizations. The scope includes such areas as computational intelligence, computer vision, neural networks, genetic algorithms, machine learning, fuzzy systems, cognitive systems, decision making, and robotics, to the extent that they contribute to the theme of cybernetics or demonstrate an application of cybernetics principles.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信