{"title":"多模过程质量预测中回声状态网络的连续半监督学习","authors":"Chao Yang;Qiang Liu;Yi Liu;Yiu-Ming Cheung","doi":"10.1109/TII.2025.3575101","DOIUrl":null,"url":null,"abstract":"The successive switching nature of multimode processes, coupled with data scarcity, challenges traditional quality prediction models. Specifically, the difficulty of simultaneously collecting abundant labeled datasets from all modes forces the model to update its parameters as modes switch. This leads to the forgetting of historical mode knowledge and hinders the aggregation of knowledge, thereby degrading generalization across modes. To this end, we propose a novel continual semisupervised graph echo state network (<inline-formula><tex-math>$\\text{CS}^{2}$</tex-math></inline-formula>GESN). First, a semisupervised graph echo state network (<inline-formula><tex-math>$\\text{S}^{2}$</tex-math></inline-formula>GESN) is designed based on the graph smoothing assumption to extract dynamic information from unlabeled samples within each mode. The <inline-formula><tex-math>$\\text{S}^{2}$</tex-math></inline-formula>GESN model then evolves into a continual model, <inline-formula><tex-math>$\\text{CS}^{2}$</tex-math></inline-formula>GESN, employing an elastic weight consolidation strategy for parameter importance estimation derived from pseudoinverse parameter optimization, facilitating the accumulation of historically learned knowledge. This manner alleviates performance deterioration from data scarcity and information forgetting, and enables more flexible modeling of successive arriving operating modes. The superiority and feasibility of the proposed method are demonstrated through its application to the Tennessee Eastman process and the three-phase flow facility process.","PeriodicalId":13301,"journal":{"name":"IEEE Transactions on Industrial Informatics","volume":"21 9","pages":"7209-7219"},"PeriodicalIF":9.9000,"publicationDate":"2025-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Continual Semisupervised Learning of Echo State Network for Quality Prediction of Multimode Processes\",\"authors\":\"Chao Yang;Qiang Liu;Yi Liu;Yiu-Ming Cheung\",\"doi\":\"10.1109/TII.2025.3575101\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The successive switching nature of multimode processes, coupled with data scarcity, challenges traditional quality prediction models. Specifically, the difficulty of simultaneously collecting abundant labeled datasets from all modes forces the model to update its parameters as modes switch. This leads to the forgetting of historical mode knowledge and hinders the aggregation of knowledge, thereby degrading generalization across modes. To this end, we propose a novel continual semisupervised graph echo state network (<inline-formula><tex-math>$\\\\text{CS}^{2}$</tex-math></inline-formula>GESN). First, a semisupervised graph echo state network (<inline-formula><tex-math>$\\\\text{S}^{2}$</tex-math></inline-formula>GESN) is designed based on the graph smoothing assumption to extract dynamic information from unlabeled samples within each mode. The <inline-formula><tex-math>$\\\\text{S}^{2}$</tex-math></inline-formula>GESN model then evolves into a continual model, <inline-formula><tex-math>$\\\\text{CS}^{2}$</tex-math></inline-formula>GESN, employing an elastic weight consolidation strategy for parameter importance estimation derived from pseudoinverse parameter optimization, facilitating the accumulation of historically learned knowledge. This manner alleviates performance deterioration from data scarcity and information forgetting, and enables more flexible modeling of successive arriving operating modes. The superiority and feasibility of the proposed method are demonstrated through its application to the Tennessee Eastman process and the three-phase flow facility process.\",\"PeriodicalId\":13301,\"journal\":{\"name\":\"IEEE Transactions on Industrial Informatics\",\"volume\":\"21 9\",\"pages\":\"7209-7219\"},\"PeriodicalIF\":9.9000,\"publicationDate\":\"2025-06-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Industrial Informatics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/11033180/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Industrial Informatics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11033180/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Continual Semisupervised Learning of Echo State Network for Quality Prediction of Multimode Processes
The successive switching nature of multimode processes, coupled with data scarcity, challenges traditional quality prediction models. Specifically, the difficulty of simultaneously collecting abundant labeled datasets from all modes forces the model to update its parameters as modes switch. This leads to the forgetting of historical mode knowledge and hinders the aggregation of knowledge, thereby degrading generalization across modes. To this end, we propose a novel continual semisupervised graph echo state network ($\text{CS}^{2}$GESN). First, a semisupervised graph echo state network ($\text{S}^{2}$GESN) is designed based on the graph smoothing assumption to extract dynamic information from unlabeled samples within each mode. The $\text{S}^{2}$GESN model then evolves into a continual model, $\text{CS}^{2}$GESN, employing an elastic weight consolidation strategy for parameter importance estimation derived from pseudoinverse parameter optimization, facilitating the accumulation of historically learned knowledge. This manner alleviates performance deterioration from data scarcity and information forgetting, and enables more flexible modeling of successive arriving operating modes. The superiority and feasibility of the proposed method are demonstrated through its application to the Tennessee Eastman process and the three-phase flow facility process.
期刊介绍:
The IEEE Transactions on Industrial Informatics is a multidisciplinary journal dedicated to publishing technical papers that connect theory with practical applications of informatics in industrial settings. It focuses on the utilization of information in intelligent, distributed, and agile industrial automation and control systems. The scope includes topics such as knowledge-based and AI-enhanced automation, intelligent computer control systems, flexible and collaborative manufacturing, industrial informatics in software-defined vehicles and robotics, computer vision, industrial cyber-physical and industrial IoT systems, real-time and networked embedded systems, security in industrial processes, industrial communications, systems interoperability, and human-machine interaction.