基于集成ConvBiGRU和注意机制的多阶段批处理质量预测

IF 3.5 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Kai Liu, Xiaoqiang Zhao, Miao Mou, Yongyong Hui
{"title":"基于集成ConvBiGRU和注意机制的多阶段批处理质量预测","authors":"Kai Liu,&nbsp;Xiaoqiang Zhao,&nbsp;Miao Mou,&nbsp;Yongyong Hui","doi":"10.1007/s10489-024-06002-y","DOIUrl":null,"url":null,"abstract":"<div><p>It is important for quality prediction and monitoring to ensure the safe operation of the process. When constructing a prediction model, it is crucial to choose appropriate input variables to influence the online prediction performance and quality monitoring. Data-driven techniques have been widely used for prediction and monitoring of quality variables, but there are some difficulties in the application of batch processes, three-dimensional characteristics of data, different initial conditions, and multi-stage characteristics within batches. Therefore, we propose a quality prediction model of multi-stage batch process based on integrated ConvBiGRU with attention mechanism (MI-ConvBiGRU-AM). Firstly, Firstly, the original 3D data are expanded into 2D time slices by the batch-variable expansion method. Secondly, the 2D time slices are clustered to complete stage identification using the improved affine propagation clustering method based on the design of the Markov chain similarity matrix. At each stage, we select product quality-related modeling variables using the Maximum Relevance Minimum Redundancy (mRMR). Then, the selected variables are used to train a convolutional bi-directional gated recurrent unit with an attention mechanism (ConvBiGRU-AM). Finally, ConvBiGRU-AM model for each stage is integrated together a whole prediction model for the entire process to accomplish quality prediction, and the prediction residuals are utilized for quality monitoring. The validity of the proposed method was verified by Industrial-scale fed-batch fermentation (IFBF) process and the Hot strip mill (HSM) process. For the IFBF process, the model achieved an FDR of 99.73%, FAR of 0.54%, MAE of 0.0043, RMSE of 0.0396, MAPE of 0.0121, and R<sup>2</sup> of 0.9971. For the HSM process, the results were an FDR of 99.95%, FAR of 0.25%, MAE of 0.0053, RMSE of 0.0111, MAPE of 0.1539, and R<sup>2</sup> of 0.9990. These results demonstrate that the proposed method significantly improves prediction accuracy and achieves better quality monitoring compared to existing methods, highlighting its effectiveness for industrial applications.</p></div>","PeriodicalId":8041,"journal":{"name":"Applied Intelligence","volume":"55 2","pages":""},"PeriodicalIF":3.5000,"publicationDate":"2024-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Quality prediction of multi-stage batch process based on integrated ConvBiGRU with attention mechanism\",\"authors\":\"Kai Liu,&nbsp;Xiaoqiang Zhao,&nbsp;Miao Mou,&nbsp;Yongyong Hui\",\"doi\":\"10.1007/s10489-024-06002-y\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>It is important for quality prediction and monitoring to ensure the safe operation of the process. When constructing a prediction model, it is crucial to choose appropriate input variables to influence the online prediction performance and quality monitoring. Data-driven techniques have been widely used for prediction and monitoring of quality variables, but there are some difficulties in the application of batch processes, three-dimensional characteristics of data, different initial conditions, and multi-stage characteristics within batches. Therefore, we propose a quality prediction model of multi-stage batch process based on integrated ConvBiGRU with attention mechanism (MI-ConvBiGRU-AM). Firstly, Firstly, the original 3D data are expanded into 2D time slices by the batch-variable expansion method. Secondly, the 2D time slices are clustered to complete stage identification using the improved affine propagation clustering method based on the design of the Markov chain similarity matrix. At each stage, we select product quality-related modeling variables using the Maximum Relevance Minimum Redundancy (mRMR). Then, the selected variables are used to train a convolutional bi-directional gated recurrent unit with an attention mechanism (ConvBiGRU-AM). Finally, ConvBiGRU-AM model for each stage is integrated together a whole prediction model for the entire process to accomplish quality prediction, and the prediction residuals are utilized for quality monitoring. The validity of the proposed method was verified by Industrial-scale fed-batch fermentation (IFBF) process and the Hot strip mill (HSM) process. For the IFBF process, the model achieved an FDR of 99.73%, FAR of 0.54%, MAE of 0.0043, RMSE of 0.0396, MAPE of 0.0121, and R<sup>2</sup> of 0.9971. For the HSM process, the results were an FDR of 99.95%, FAR of 0.25%, MAE of 0.0053, RMSE of 0.0111, MAPE of 0.1539, and R<sup>2</sup> of 0.9990. These results demonstrate that the proposed method significantly improves prediction accuracy and achieves better quality monitoring compared to existing methods, highlighting its effectiveness for industrial applications.</p></div>\",\"PeriodicalId\":8041,\"journal\":{\"name\":\"Applied Intelligence\",\"volume\":\"55 2\",\"pages\":\"\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2024-12-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://link.springer.com/article/10.1007/s10489-024-06002-y\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Intelligence","FirstCategoryId":"94","ListUrlMain":"https://link.springer.com/article/10.1007/s10489-024-06002-y","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

质量预测和监测是保证工艺安全运行的重要手段。在构建预测模型时,选择合适的输入变量是影响在线预测性能和质量监测的关键。数据驱动技术已广泛应用于质量变量的预测和监测,但在批量过程、数据的三维特性、不同初始条件、批次内多阶段特性等方面存在应用困难。为此,我们提出了一种基于集成ConvBiGRU和注意机制的多阶段批处理质量预测模型(MI-ConvBiGRU-AM)。首先,采用批变量展开法将原始三维数据展开为二维时间片;其次,采用基于马尔可夫链相似矩阵设计的改进仿射传播聚类方法对二维时间片进行聚类,完成阶段识别;在每个阶段,我们使用最大关联最小冗余(mRMR)选择与产品质量相关的建模变量。然后,使用选择的变量来训练具有注意机制的卷积双向门控循环单元(ConvBiGRU-AM)。最后,将各阶段的ConvBiGRU-AM模型集成为整个过程的整体预测模型,完成质量预测,并利用预测残差进行质量监测。通过工业级补料间歇发酵(IFBF)工艺和热轧带钢(HSM)工艺验证了该方法的有效性。对于IFBF过程,该模型的FDR为99.73%,FAR为0.54%,MAE为0.0043,RMSE为0.0396,MAPE为0.0121,R2为0.9971。HSM工艺的FDR为99.95%,FAR为0.25%,MAE为0.0053,RMSE为0.0111,MAPE为0.1539,R2为0.9990。结果表明,与现有方法相比,该方法显著提高了预测精度,实现了更好的监测质量,突出了其在工业应用中的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Quality prediction of multi-stage batch process based on integrated ConvBiGRU with attention mechanism

It is important for quality prediction and monitoring to ensure the safe operation of the process. When constructing a prediction model, it is crucial to choose appropriate input variables to influence the online prediction performance and quality monitoring. Data-driven techniques have been widely used for prediction and monitoring of quality variables, but there are some difficulties in the application of batch processes, three-dimensional characteristics of data, different initial conditions, and multi-stage characteristics within batches. Therefore, we propose a quality prediction model of multi-stage batch process based on integrated ConvBiGRU with attention mechanism (MI-ConvBiGRU-AM). Firstly, Firstly, the original 3D data are expanded into 2D time slices by the batch-variable expansion method. Secondly, the 2D time slices are clustered to complete stage identification using the improved affine propagation clustering method based on the design of the Markov chain similarity matrix. At each stage, we select product quality-related modeling variables using the Maximum Relevance Minimum Redundancy (mRMR). Then, the selected variables are used to train a convolutional bi-directional gated recurrent unit with an attention mechanism (ConvBiGRU-AM). Finally, ConvBiGRU-AM model for each stage is integrated together a whole prediction model for the entire process to accomplish quality prediction, and the prediction residuals are utilized for quality monitoring. The validity of the proposed method was verified by Industrial-scale fed-batch fermentation (IFBF) process and the Hot strip mill (HSM) process. For the IFBF process, the model achieved an FDR of 99.73%, FAR of 0.54%, MAE of 0.0043, RMSE of 0.0396, MAPE of 0.0121, and R2 of 0.9971. For the HSM process, the results were an FDR of 99.95%, FAR of 0.25%, MAE of 0.0053, RMSE of 0.0111, MAPE of 0.1539, and R2 of 0.9990. These results demonstrate that the proposed method significantly improves prediction accuracy and achieves better quality monitoring compared to existing methods, highlighting its effectiveness for industrial applications.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Applied Intelligence
Applied Intelligence 工程技术-计算机:人工智能
CiteScore
6.60
自引率
20.80%
发文量
1361
审稿时长
5.9 months
期刊介绍: With a focus on research in artificial intelligence and neural networks, this journal addresses issues involving solutions of real-life manufacturing, defense, management, government and industrial problems which are too complex to be solved through conventional approaches and require the simulation of intelligent thought processes, heuristics, applications of knowledge, and distributed and parallel processing. The integration of these multiple approaches in solving complex problems is of particular importance. The journal presents new and original research and technological developments, addressing real and complex issues applicable to difficult problems. It provides a medium for exchanging scientific research and technological achievements accomplished by the international community.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信