石油化工过程预测的神经常微分方程和嵌入历史变量的监督门控循环单元

IF 3.9 3区 工程技术 Q2 ENGINEERING, CHEMICAL
Jian Long, , , Jiawei Zhu, , , Ning Wang, , , Kai Luo, , , Yejie Zhao, , and , Yunmeng Zhao*, 
{"title":"石油化工过程预测的神经常微分方程和嵌入历史变量的监督门控循环单元","authors":"Jian Long,&nbsp;, ,&nbsp;Jiawei Zhu,&nbsp;, ,&nbsp;Ning Wang,&nbsp;, ,&nbsp;Kai Luo,&nbsp;, ,&nbsp;Yejie Zhao,&nbsp;, and ,&nbsp;Yunmeng Zhao*,&nbsp;","doi":"10.1021/acs.iecr.5c02157","DOIUrl":null,"url":null,"abstract":"<p >Gated recurrent units (GRU) effectively handle dynamic nonlinear data in petrochemical process. However, GRUs mainly focus on temporal dependencies of input variables while neglecting supervisory variables in historical data. Concurrently, conventional discrete-layer neural networks struggle to capture continuous-time system dynamics. These combined limitations impair long-term prediction accuracy. To overcome the limitations of existing time series modeling approaches in capturing complex dynamic behaviors, this study proposes a novel fusion framework that integrates a gated recurrent architecture with neural ordinary differential equations (Neural ODEs). Specifically, we introduce a supervised history-gated recurrent unit (SHGRU), which extends the standard GRU by incorporating historical supervisory variables, thereby enhancing the model’s capacity to capture time-varying hidden dynamics associated with process quality. Building on this foundation, a deep architecture SHGRU deep network (SHGRU-DN) is constructed by stacking multiple layers of SHGRU units, enabling hierarchical feature extraction guided by historical supervision. To further model the continuous-time evolution of system states, we embed an improved Neural ODE into the SHGRU-DN, resulting in a novel dynamic modeling framework termed SHGRU with dynamic Neural ODE (SHGRU-DODE). Extensive experiments on industrial datasets demonstrate the superior predictive accuracy of the proposed model compared to GRU, and the results are close to the true value with an RMSE of 0.0151 when predicting gasoline yield during fluid catalytic cracking. Additional evaluations on the tennessee eastman process and the debutanizer column further validate the model’s superiority.</p>","PeriodicalId":39,"journal":{"name":"Industrial & Engineering Chemistry Research","volume":"64 41","pages":"20070–20088"},"PeriodicalIF":3.9000,"publicationDate":"2025-10-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Neural Ordinary Differential Equation and Supervised Gated Recurrent Units Embedded with Historical Variables for Petrochemical Process Prediction\",\"authors\":\"Jian Long,&nbsp;, ,&nbsp;Jiawei Zhu,&nbsp;, ,&nbsp;Ning Wang,&nbsp;, ,&nbsp;Kai Luo,&nbsp;, ,&nbsp;Yejie Zhao,&nbsp;, and ,&nbsp;Yunmeng Zhao*,&nbsp;\",\"doi\":\"10.1021/acs.iecr.5c02157\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p >Gated recurrent units (GRU) effectively handle dynamic nonlinear data in petrochemical process. However, GRUs mainly focus on temporal dependencies of input variables while neglecting supervisory variables in historical data. Concurrently, conventional discrete-layer neural networks struggle to capture continuous-time system dynamics. These combined limitations impair long-term prediction accuracy. To overcome the limitations of existing time series modeling approaches in capturing complex dynamic behaviors, this study proposes a novel fusion framework that integrates a gated recurrent architecture with neural ordinary differential equations (Neural ODEs). Specifically, we introduce a supervised history-gated recurrent unit (SHGRU), which extends the standard GRU by incorporating historical supervisory variables, thereby enhancing the model’s capacity to capture time-varying hidden dynamics associated with process quality. Building on this foundation, a deep architecture SHGRU deep network (SHGRU-DN) is constructed by stacking multiple layers of SHGRU units, enabling hierarchical feature extraction guided by historical supervision. To further model the continuous-time evolution of system states, we embed an improved Neural ODE into the SHGRU-DN, resulting in a novel dynamic modeling framework termed SHGRU with dynamic Neural ODE (SHGRU-DODE). Extensive experiments on industrial datasets demonstrate the superior predictive accuracy of the proposed model compared to GRU, and the results are close to the true value with an RMSE of 0.0151 when predicting gasoline yield during fluid catalytic cracking. Additional evaluations on the tennessee eastman process and the debutanizer column further validate the model’s superiority.</p>\",\"PeriodicalId\":39,\"journal\":{\"name\":\"Industrial & Engineering Chemistry Research\",\"volume\":\"64 41\",\"pages\":\"20070–20088\"},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2025-10-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Industrial & Engineering Chemistry Research\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://pubs.acs.org/doi/10.1021/acs.iecr.5c02157\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, CHEMICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Industrial & Engineering Chemistry Research","FirstCategoryId":"5","ListUrlMain":"https://pubs.acs.org/doi/10.1021/acs.iecr.5c02157","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, CHEMICAL","Score":null,"Total":0}
引用次数: 0

摘要

门控循环装置(GRU)可以有效地处理石化过程中的动态非线性数据。然而,gru主要关注输入变量的时间依赖性,而忽略了历史数据中的监督变量。同时,传统的离散层神经网络难以捕捉连续时间系统的动态。这些综合的限制损害了长期预测的准确性。为了克服现有时间序列建模方法在捕获复杂动态行为方面的局限性,本研究提出了一种新的融合框架,该框架将门控循环架构与神经常微分方程(neural ode)相结合。具体来说,我们引入了一个有监督的历史门控循环单元(SHGRU),它通过纳入历史监督变量扩展了标准GRU,从而增强了模型捕捉与过程质量相关的时变隐藏动态的能力。在此基础上,通过堆叠多层SHGRU单元构建深度架构SHGRU深度网络(SHGRU- dn),实现在历史监督指导下的分层特征提取。为了进一步模拟系统状态的连续时间演化,我们将一个改进的神经ODE嵌入到SHGRU- dn中,形成了一个新的动态建模框架,称为带有动态神经ODE的SHGRU (SHGRU- dode)。在工业数据集上的大量实验表明,与GRU相比,该模型的预测精度更高,在预测流体催化裂化过程中汽油产量时,结果接近真实值,RMSE为0.0151。对田纳西伊士曼工艺和脱塔塔的附加评价进一步验证了该模型的优越性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Neural Ordinary Differential Equation and Supervised Gated Recurrent Units Embedded with Historical Variables for Petrochemical Process Prediction

Neural Ordinary Differential Equation and Supervised Gated Recurrent Units Embedded with Historical Variables for Petrochemical Process Prediction

Neural Ordinary Differential Equation and Supervised Gated Recurrent Units Embedded with Historical Variables for Petrochemical Process Prediction

Gated recurrent units (GRU) effectively handle dynamic nonlinear data in petrochemical process. However, GRUs mainly focus on temporal dependencies of input variables while neglecting supervisory variables in historical data. Concurrently, conventional discrete-layer neural networks struggle to capture continuous-time system dynamics. These combined limitations impair long-term prediction accuracy. To overcome the limitations of existing time series modeling approaches in capturing complex dynamic behaviors, this study proposes a novel fusion framework that integrates a gated recurrent architecture with neural ordinary differential equations (Neural ODEs). Specifically, we introduce a supervised history-gated recurrent unit (SHGRU), which extends the standard GRU by incorporating historical supervisory variables, thereby enhancing the model’s capacity to capture time-varying hidden dynamics associated with process quality. Building on this foundation, a deep architecture SHGRU deep network (SHGRU-DN) is constructed by stacking multiple layers of SHGRU units, enabling hierarchical feature extraction guided by historical supervision. To further model the continuous-time evolution of system states, we embed an improved Neural ODE into the SHGRU-DN, resulting in a novel dynamic modeling framework termed SHGRU with dynamic Neural ODE (SHGRU-DODE). Extensive experiments on industrial datasets demonstrate the superior predictive accuracy of the proposed model compared to GRU, and the results are close to the true value with an RMSE of 0.0151 when predicting gasoline yield during fluid catalytic cracking. Additional evaluations on the tennessee eastman process and the debutanizer column further validate the model’s superiority.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Industrial & Engineering Chemistry Research
Industrial & Engineering Chemistry Research 工程技术-工程:化工
CiteScore
7.40
自引率
7.10%
发文量
1467
审稿时长
2.8 months
期刊介绍: ndustrial & Engineering Chemistry, with variations in title and format, has been published since 1909 by the American Chemical Society. Industrial & Engineering Chemistry Research is a weekly publication that reports industrial and academic research in the broad fields of applied chemistry and chemical engineering with special focus on fundamentals, processes, and products.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信