Jian Long, , , Jiawei Zhu, , , Ning Wang, , , Kai Luo, , , Yejie Zhao, , and , Yunmeng Zhao*,
{"title":"石油化工过程预测的神经常微分方程和嵌入历史变量的监督门控循环单元","authors":"Jian Long, , , Jiawei Zhu, , , Ning Wang, , , Kai Luo, , , Yejie Zhao, , and , Yunmeng Zhao*, ","doi":"10.1021/acs.iecr.5c02157","DOIUrl":null,"url":null,"abstract":"<p >Gated recurrent units (GRU) effectively handle dynamic nonlinear data in petrochemical process. However, GRUs mainly focus on temporal dependencies of input variables while neglecting supervisory variables in historical data. Concurrently, conventional discrete-layer neural networks struggle to capture continuous-time system dynamics. These combined limitations impair long-term prediction accuracy. To overcome the limitations of existing time series modeling approaches in capturing complex dynamic behaviors, this study proposes a novel fusion framework that integrates a gated recurrent architecture with neural ordinary differential equations (Neural ODEs). Specifically, we introduce a supervised history-gated recurrent unit (SHGRU), which extends the standard GRU by incorporating historical supervisory variables, thereby enhancing the model’s capacity to capture time-varying hidden dynamics associated with process quality. Building on this foundation, a deep architecture SHGRU deep network (SHGRU-DN) is constructed by stacking multiple layers of SHGRU units, enabling hierarchical feature extraction guided by historical supervision. To further model the continuous-time evolution of system states, we embed an improved Neural ODE into the SHGRU-DN, resulting in a novel dynamic modeling framework termed SHGRU with dynamic Neural ODE (SHGRU-DODE). Extensive experiments on industrial datasets demonstrate the superior predictive accuracy of the proposed model compared to GRU, and the results are close to the true value with an RMSE of 0.0151 when predicting gasoline yield during fluid catalytic cracking. Additional evaluations on the tennessee eastman process and the debutanizer column further validate the model’s superiority.</p>","PeriodicalId":39,"journal":{"name":"Industrial & Engineering Chemistry Research","volume":"64 41","pages":"20070–20088"},"PeriodicalIF":3.9000,"publicationDate":"2025-10-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Neural Ordinary Differential Equation and Supervised Gated Recurrent Units Embedded with Historical Variables for Petrochemical Process Prediction\",\"authors\":\"Jian Long, , , Jiawei Zhu, , , Ning Wang, , , Kai Luo, , , Yejie Zhao, , and , Yunmeng Zhao*, \",\"doi\":\"10.1021/acs.iecr.5c02157\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p >Gated recurrent units (GRU) effectively handle dynamic nonlinear data in petrochemical process. However, GRUs mainly focus on temporal dependencies of input variables while neglecting supervisory variables in historical data. Concurrently, conventional discrete-layer neural networks struggle to capture continuous-time system dynamics. These combined limitations impair long-term prediction accuracy. To overcome the limitations of existing time series modeling approaches in capturing complex dynamic behaviors, this study proposes a novel fusion framework that integrates a gated recurrent architecture with neural ordinary differential equations (Neural ODEs). Specifically, we introduce a supervised history-gated recurrent unit (SHGRU), which extends the standard GRU by incorporating historical supervisory variables, thereby enhancing the model’s capacity to capture time-varying hidden dynamics associated with process quality. Building on this foundation, a deep architecture SHGRU deep network (SHGRU-DN) is constructed by stacking multiple layers of SHGRU units, enabling hierarchical feature extraction guided by historical supervision. To further model the continuous-time evolution of system states, we embed an improved Neural ODE into the SHGRU-DN, resulting in a novel dynamic modeling framework termed SHGRU with dynamic Neural ODE (SHGRU-DODE). Extensive experiments on industrial datasets demonstrate the superior predictive accuracy of the proposed model compared to GRU, and the results are close to the true value with an RMSE of 0.0151 when predicting gasoline yield during fluid catalytic cracking. Additional evaluations on the tennessee eastman process and the debutanizer column further validate the model’s superiority.</p>\",\"PeriodicalId\":39,\"journal\":{\"name\":\"Industrial & Engineering Chemistry Research\",\"volume\":\"64 41\",\"pages\":\"20070–20088\"},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2025-10-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Industrial & Engineering Chemistry Research\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://pubs.acs.org/doi/10.1021/acs.iecr.5c02157\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, CHEMICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Industrial & Engineering Chemistry Research","FirstCategoryId":"5","ListUrlMain":"https://pubs.acs.org/doi/10.1021/acs.iecr.5c02157","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, CHEMICAL","Score":null,"Total":0}
Neural Ordinary Differential Equation and Supervised Gated Recurrent Units Embedded with Historical Variables for Petrochemical Process Prediction
Gated recurrent units (GRU) effectively handle dynamic nonlinear data in petrochemical process. However, GRUs mainly focus on temporal dependencies of input variables while neglecting supervisory variables in historical data. Concurrently, conventional discrete-layer neural networks struggle to capture continuous-time system dynamics. These combined limitations impair long-term prediction accuracy. To overcome the limitations of existing time series modeling approaches in capturing complex dynamic behaviors, this study proposes a novel fusion framework that integrates a gated recurrent architecture with neural ordinary differential equations (Neural ODEs). Specifically, we introduce a supervised history-gated recurrent unit (SHGRU), which extends the standard GRU by incorporating historical supervisory variables, thereby enhancing the model’s capacity to capture time-varying hidden dynamics associated with process quality. Building on this foundation, a deep architecture SHGRU deep network (SHGRU-DN) is constructed by stacking multiple layers of SHGRU units, enabling hierarchical feature extraction guided by historical supervision. To further model the continuous-time evolution of system states, we embed an improved Neural ODE into the SHGRU-DN, resulting in a novel dynamic modeling framework termed SHGRU with dynamic Neural ODE (SHGRU-DODE). Extensive experiments on industrial datasets demonstrate the superior predictive accuracy of the proposed model compared to GRU, and the results are close to the true value with an RMSE of 0.0151 when predicting gasoline yield during fluid catalytic cracking. Additional evaluations on the tennessee eastman process and the debutanizer column further validate the model’s superiority.
期刊介绍:
ndustrial & Engineering Chemistry, with variations in title and format, has been published since 1909 by the American Chemical Society. Industrial & Engineering Chemistry Research is a weekly publication that reports industrial and academic research in the broad fields of applied chemistry and chemical engineering with special focus on fundamentals, processes, and products.