基于离线强化学习的乙烯裂解炉进料策略

IF 3.9 2区 工程技术 Q2 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
Haojun Zhong, Zhenlei Wang, Yuzhe Hao
{"title":"基于离线强化学习的乙烯裂解炉进料策略","authors":"Haojun Zhong,&nbsp;Zhenlei Wang,&nbsp;Yuzhe Hao","doi":"10.1016/j.compchemeng.2024.108864","DOIUrl":null,"url":null,"abstract":"<div><p>The feeding process of the ethylene cracking furnace necessitates the synchronized adjustment of multiple controlled factors. The process mainly relies on operators to do it manually, which is burdensome and may lead to significant variations in coil out temperature (COT) due to the differing expertise of operators. This paper proposes a method for learning the feeding strategy of the ethylene cracking furnace using offline reinforcement learning. The agent learns and optimizes the operating strategy directly from datasets, eliminating the need for sophisticated process simulator modeling. In addition, the advantage function is incorporated into the Twin Delayed Deep Deterministic Behavioral Cloning (TD3BC) algorithm, which enables the agent to acquire more effective operational experience. The proposed method is initially evaluated using benchmark datasets. Further, the proposed method is validated through comparative experiments on a feeding process validation model, demonstrating superior rewards and outperforming manual operating experience as well as other offline reinforcement learning methods.</p></div>","PeriodicalId":286,"journal":{"name":"Computers & Chemical Engineering","volume":"192 ","pages":"Article 108864"},"PeriodicalIF":3.9000,"publicationDate":"2024-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0098135424002825/pdfft?md5=85eb0196a921c27b8bd237adcbca4c1d&pid=1-s2.0-S0098135424002825-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Offline reinforcement learning based feeding strategy of ethylene cracking furnace\",\"authors\":\"Haojun Zhong,&nbsp;Zhenlei Wang,&nbsp;Yuzhe Hao\",\"doi\":\"10.1016/j.compchemeng.2024.108864\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>The feeding process of the ethylene cracking furnace necessitates the synchronized adjustment of multiple controlled factors. The process mainly relies on operators to do it manually, which is burdensome and may lead to significant variations in coil out temperature (COT) due to the differing expertise of operators. This paper proposes a method for learning the feeding strategy of the ethylene cracking furnace using offline reinforcement learning. The agent learns and optimizes the operating strategy directly from datasets, eliminating the need for sophisticated process simulator modeling. In addition, the advantage function is incorporated into the Twin Delayed Deep Deterministic Behavioral Cloning (TD3BC) algorithm, which enables the agent to acquire more effective operational experience. The proposed method is initially evaluated using benchmark datasets. Further, the proposed method is validated through comparative experiments on a feeding process validation model, demonstrating superior rewards and outperforming manual operating experience as well as other offline reinforcement learning methods.</p></div>\",\"PeriodicalId\":286,\"journal\":{\"name\":\"Computers & Chemical Engineering\",\"volume\":\"192 \",\"pages\":\"Article 108864\"},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2024-09-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S0098135424002825/pdfft?md5=85eb0196a921c27b8bd237adcbca4c1d&pid=1-s2.0-S0098135424002825-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers & Chemical Engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0098135424002825\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers & Chemical Engineering","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0098135424002825","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

乙烯裂解炉的进料过程需要对多个受控因素进行同步调整。该过程主要依靠操作人员手动完成,负担较重,而且由于操作人员的专业知识不同,可能导致盘管出料温度(COT)的显著变化。本文提出了一种利用离线强化学习来学习乙烯裂解炉进料策略的方法。代理直接从数据集学习和优化操作策略,无需复杂的过程模拟器建模。此外,还将优势功能纳入了双延迟深度确定性行为克隆(TD3BC)算法,使代理能够获得更有效的操作经验。利用基准数据集对所提出的方法进行了初步评估。此外,还在一个饲养过程验证模型上进行了对比实验,验证了所提出的方法,结果表明该方法具有卓越的回报,优于人工操作经验和其他离线强化学习方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Offline reinforcement learning based feeding strategy of ethylene cracking furnace

The feeding process of the ethylene cracking furnace necessitates the synchronized adjustment of multiple controlled factors. The process mainly relies on operators to do it manually, which is burdensome and may lead to significant variations in coil out temperature (COT) due to the differing expertise of operators. This paper proposes a method for learning the feeding strategy of the ethylene cracking furnace using offline reinforcement learning. The agent learns and optimizes the operating strategy directly from datasets, eliminating the need for sophisticated process simulator modeling. In addition, the advantage function is incorporated into the Twin Delayed Deep Deterministic Behavioral Cloning (TD3BC) algorithm, which enables the agent to acquire more effective operational experience. The proposed method is initially evaluated using benchmark datasets. Further, the proposed method is validated through comparative experiments on a feeding process validation model, demonstrating superior rewards and outperforming manual operating experience as well as other offline reinforcement learning methods.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Computers & Chemical Engineering
Computers & Chemical Engineering 工程技术-工程:化工
CiteScore
8.70
自引率
14.00%
发文量
374
审稿时长
70 days
期刊介绍: Computers & Chemical Engineering is primarily a journal of record for new developments in the application of computing and systems technology to chemical engineering problems.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信