基于多智能体强化学习的锅炉汽轮机组过程知识导向优化控制

IF 3.7 3区 化学 Q2 CHEMISTRY, MULTIDISCIPLINARY
Bangwu Dai, Yuqing Chang, Sheng Xu* and Fuli Wang, 
{"title":"基于多智能体强化学习的锅炉汽轮机组过程知识导向优化控制","authors":"Bangwu Dai,&nbsp;Yuqing Chang,&nbsp;Sheng Xu* and Fuli Wang,&nbsp;","doi":"10.1021/acsomega.4c1001110.1021/acsomega.4c10011","DOIUrl":null,"url":null,"abstract":"<p >For the coal-fired power unit, traditional centralized optimization control frameworks face challenges in achieving fast load response due to heavy computation and long online calculation times, especially for devices with limited computing power. This paper proposes a process knowledge-guided distributed optimization control framework for once-through boiler-turbine unit using multiagent deep reinforcement learning. In this framework, a centralized training distributed execution multiagent deep reinforcement learning algorithm is employed to obtain the optimal controllers of the once-through boiler-turbine unit, by dividing the coordinated control system into three subsystems and modeling the control process as a fully cooperative multiagent Markov decision process. Moreover, the process knowledge represented by a low-precision process model is used to guide and improve the training of multiagent deep reinforcement learning by distributed model predictive control algorithm generating the initial control actions and the designed action fusion strategy. Finally, the effectiveness of the process knowledge-guided optimization control framework is verified by the simulation platform, and the results show that the proposed algorithm has a faster speed and better control effect than the compared algorithms.</p>","PeriodicalId":22,"journal":{"name":"ACS Omega","volume":"10 15","pages":"14844–14857 14844–14857"},"PeriodicalIF":3.7000,"publicationDate":"2025-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://pubs.acs.org/doi/epdf/10.1021/acsomega.4c10011","citationCount":"0","resultStr":"{\"title\":\"Process Knowledge-Guided Optimization Control for Once-Through Boiler-Turbine Units Based on Multi-Agent Reinforcement Learning\",\"authors\":\"Bangwu Dai,&nbsp;Yuqing Chang,&nbsp;Sheng Xu* and Fuli Wang,&nbsp;\",\"doi\":\"10.1021/acsomega.4c1001110.1021/acsomega.4c10011\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p >For the coal-fired power unit, traditional centralized optimization control frameworks face challenges in achieving fast load response due to heavy computation and long online calculation times, especially for devices with limited computing power. This paper proposes a process knowledge-guided distributed optimization control framework for once-through boiler-turbine unit using multiagent deep reinforcement learning. In this framework, a centralized training distributed execution multiagent deep reinforcement learning algorithm is employed to obtain the optimal controllers of the once-through boiler-turbine unit, by dividing the coordinated control system into three subsystems and modeling the control process as a fully cooperative multiagent Markov decision process. Moreover, the process knowledge represented by a low-precision process model is used to guide and improve the training of multiagent deep reinforcement learning by distributed model predictive control algorithm generating the initial control actions and the designed action fusion strategy. Finally, the effectiveness of the process knowledge-guided optimization control framework is verified by the simulation platform, and the results show that the proposed algorithm has a faster speed and better control effect than the compared algorithms.</p>\",\"PeriodicalId\":22,\"journal\":{\"name\":\"ACS Omega\",\"volume\":\"10 15\",\"pages\":\"14844–14857 14844–14857\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2025-04-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://pubs.acs.org/doi/epdf/10.1021/acsomega.4c10011\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ACS Omega\",\"FirstCategoryId\":\"92\",\"ListUrlMain\":\"https://pubs.acs.org/doi/10.1021/acsomega.4c10011\",\"RegionNum\":3,\"RegionCategory\":\"化学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"CHEMISTRY, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Omega","FirstCategoryId":"92","ListUrlMain":"https://pubs.acs.org/doi/10.1021/acsomega.4c10011","RegionNum":3,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

对于燃煤机组来说,传统的集中式优化控制框架由于计算量大、在线计算时间长,特别是对于计算能力有限的设备,难以实现快速的负荷响应。本文提出了一种基于多智能体深度强化学习的过程知识引导的锅炉汽轮机组直通分布式优化控制框架。在该框架中,采用集中训练分布式执行的多智能体深度强化学习算法,将协调控制系统划分为三个子系统,并将控制过程建模为一个完全合作的多智能体马尔可夫决策过程,从而获得锅炉汽轮机组的最优控制器。以低精度过程模型为代表的过程知识,通过分布式模型预测控制算法生成初始控制动作和设计动作融合策略,指导和改进多智能体深度强化学习的训练。最后,通过仿真平台验证了过程知识导向优化控制框架的有效性,结果表明,与比较算法相比,所提算法具有更快的速度和更好的控制效果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Process Knowledge-Guided Optimization Control for Once-Through Boiler-Turbine Units Based on Multi-Agent Reinforcement Learning

For the coal-fired power unit, traditional centralized optimization control frameworks face challenges in achieving fast load response due to heavy computation and long online calculation times, especially for devices with limited computing power. This paper proposes a process knowledge-guided distributed optimization control framework for once-through boiler-turbine unit using multiagent deep reinforcement learning. In this framework, a centralized training distributed execution multiagent deep reinforcement learning algorithm is employed to obtain the optimal controllers of the once-through boiler-turbine unit, by dividing the coordinated control system into three subsystems and modeling the control process as a fully cooperative multiagent Markov decision process. Moreover, the process knowledge represented by a low-precision process model is used to guide and improve the training of multiagent deep reinforcement learning by distributed model predictive control algorithm generating the initial control actions and the designed action fusion strategy. Finally, the effectiveness of the process knowledge-guided optimization control framework is verified by the simulation platform, and the results show that the proposed algorithm has a faster speed and better control effect than the compared algorithms.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
ACS Omega
ACS Omega Chemical Engineering-General Chemical Engineering
CiteScore
6.60
自引率
4.90%
发文量
3945
审稿时长
2.4 months
期刊介绍: ACS Omega is an open-access global publication for scientific articles that describe new findings in chemistry and interfacing areas of science, without any perceived evaluation of immediate impact.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信