Bangwu Dai, Yuqing Chang, Sheng Xu* and Fuli Wang,
{"title":"基于多智能体强化学习的锅炉汽轮机组过程知识导向优化控制","authors":"Bangwu Dai, Yuqing Chang, Sheng Xu* and Fuli Wang, ","doi":"10.1021/acsomega.4c1001110.1021/acsomega.4c10011","DOIUrl":null,"url":null,"abstract":"<p >For the coal-fired power unit, traditional centralized optimization control frameworks face challenges in achieving fast load response due to heavy computation and long online calculation times, especially for devices with limited computing power. This paper proposes a process knowledge-guided distributed optimization control framework for once-through boiler-turbine unit using multiagent deep reinforcement learning. In this framework, a centralized training distributed execution multiagent deep reinforcement learning algorithm is employed to obtain the optimal controllers of the once-through boiler-turbine unit, by dividing the coordinated control system into three subsystems and modeling the control process as a fully cooperative multiagent Markov decision process. Moreover, the process knowledge represented by a low-precision process model is used to guide and improve the training of multiagent deep reinforcement learning by distributed model predictive control algorithm generating the initial control actions and the designed action fusion strategy. Finally, the effectiveness of the process knowledge-guided optimization control framework is verified by the simulation platform, and the results show that the proposed algorithm has a faster speed and better control effect than the compared algorithms.</p>","PeriodicalId":22,"journal":{"name":"ACS Omega","volume":"10 15","pages":"14844–14857 14844–14857"},"PeriodicalIF":3.7000,"publicationDate":"2025-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://pubs.acs.org/doi/epdf/10.1021/acsomega.4c10011","citationCount":"0","resultStr":"{\"title\":\"Process Knowledge-Guided Optimization Control for Once-Through Boiler-Turbine Units Based on Multi-Agent Reinforcement Learning\",\"authors\":\"Bangwu Dai, Yuqing Chang, Sheng Xu* and Fuli Wang, \",\"doi\":\"10.1021/acsomega.4c1001110.1021/acsomega.4c10011\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p >For the coal-fired power unit, traditional centralized optimization control frameworks face challenges in achieving fast load response due to heavy computation and long online calculation times, especially for devices with limited computing power. This paper proposes a process knowledge-guided distributed optimization control framework for once-through boiler-turbine unit using multiagent deep reinforcement learning. In this framework, a centralized training distributed execution multiagent deep reinforcement learning algorithm is employed to obtain the optimal controllers of the once-through boiler-turbine unit, by dividing the coordinated control system into three subsystems and modeling the control process as a fully cooperative multiagent Markov decision process. Moreover, the process knowledge represented by a low-precision process model is used to guide and improve the training of multiagent deep reinforcement learning by distributed model predictive control algorithm generating the initial control actions and the designed action fusion strategy. Finally, the effectiveness of the process knowledge-guided optimization control framework is verified by the simulation platform, and the results show that the proposed algorithm has a faster speed and better control effect than the compared algorithms.</p>\",\"PeriodicalId\":22,\"journal\":{\"name\":\"ACS Omega\",\"volume\":\"10 15\",\"pages\":\"14844–14857 14844–14857\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2025-04-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://pubs.acs.org/doi/epdf/10.1021/acsomega.4c10011\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ACS Omega\",\"FirstCategoryId\":\"92\",\"ListUrlMain\":\"https://pubs.acs.org/doi/10.1021/acsomega.4c10011\",\"RegionNum\":3,\"RegionCategory\":\"化学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"CHEMISTRY, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Omega","FirstCategoryId":"92","ListUrlMain":"https://pubs.acs.org/doi/10.1021/acsomega.4c10011","RegionNum":3,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
Process Knowledge-Guided Optimization Control for Once-Through Boiler-Turbine Units Based on Multi-Agent Reinforcement Learning
For the coal-fired power unit, traditional centralized optimization control frameworks face challenges in achieving fast load response due to heavy computation and long online calculation times, especially for devices with limited computing power. This paper proposes a process knowledge-guided distributed optimization control framework for once-through boiler-turbine unit using multiagent deep reinforcement learning. In this framework, a centralized training distributed execution multiagent deep reinforcement learning algorithm is employed to obtain the optimal controllers of the once-through boiler-turbine unit, by dividing the coordinated control system into three subsystems and modeling the control process as a fully cooperative multiagent Markov decision process. Moreover, the process knowledge represented by a low-precision process model is used to guide and improve the training of multiagent deep reinforcement learning by distributed model predictive control algorithm generating the initial control actions and the designed action fusion strategy. Finally, the effectiveness of the process knowledge-guided optimization control framework is verified by the simulation platform, and the results show that the proposed algorithm has a faster speed and better control effect than the compared algorithms.
ACS OmegaChemical Engineering-General Chemical Engineering
CiteScore
6.60
自引率
4.90%
发文量
3945
审稿时长
2.4 months
期刊介绍:
ACS Omega is an open-access global publication for scientific articles that describe new findings in chemistry and interfacing areas of science, without any perceived evaluation of immediate impact.