基于 MO-TD3 的质子交换膜电解槽温度控制研究

IF 2.6 4区 工程技术 Q3 ENERGY & FUELS
Libo Ma, Hongshan Zhao, Sichao Pan
{"title":"基于 MO-TD3 的质子交换膜电解槽温度控制研究","authors":"Libo Ma,&nbsp;Hongshan Zhao,&nbsp;Sichao Pan","doi":"10.1049/rpg2.12997","DOIUrl":null,"url":null,"abstract":"<p>To solve the problem of temperature control in proton exchange membrane electrolytic cell (PEMEC), this paper presents a temperature control method based on multi-experience pool probability playback and Ornstein-Uhlenbeck noise-twin delay depth deterministic strategy gradient. Firstly, considering the influence of water supply, anode and cathode pressure, and natural heat dissipation on temperature, a refined thermal model of PEMEC is established and transformed into a Markov model under the framework of deep reinforcement learning (DRL). Then, to solve the training instability and poor control effect of DRL caused by inertia delay of the PEMEC temperature control system, multi-empirical pool probability playback and Ornstein-Uhlenbeck random process noise techniques are introduced on the basis of the traditional DRL method. Finally, the simulation and hardware-in-the-loop experience results show that the proposed method outperforms other advanced methods.</p>","PeriodicalId":55000,"journal":{"name":"IET Renewable Power Generation","volume":"18 9-10","pages":"1597-1610"},"PeriodicalIF":2.6000,"publicationDate":"2024-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/rpg2.12997","citationCount":"0","resultStr":"{\"title\":\"Research on temperature control of proton exchange membrane electrolysis cell based on MO-TD3\",\"authors\":\"Libo Ma,&nbsp;Hongshan Zhao,&nbsp;Sichao Pan\",\"doi\":\"10.1049/rpg2.12997\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>To solve the problem of temperature control in proton exchange membrane electrolytic cell (PEMEC), this paper presents a temperature control method based on multi-experience pool probability playback and Ornstein-Uhlenbeck noise-twin delay depth deterministic strategy gradient. Firstly, considering the influence of water supply, anode and cathode pressure, and natural heat dissipation on temperature, a refined thermal model of PEMEC is established and transformed into a Markov model under the framework of deep reinforcement learning (DRL). Then, to solve the training instability and poor control effect of DRL caused by inertia delay of the PEMEC temperature control system, multi-empirical pool probability playback and Ornstein-Uhlenbeck random process noise techniques are introduced on the basis of the traditional DRL method. Finally, the simulation and hardware-in-the-loop experience results show that the proposed method outperforms other advanced methods.</p>\",\"PeriodicalId\":55000,\"journal\":{\"name\":\"IET Renewable Power Generation\",\"volume\":\"18 9-10\",\"pages\":\"1597-1610\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2024-05-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1049/rpg2.12997\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IET Renewable Power Generation\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1049/rpg2.12997\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENERGY & FUELS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Renewable Power Generation","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/rpg2.12997","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
引用次数: 0

摘要

为解决质子交换膜电解槽(PEMEC)的温度控制问题,本文提出了一种基于多经验池概率回放和Ornstein-Uhlenbeck噪声-双延迟深度确定性策略梯度的温度控制方法。首先,考虑供水、正负极压力和自然散热对温度的影响,建立了 PEMEC 的精细热模型,并在深度强化学习(DRL)框架下将其转化为马尔可夫模型。然后,为了解决 PEMEC 温控系统惯性延迟导致的 DRL 训练不稳定和控制效果差的问题,在传统 DRL 方法的基础上引入了多经验池概率回放和 Ornstein-Uhlenbeck 随机过程噪声技术。最后,仿真和硬件在环体验结果表明,所提出的方法优于其他先进方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Research on temperature control of proton exchange membrane electrolysis cell based on MO-TD3

Research on temperature control of proton exchange membrane electrolysis cell based on MO-TD3

To solve the problem of temperature control in proton exchange membrane electrolytic cell (PEMEC), this paper presents a temperature control method based on multi-experience pool probability playback and Ornstein-Uhlenbeck noise-twin delay depth deterministic strategy gradient. Firstly, considering the influence of water supply, anode and cathode pressure, and natural heat dissipation on temperature, a refined thermal model of PEMEC is established and transformed into a Markov model under the framework of deep reinforcement learning (DRL). Then, to solve the training instability and poor control effect of DRL caused by inertia delay of the PEMEC temperature control system, multi-empirical pool probability playback and Ornstein-Uhlenbeck random process noise techniques are introduced on the basis of the traditional DRL method. Finally, the simulation and hardware-in-the-loop experience results show that the proposed method outperforms other advanced methods.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IET Renewable Power Generation
IET Renewable Power Generation 工程技术-工程:电子与电气
CiteScore
6.80
自引率
11.50%
发文量
268
审稿时长
6.6 months
期刊介绍: IET Renewable Power Generation (RPG) brings together the topics of renewable energy technology, power generation and systems integration, with techno-economic issues. All renewable energy generation technologies are within the scope of the journal. Specific technology areas covered by the journal include: Wind power technology and systems Photovoltaics Solar thermal power generation Geothermal energy Fuel cells Wave power Marine current energy Biomass conversion and power generation What differentiates RPG from technology specific journals is a concern with power generation and how the characteristics of the different renewable sources affect electrical power conversion, including power electronic design, integration in to power systems, and techno-economic issues. Other technologies that have a direct role in sustainable power generation such as fuel cells and energy storage are also covered, as are system control approaches such as demand side management, which facilitate the integration of renewable sources into power systems, both large and small. The journal provides a forum for the presentation of new research, development and applications of renewable power generation. Demonstrations and experimentally based research are particularly valued, and modelling studies should as far as possible be validated so as to give confidence that the models are representative of real-world behavior. Research that explores issues where the characteristics of the renewable energy source and their control impact on the power conversion is welcome. Papers covering the wider areas of power system control and operation, including scheduling and protection that are central to the challenge of renewable power integration are particularly encouraged. The journal is technology focused covering design, demonstration, modelling and analysis, but papers covering techno-economic issues are also of interest. Papers presenting new modelling and theory are welcome but this must be relevant to real power systems and power generation. Most papers are expected to include significant novelty of approach or application that has general applicability, and where appropriate include experimental results. Critical reviews of relevant topics are also invited and these would be expected to be comprehensive and fully referenced. Current Special Issue. Call for papers: Power Quality and Protection in Renewable Energy Systems and Microgrids - https://digital-library.theiet.org/files/IET_RPG_CFP_PQPRESM.pdf Energy and Rail/Road Transportation Integrated Development - https://digital-library.theiet.org/files/IET_RPG_CFP_ERTID.pdf
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信