{"title":"基于 MO-TD3 的质子交换膜电解槽温度控制研究","authors":"Libo Ma, Hongshan Zhao, Sichao Pan","doi":"10.1049/rpg2.12997","DOIUrl":null,"url":null,"abstract":"<p>To solve the problem of temperature control in proton exchange membrane electrolytic cell (PEMEC), this paper presents a temperature control method based on multi-experience pool probability playback and Ornstein-Uhlenbeck noise-twin delay depth deterministic strategy gradient. Firstly, considering the influence of water supply, anode and cathode pressure, and natural heat dissipation on temperature, a refined thermal model of PEMEC is established and transformed into a Markov model under the framework of deep reinforcement learning (DRL). Then, to solve the training instability and poor control effect of DRL caused by inertia delay of the PEMEC temperature control system, multi-empirical pool probability playback and Ornstein-Uhlenbeck random process noise techniques are introduced on the basis of the traditional DRL method. Finally, the simulation and hardware-in-the-loop experience results show that the proposed method outperforms other advanced methods.</p>","PeriodicalId":55000,"journal":{"name":"IET Renewable Power Generation","volume":"18 9-10","pages":"1597-1610"},"PeriodicalIF":2.6000,"publicationDate":"2024-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/rpg2.12997","citationCount":"0","resultStr":"{\"title\":\"Research on temperature control of proton exchange membrane electrolysis cell based on MO-TD3\",\"authors\":\"Libo Ma, Hongshan Zhao, Sichao Pan\",\"doi\":\"10.1049/rpg2.12997\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>To solve the problem of temperature control in proton exchange membrane electrolytic cell (PEMEC), this paper presents a temperature control method based on multi-experience pool probability playback and Ornstein-Uhlenbeck noise-twin delay depth deterministic strategy gradient. Firstly, considering the influence of water supply, anode and cathode pressure, and natural heat dissipation on temperature, a refined thermal model of PEMEC is established and transformed into a Markov model under the framework of deep reinforcement learning (DRL). Then, to solve the training instability and poor control effect of DRL caused by inertia delay of the PEMEC temperature control system, multi-empirical pool probability playback and Ornstein-Uhlenbeck random process noise techniques are introduced on the basis of the traditional DRL method. Finally, the simulation and hardware-in-the-loop experience results show that the proposed method outperforms other advanced methods.</p>\",\"PeriodicalId\":55000,\"journal\":{\"name\":\"IET Renewable Power Generation\",\"volume\":\"18 9-10\",\"pages\":\"1597-1610\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2024-05-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1049/rpg2.12997\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IET Renewable Power Generation\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1049/rpg2.12997\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENERGY & FUELS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Renewable Power Generation","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/rpg2.12997","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
Research on temperature control of proton exchange membrane electrolysis cell based on MO-TD3
To solve the problem of temperature control in proton exchange membrane electrolytic cell (PEMEC), this paper presents a temperature control method based on multi-experience pool probability playback and Ornstein-Uhlenbeck noise-twin delay depth deterministic strategy gradient. Firstly, considering the influence of water supply, anode and cathode pressure, and natural heat dissipation on temperature, a refined thermal model of PEMEC is established and transformed into a Markov model under the framework of deep reinforcement learning (DRL). Then, to solve the training instability and poor control effect of DRL caused by inertia delay of the PEMEC temperature control system, multi-empirical pool probability playback and Ornstein-Uhlenbeck random process noise techniques are introduced on the basis of the traditional DRL method. Finally, the simulation and hardware-in-the-loop experience results show that the proposed method outperforms other advanced methods.
期刊介绍:
IET Renewable Power Generation (RPG) brings together the topics of renewable energy technology, power generation and systems integration, with techno-economic issues. All renewable energy generation technologies are within the scope of the journal.
Specific technology areas covered by the journal include:
Wind power technology and systems
Photovoltaics
Solar thermal power generation
Geothermal energy
Fuel cells
Wave power
Marine current energy
Biomass conversion and power generation
What differentiates RPG from technology specific journals is a concern with power generation and how the characteristics of the different renewable sources affect electrical power conversion, including power electronic design, integration in to power systems, and techno-economic issues. Other technologies that have a direct role in sustainable power generation such as fuel cells and energy storage are also covered, as are system control approaches such as demand side management, which facilitate the integration of renewable sources into power systems, both large and small.
The journal provides a forum for the presentation of new research, development and applications of renewable power generation. Demonstrations and experimentally based research are particularly valued, and modelling studies should as far as possible be validated so as to give confidence that the models are representative of real-world behavior. Research that explores issues where the characteristics of the renewable energy source and their control impact on the power conversion is welcome. Papers covering the wider areas of power system control and operation, including scheduling and protection that are central to the challenge of renewable power integration are particularly encouraged.
The journal is technology focused covering design, demonstration, modelling and analysis, but papers covering techno-economic issues are also of interest. Papers presenting new modelling and theory are welcome but this must be relevant to real power systems and power generation. Most papers are expected to include significant novelty of approach or application that has general applicability, and where appropriate include experimental results. Critical reviews of relevant topics are also invited and these would be expected to be comprehensive and fully referenced.
Current Special Issue. Call for papers:
Power Quality and Protection in Renewable Energy Systems and Microgrids - https://digital-library.theiet.org/files/IET_RPG_CFP_PQPRESM.pdf
Energy and Rail/Road Transportation Integrated Development - https://digital-library.theiet.org/files/IET_RPG_CFP_ERTID.pdf