结合计算流体力学和深度强化学习的不规则波环境中点吸收波能转换器的闭锁控制

IF 10.1 1区 工程技术 Q1 ENERGY & FUELS
Hao Qin , Haowen Su , Zhixuan Wen , Hongjian Liang
{"title":"结合计算流体力学和深度强化学习的不规则波环境中点吸收波能转换器的闭锁控制","authors":"Hao Qin ,&nbsp;Haowen Su ,&nbsp;Zhixuan Wen ,&nbsp;Hongjian Liang","doi":"10.1016/j.apenergy.2025.126282","DOIUrl":null,"url":null,"abstract":"<div><div>This paper proposes a novel latching control model coupling Computational fluid dynamics (CFD) and Deep Reinforcement Learning (DRL) to improve the wave energy capture performance of a point absorber wave energy converter (WEC). Firstly, a numerical wave flume (NWF) is built to generate unpredicted irregular waves. That simulates the two-way coupling interaction between the WEC and waves based on CFD, which creates the nonlinear environmental state space for the DRL input. In the meanwhile, a training method based on the Soft Actor-Critic (SAC) algorithm without explicit parameter adjustment is designed to implement a non-predictive latching control agent. Secondly, using the CFD-DRL coupling model, training for the latching control strategy is conducted in parallel irregular wave environments, and three state space configurations are evaluated to enhance the agent's generalization ability. Lastly, the wave energy capture performance using the proposed latching control model is compared with a traditional real-time latching method, and comparative analysis of two different training approaches is carried out. Simulation results show that the proposed latching control model outperforms the traditional real-time latching method in tests under irregular waves with different wave heights and frequencies, stably achieving more than 30 % wave energy conversion efficiency. This paper highlights the applicability and advancement of the DRL method applied in intelligent control of WECs, which may provide new insights for the wave energy and ocean engineering industries.</div></div>","PeriodicalId":246,"journal":{"name":"Applied Energy","volume":"396 ","pages":"Article 126282"},"PeriodicalIF":10.1000,"publicationDate":"2025-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Latching control of a point absorber wave energy converter in irregular wave environments coupling computational fluid dynamics and deep reinforcement learning\",\"authors\":\"Hao Qin ,&nbsp;Haowen Su ,&nbsp;Zhixuan Wen ,&nbsp;Hongjian Liang\",\"doi\":\"10.1016/j.apenergy.2025.126282\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>This paper proposes a novel latching control model coupling Computational fluid dynamics (CFD) and Deep Reinforcement Learning (DRL) to improve the wave energy capture performance of a point absorber wave energy converter (WEC). Firstly, a numerical wave flume (NWF) is built to generate unpredicted irregular waves. That simulates the two-way coupling interaction between the WEC and waves based on CFD, which creates the nonlinear environmental state space for the DRL input. In the meanwhile, a training method based on the Soft Actor-Critic (SAC) algorithm without explicit parameter adjustment is designed to implement a non-predictive latching control agent. Secondly, using the CFD-DRL coupling model, training for the latching control strategy is conducted in parallel irregular wave environments, and three state space configurations are evaluated to enhance the agent's generalization ability. Lastly, the wave energy capture performance using the proposed latching control model is compared with a traditional real-time latching method, and comparative analysis of two different training approaches is carried out. Simulation results show that the proposed latching control model outperforms the traditional real-time latching method in tests under irregular waves with different wave heights and frequencies, stably achieving more than 30 % wave energy conversion efficiency. This paper highlights the applicability and advancement of the DRL method applied in intelligent control of WECs, which may provide new insights for the wave energy and ocean engineering industries.</div></div>\",\"PeriodicalId\":246,\"journal\":{\"name\":\"Applied Energy\",\"volume\":\"396 \",\"pages\":\"Article 126282\"},\"PeriodicalIF\":10.1000,\"publicationDate\":\"2025-06-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Energy\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0306261925010128\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENERGY & FUELS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Energy","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0306261925010128","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
引用次数: 0

摘要

为了提高点吸收波能转换器(WEC)的波能捕获性能,提出了一种结合计算流体力学(CFD)和深度强化学习(DRL)的锁存控制模型。首先,建立数值波浪水槽(NWF)来产生不可预测的不规则波浪。基于CFD模拟了WEC与波浪之间的双向耦合相互作用,为DRL输入创建了非线性环境状态空间。同时,设计了一种基于SAC (Soft Actor-Critic)算法的无显式参数调整训练方法,实现了非预测闭锁控制代理。其次,利用CFD-DRL耦合模型,在并行的不规则波环境中对闭锁控制策略进行训练,并对三种状态空间构型进行评估,增强智能体的泛化能力;最后,将所提出的锁存控制模型与传统的实时锁存控制方法进行了波能捕获性能的比较,并对两种不同的训练方法进行了对比分析。仿真结果表明,该锁存控制模型在不同波高和频率的不规则波下的测试中优于传统的实时锁存控制方法,稳定地实现了30%以上的波能转换效率。本文重点介绍了DRL方法在微气泡水智能控制中的适用性和先进性,为波浪能和海洋工程行业提供了新的思路。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Latching control of a point absorber wave energy converter in irregular wave environments coupling computational fluid dynamics and deep reinforcement learning
This paper proposes a novel latching control model coupling Computational fluid dynamics (CFD) and Deep Reinforcement Learning (DRL) to improve the wave energy capture performance of a point absorber wave energy converter (WEC). Firstly, a numerical wave flume (NWF) is built to generate unpredicted irregular waves. That simulates the two-way coupling interaction between the WEC and waves based on CFD, which creates the nonlinear environmental state space for the DRL input. In the meanwhile, a training method based on the Soft Actor-Critic (SAC) algorithm without explicit parameter adjustment is designed to implement a non-predictive latching control agent. Secondly, using the CFD-DRL coupling model, training for the latching control strategy is conducted in parallel irregular wave environments, and three state space configurations are evaluated to enhance the agent's generalization ability. Lastly, the wave energy capture performance using the proposed latching control model is compared with a traditional real-time latching method, and comparative analysis of two different training approaches is carried out. Simulation results show that the proposed latching control model outperforms the traditional real-time latching method in tests under irregular waves with different wave heights and frequencies, stably achieving more than 30 % wave energy conversion efficiency. This paper highlights the applicability and advancement of the DRL method applied in intelligent control of WECs, which may provide new insights for the wave energy and ocean engineering industries.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Applied Energy
Applied Energy 工程技术-工程:化工
CiteScore
21.20
自引率
10.70%
发文量
1830
审稿时长
41 days
期刊介绍: Applied Energy serves as a platform for sharing innovations, research, development, and demonstrations in energy conversion, conservation, and sustainable energy systems. The journal covers topics such as optimal energy resource use, environmental pollutant mitigation, and energy process analysis. It welcomes original papers, review articles, technical notes, and letters to the editor. Authors are encouraged to submit manuscripts that bridge the gap between research, development, and implementation. The journal addresses a wide spectrum of topics, including fossil and renewable energy technologies, energy economics, and environmental impacts. Applied Energy also explores modeling and forecasting, conservation strategies, and the social and economic implications of energy policies, including climate change mitigation. It is complemented by the open-access journal Advances in Applied Energy.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信