Hangyu Wang, Shukai He, Jie Yan, Shuang Han, Yongqian Liu
{"title":"考虑动态风的深度强化学习驱动风电场流量控制","authors":"Hangyu Wang, Shukai He, Jie Yan, Shuang Han, Yongqian Liu","doi":"10.1016/j.enconman.2025.119888","DOIUrl":null,"url":null,"abstract":"<div><div>Mitigating power losses caused by the wake effect is crucial for improving the efficiency of operational wind farms. Wind farm flow control represents a key approach to achieving this objective. However, dynamic wind conditions, including variations in wind speed and direction, along with environmental uncertainties, present significant challenges to effective flow control. To address these challenges, this paper proposes a wind farm flow control method via deep reinforcement learning that considers dynamic wind. Initially, dynamic wind fluctuation characteristics are extracted from LiDAR-measured data, which provides a comprehensive dataset. Subsequently, a flow control method is developed, using dynamic wind as input to maximize wind farm power output through yaw angle adjustments. Finally, the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm is introduced to drive a control model for real-time optimization and online learning. The model is capable of addressing uncertainties through experience replay and exploration mechanisms. Simulation results demonstrate that optimization considering mean wind is effective only when the wind direction standard deviation is below 4, whereas optimization considering dynamic wind is effective across all wind conditions. Considering dynamic wind results in a 3.3% improvement in power generation compared to optimization considering mean wind.</div></div>","PeriodicalId":11664,"journal":{"name":"Energy Conversion and Management","volume":"337 ","pages":"Article 119888"},"PeriodicalIF":9.9000,"publicationDate":"2025-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep reinforcement learning-driven wind farm flow control considering dynamic wind\",\"authors\":\"Hangyu Wang, Shukai He, Jie Yan, Shuang Han, Yongqian Liu\",\"doi\":\"10.1016/j.enconman.2025.119888\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Mitigating power losses caused by the wake effect is crucial for improving the efficiency of operational wind farms. Wind farm flow control represents a key approach to achieving this objective. However, dynamic wind conditions, including variations in wind speed and direction, along with environmental uncertainties, present significant challenges to effective flow control. To address these challenges, this paper proposes a wind farm flow control method via deep reinforcement learning that considers dynamic wind. Initially, dynamic wind fluctuation characteristics are extracted from LiDAR-measured data, which provides a comprehensive dataset. Subsequently, a flow control method is developed, using dynamic wind as input to maximize wind farm power output through yaw angle adjustments. Finally, the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm is introduced to drive a control model for real-time optimization and online learning. The model is capable of addressing uncertainties through experience replay and exploration mechanisms. Simulation results demonstrate that optimization considering mean wind is effective only when the wind direction standard deviation is below 4, whereas optimization considering dynamic wind is effective across all wind conditions. Considering dynamic wind results in a 3.3% improvement in power generation compared to optimization considering mean wind.</div></div>\",\"PeriodicalId\":11664,\"journal\":{\"name\":\"Energy Conversion and Management\",\"volume\":\"337 \",\"pages\":\"Article 119888\"},\"PeriodicalIF\":9.9000,\"publicationDate\":\"2025-05-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Energy Conversion and Management\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0196890425004121\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENERGY & FUELS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Energy Conversion and Management","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0196890425004121","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
Deep reinforcement learning-driven wind farm flow control considering dynamic wind
Mitigating power losses caused by the wake effect is crucial for improving the efficiency of operational wind farms. Wind farm flow control represents a key approach to achieving this objective. However, dynamic wind conditions, including variations in wind speed and direction, along with environmental uncertainties, present significant challenges to effective flow control. To address these challenges, this paper proposes a wind farm flow control method via deep reinforcement learning that considers dynamic wind. Initially, dynamic wind fluctuation characteristics are extracted from LiDAR-measured data, which provides a comprehensive dataset. Subsequently, a flow control method is developed, using dynamic wind as input to maximize wind farm power output through yaw angle adjustments. Finally, the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm is introduced to drive a control model for real-time optimization and online learning. The model is capable of addressing uncertainties through experience replay and exploration mechanisms. Simulation results demonstrate that optimization considering mean wind is effective only when the wind direction standard deviation is below 4, whereas optimization considering dynamic wind is effective across all wind conditions. Considering dynamic wind results in a 3.3% improvement in power generation compared to optimization considering mean wind.
期刊介绍:
The journal Energy Conversion and Management provides a forum for publishing original contributions and comprehensive technical review articles of interdisciplinary and original research on all important energy topics.
The topics considered include energy generation, utilization, conversion, storage, transmission, conservation, management and sustainability. These topics typically involve various types of energy such as mechanical, thermal, nuclear, chemical, electromagnetic, magnetic and electric. These energy types cover all known energy resources, including renewable resources (e.g., solar, bio, hydro, wind, geothermal and ocean energy), fossil fuels and nuclear resources.