基于深度强化学习的孤岛能水微网系统优化

IF 11.2 1区 环境科学与生态学 Q1 ENGINEERING, ENVIRONMENTAL
Roozbeh Ghasemi , Gersi Doko , Marek Petrik , Martin Wosnik , Zhongming Lu , Diane L. Foster , Weiwei Mo
{"title":"基于深度强化学习的孤岛能水微网系统优化","authors":"Roozbeh Ghasemi ,&nbsp;Gersi Doko ,&nbsp;Marek Petrik ,&nbsp;Martin Wosnik ,&nbsp;Zhongming Lu ,&nbsp;Diane L. Foster ,&nbsp;Weiwei Mo","doi":"10.1016/j.resconrec.2025.108440","DOIUrl":null,"url":null,"abstract":"<div><div>Islanded microgrids often struggle with limited resources and heavy reliance on fossil fuels. This study optimizes an island energy-water microgrid using reinforcement learning (RL) to schedule the water system as a virtual battery. Using the Shoals Marine Laboratory microgrid as a testbed, a dynamic model simulating water and energy interactions was integrated with an RL algorithm to improve profit, sustainability, and reliability. The RL scenario outperformed the status quo, leading to a 7.04 % overall improvement in the equally weighted total score. It also exceeded a single-objective, heuristic management approach in profit and reliability, though slightly reducing sustainability. The RL model strategically reserves battery storage for peak renewable energy generation and extends water system operation to circumvent pumping constraints. Increasing desalination rates further improved performance, while larger water tank capacity offered minimal advantages. Future research may expand RL decision space to incorporate energy system actions for enhanced benefits.</div></div>","PeriodicalId":21153,"journal":{"name":"Resources Conservation and Recycling","volume":"222 ","pages":"Article 108440"},"PeriodicalIF":11.2000,"publicationDate":"2025-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep reinforcement learning-based optimization of an island energy-water microgrid system\",\"authors\":\"Roozbeh Ghasemi ,&nbsp;Gersi Doko ,&nbsp;Marek Petrik ,&nbsp;Martin Wosnik ,&nbsp;Zhongming Lu ,&nbsp;Diane L. Foster ,&nbsp;Weiwei Mo\",\"doi\":\"10.1016/j.resconrec.2025.108440\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Islanded microgrids often struggle with limited resources and heavy reliance on fossil fuels. This study optimizes an island energy-water microgrid using reinforcement learning (RL) to schedule the water system as a virtual battery. Using the Shoals Marine Laboratory microgrid as a testbed, a dynamic model simulating water and energy interactions was integrated with an RL algorithm to improve profit, sustainability, and reliability. The RL scenario outperformed the status quo, leading to a 7.04 % overall improvement in the equally weighted total score. It also exceeded a single-objective, heuristic management approach in profit and reliability, though slightly reducing sustainability. The RL model strategically reserves battery storage for peak renewable energy generation and extends water system operation to circumvent pumping constraints. Increasing desalination rates further improved performance, while larger water tank capacity offered minimal advantages. Future research may expand RL decision space to incorporate energy system actions for enhanced benefits.</div></div>\",\"PeriodicalId\":21153,\"journal\":{\"name\":\"Resources Conservation and Recycling\",\"volume\":\"222 \",\"pages\":\"Article 108440\"},\"PeriodicalIF\":11.2000,\"publicationDate\":\"2025-06-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Resources Conservation and Recycling\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0921344925003180\",\"RegionNum\":1,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ENVIRONMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Resources Conservation and Recycling","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0921344925003180","RegionNum":1,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ENVIRONMENTAL","Score":null,"Total":0}
引用次数: 0

摘要

孤岛微电网往往面临资源有限和严重依赖化石燃料的困境。本研究利用强化学习(RL)优化岛屿能源-水微电网,将水系统作为虚拟电池进行调度。利用Shoals Marine Laboratory微电网作为测试平台,将模拟水和能量相互作用的动态模型与RL算法集成在一起,以提高利润、可持续性和可靠性。RL方案优于现状,导致平均加权总分的7.04%的总体改善。它在利润和可靠性方面也超过了单一目标的启发式管理方法,尽管略微降低了可持续性。RL模型战略性地为峰值可再生能源发电保留电池存储,并扩展水系统运行以规避抽水限制。提高海水淡化率进一步提高了性能,而更大的水箱容量提供了最小的优势。未来的研究可能会扩大RL的决策空间,以纳入能源系统的行动,以提高效益。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Deep reinforcement learning-based optimization of an island energy-water microgrid system
Islanded microgrids often struggle with limited resources and heavy reliance on fossil fuels. This study optimizes an island energy-water microgrid using reinforcement learning (RL) to schedule the water system as a virtual battery. Using the Shoals Marine Laboratory microgrid as a testbed, a dynamic model simulating water and energy interactions was integrated with an RL algorithm to improve profit, sustainability, and reliability. The RL scenario outperformed the status quo, leading to a 7.04 % overall improvement in the equally weighted total score. It also exceeded a single-objective, heuristic management approach in profit and reliability, though slightly reducing sustainability. The RL model strategically reserves battery storage for peak renewable energy generation and extends water system operation to circumvent pumping constraints. Increasing desalination rates further improved performance, while larger water tank capacity offered minimal advantages. Future research may expand RL decision space to incorporate energy system actions for enhanced benefits.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Resources Conservation and Recycling
Resources Conservation and Recycling 环境科学-工程:环境
CiteScore
22.90
自引率
6.10%
发文量
625
审稿时长
23 days
期刊介绍: The journal Resources, Conservation & Recycling welcomes contributions from research, which consider sustainable management and conservation of resources. The journal prioritizes understanding the transformation processes crucial for transitioning toward more sustainable production and consumption systems. It highlights technological, economic, institutional, and policy aspects related to specific resource management practices such as conservation, recycling, and resource substitution, as well as broader strategies like improving resource productivity and restructuring production and consumption patterns. Contributions may address regional, national, or international scales and can range from individual resources or technologies to entire sectors or systems. Authors are encouraged to explore scientific and methodological issues alongside practical, environmental, and economic implications. However, manuscripts focusing solely on laboratory experiments without discussing their broader implications will not be considered for publication in the journal.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信