Roozbeh Ghasemi , Gersi Doko , Marek Petrik , Martin Wosnik , Zhongming Lu , Diane L. Foster , Weiwei Mo
{"title":"基于深度强化学习的孤岛能水微网系统优化","authors":"Roozbeh Ghasemi , Gersi Doko , Marek Petrik , Martin Wosnik , Zhongming Lu , Diane L. Foster , Weiwei Mo","doi":"10.1016/j.resconrec.2025.108440","DOIUrl":null,"url":null,"abstract":"<div><div>Islanded microgrids often struggle with limited resources and heavy reliance on fossil fuels. This study optimizes an island energy-water microgrid using reinforcement learning (RL) to schedule the water system as a virtual battery. Using the Shoals Marine Laboratory microgrid as a testbed, a dynamic model simulating water and energy interactions was integrated with an RL algorithm to improve profit, sustainability, and reliability. The RL scenario outperformed the status quo, leading to a 7.04 % overall improvement in the equally weighted total score. It also exceeded a single-objective, heuristic management approach in profit and reliability, though slightly reducing sustainability. The RL model strategically reserves battery storage for peak renewable energy generation and extends water system operation to circumvent pumping constraints. Increasing desalination rates further improved performance, while larger water tank capacity offered minimal advantages. Future research may expand RL decision space to incorporate energy system actions for enhanced benefits.</div></div>","PeriodicalId":21153,"journal":{"name":"Resources Conservation and Recycling","volume":"222 ","pages":"Article 108440"},"PeriodicalIF":11.2000,"publicationDate":"2025-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep reinforcement learning-based optimization of an island energy-water microgrid system\",\"authors\":\"Roozbeh Ghasemi , Gersi Doko , Marek Petrik , Martin Wosnik , Zhongming Lu , Diane L. Foster , Weiwei Mo\",\"doi\":\"10.1016/j.resconrec.2025.108440\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Islanded microgrids often struggle with limited resources and heavy reliance on fossil fuels. This study optimizes an island energy-water microgrid using reinforcement learning (RL) to schedule the water system as a virtual battery. Using the Shoals Marine Laboratory microgrid as a testbed, a dynamic model simulating water and energy interactions was integrated with an RL algorithm to improve profit, sustainability, and reliability. The RL scenario outperformed the status quo, leading to a 7.04 % overall improvement in the equally weighted total score. It also exceeded a single-objective, heuristic management approach in profit and reliability, though slightly reducing sustainability. The RL model strategically reserves battery storage for peak renewable energy generation and extends water system operation to circumvent pumping constraints. Increasing desalination rates further improved performance, while larger water tank capacity offered minimal advantages. Future research may expand RL decision space to incorporate energy system actions for enhanced benefits.</div></div>\",\"PeriodicalId\":21153,\"journal\":{\"name\":\"Resources Conservation and Recycling\",\"volume\":\"222 \",\"pages\":\"Article 108440\"},\"PeriodicalIF\":11.2000,\"publicationDate\":\"2025-06-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Resources Conservation and Recycling\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0921344925003180\",\"RegionNum\":1,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ENVIRONMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Resources Conservation and Recycling","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0921344925003180","RegionNum":1,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ENVIRONMENTAL","Score":null,"Total":0}
Deep reinforcement learning-based optimization of an island energy-water microgrid system
Islanded microgrids often struggle with limited resources and heavy reliance on fossil fuels. This study optimizes an island energy-water microgrid using reinforcement learning (RL) to schedule the water system as a virtual battery. Using the Shoals Marine Laboratory microgrid as a testbed, a dynamic model simulating water and energy interactions was integrated with an RL algorithm to improve profit, sustainability, and reliability. The RL scenario outperformed the status quo, leading to a 7.04 % overall improvement in the equally weighted total score. It also exceeded a single-objective, heuristic management approach in profit and reliability, though slightly reducing sustainability. The RL model strategically reserves battery storage for peak renewable energy generation and extends water system operation to circumvent pumping constraints. Increasing desalination rates further improved performance, while larger water tank capacity offered minimal advantages. Future research may expand RL decision space to incorporate energy system actions for enhanced benefits.
期刊介绍:
The journal Resources, Conservation & Recycling welcomes contributions from research, which consider sustainable management and conservation of resources. The journal prioritizes understanding the transformation processes crucial for transitioning toward more sustainable production and consumption systems. It highlights technological, economic, institutional, and policy aspects related to specific resource management practices such as conservation, recycling, and resource substitution, as well as broader strategies like improving resource productivity and restructuring production and consumption patterns.
Contributions may address regional, national, or international scales and can range from individual resources or technologies to entire sectors or systems. Authors are encouraged to explore scientific and methodological issues alongside practical, environmental, and economic implications. However, manuscripts focusing solely on laboratory experiments without discussing their broader implications will not be considered for publication in the journal.