Kuo Wang, Zhanqiang Zhang, Keqilao Meng, Pengbing Lei, Rui Wang, Wenlu Yang, Zhihua Lin
{"title":"基于 GAIL 和 Wasserstein 距离的微电网优化能源调度","authors":"Kuo Wang, Zhanqiang Zhang, Keqilao Meng, Pengbing Lei, Rui Wang, Wenlu Yang, Zhihua Lin","doi":"10.1063/5.0207444","DOIUrl":null,"url":null,"abstract":"Owing to the volatility and intermittency of renewable energy generation units in microgrids, effective energy scheduling methods are essential for efficient renewable energy utilization and stable microgrid operation. In recent years, microgrid energy optimization scheduling based on deep reinforcement learning (DRL) has made significant progress. With the development of the microgrid, the drawbacks of the traditional DRL agent, such as long training time and poor convergence effect, are gradually revealed. This paper proposes a generative adversarial imitation learning method with Wasserstein distance for optimal energy scheduling in the microgrid. This method combines a proximal policy optimization algorithm to optimize energy scheduling and reduce microgrid operating costs. First, the agent adaptively learns the action exploration process by imitating expert trajectories. Second, based on the generative adversarial theory, a discriminator network is added, and the Wasserstein distance is introduced into the discriminator network to distinguish between the generative and expert strategies. This feedback assists in updating the neural network parameters. Finally, the effectiveness of the proposed method is verified through an arithmetic example analysis.","PeriodicalId":7619,"journal":{"name":"AIP Advances","volume":null,"pages":null},"PeriodicalIF":1.4000,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Optimal energy scheduling for microgrid based on GAIL with Wasserstein distance\",\"authors\":\"Kuo Wang, Zhanqiang Zhang, Keqilao Meng, Pengbing Lei, Rui Wang, Wenlu Yang, Zhihua Lin\",\"doi\":\"10.1063/5.0207444\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Owing to the volatility and intermittency of renewable energy generation units in microgrids, effective energy scheduling methods are essential for efficient renewable energy utilization and stable microgrid operation. In recent years, microgrid energy optimization scheduling based on deep reinforcement learning (DRL) has made significant progress. With the development of the microgrid, the drawbacks of the traditional DRL agent, such as long training time and poor convergence effect, are gradually revealed. This paper proposes a generative adversarial imitation learning method with Wasserstein distance for optimal energy scheduling in the microgrid. This method combines a proximal policy optimization algorithm to optimize energy scheduling and reduce microgrid operating costs. First, the agent adaptively learns the action exploration process by imitating expert trajectories. Second, based on the generative adversarial theory, a discriminator network is added, and the Wasserstein distance is introduced into the discriminator network to distinguish between the generative and expert strategies. This feedback assists in updating the neural network parameters. Finally, the effectiveness of the proposed method is verified through an arithmetic example analysis.\",\"PeriodicalId\":7619,\"journal\":{\"name\":\"AIP Advances\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.4000,\"publicationDate\":\"2024-08-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"AIP Advances\",\"FirstCategoryId\":\"88\",\"ListUrlMain\":\"https://doi.org/10.1063/5.0207444\",\"RegionNum\":4,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"MATERIALS SCIENCE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"AIP Advances","FirstCategoryId":"88","ListUrlMain":"https://doi.org/10.1063/5.0207444","RegionNum":4,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"MATERIALS SCIENCE, MULTIDISCIPLINARY","Score":null,"Total":0}
Optimal energy scheduling for microgrid based on GAIL with Wasserstein distance
Owing to the volatility and intermittency of renewable energy generation units in microgrids, effective energy scheduling methods are essential for efficient renewable energy utilization and stable microgrid operation. In recent years, microgrid energy optimization scheduling based on deep reinforcement learning (DRL) has made significant progress. With the development of the microgrid, the drawbacks of the traditional DRL agent, such as long training time and poor convergence effect, are gradually revealed. This paper proposes a generative adversarial imitation learning method with Wasserstein distance for optimal energy scheduling in the microgrid. This method combines a proximal policy optimization algorithm to optimize energy scheduling and reduce microgrid operating costs. First, the agent adaptively learns the action exploration process by imitating expert trajectories. Second, based on the generative adversarial theory, a discriminator network is added, and the Wasserstein distance is introduced into the discriminator network to distinguish between the generative and expert strategies. This feedback assists in updating the neural network parameters. Finally, the effectiveness of the proposed method is verified through an arithmetic example analysis.
期刊介绍:
AIP Advances is an open access journal publishing in all areas of physical sciences—applied, theoretical, and experimental. All published articles are freely available to read, download, and share. The journal prides itself on the belief that all good science is important and relevant. Our inclusive scope and publication standards make it an essential outlet for scientists in the physical sciences.
AIP Advances is a community-based journal, with a fast production cycle. The quick publication process and open-access model allows us to quickly distribute new scientific concepts. Our Editors, assisted by peer review, determine whether a manuscript is technically correct and original. After publication, the readership evaluates whether a manuscript is timely, relevant, or significant.