Dongbao Jia, Ming Cao, Jing Sun, Feimeng Wang, Wei Xu, Yichen Wang
{"title":"基于元学习和增强型近端策略优化的岛屿集成能源系统区间约束多目标优化调度方法","authors":"Dongbao Jia, Ming Cao, Jing Sun, Feimeng Wang, Wei Xu, Yichen Wang","doi":"10.3390/electronics13173579","DOIUrl":null,"url":null,"abstract":"Multiple uncertainties from source–load and energy conversion significantly impact the real-time dispatch of an island integrated energy system (IIES). This paper addresses the day-ahead scheduling problems of IIES under these conditions, aiming to minimize daily economic costs and maximize the output of renewable energies. We introduce an innovative algorithm for Interval Constrained Multi-objective Optimization Problems (ICMOPs), which incorporates meta-learning and an improved Proximal Policy Optimization with Clipped Objective (PPO-CLIP) approach. This algorithm fills a notable gap in the application of DRL to complex ICMOPs within the field. Initially, the multi-objective problem is decomposed into several single-objective problems using a uniform weight decomposition method. A meta-model trained via meta-learning enables fine-tuning to adapt solutions for subsidiary problems once the initial training is complete. Additionally, we enhance the PPO-CLIP framework with a novel strategy that integrates probability shifts and Generalized Advantage Estimation (GAE). In the final stage of scheduling plan selection, a technique for identifying interval turning points is employed to choose the optimal plan from the Pareto solution set. The results demonstrate that the method not only secures excellent scheduling solutions in complex environments through its robust generalization capabilities but also shows significant improvements over interval-constrained multi-objective evolutionary algorithms, such as IP-MOEA, ICMOABC, and IMOMA-II, across multiple multi-objective evaluation metrics including hypervolume (HV), runtime, and uncertainty.","PeriodicalId":11646,"journal":{"name":"Electronics","volume":null,"pages":null},"PeriodicalIF":2.6000,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Interval Constrained Multi-Objective Optimization Scheduling Method for Island-Integrated Energy Systems Based on Meta-Learning and Enhanced Proximal Policy Optimization\",\"authors\":\"Dongbao Jia, Ming Cao, Jing Sun, Feimeng Wang, Wei Xu, Yichen Wang\",\"doi\":\"10.3390/electronics13173579\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Multiple uncertainties from source–load and energy conversion significantly impact the real-time dispatch of an island integrated energy system (IIES). This paper addresses the day-ahead scheduling problems of IIES under these conditions, aiming to minimize daily economic costs and maximize the output of renewable energies. We introduce an innovative algorithm for Interval Constrained Multi-objective Optimization Problems (ICMOPs), which incorporates meta-learning and an improved Proximal Policy Optimization with Clipped Objective (PPO-CLIP) approach. This algorithm fills a notable gap in the application of DRL to complex ICMOPs within the field. Initially, the multi-objective problem is decomposed into several single-objective problems using a uniform weight decomposition method. A meta-model trained via meta-learning enables fine-tuning to adapt solutions for subsidiary problems once the initial training is complete. Additionally, we enhance the PPO-CLIP framework with a novel strategy that integrates probability shifts and Generalized Advantage Estimation (GAE). In the final stage of scheduling plan selection, a technique for identifying interval turning points is employed to choose the optimal plan from the Pareto solution set. The results demonstrate that the method not only secures excellent scheduling solutions in complex environments through its robust generalization capabilities but also shows significant improvements over interval-constrained multi-objective evolutionary algorithms, such as IP-MOEA, ICMOABC, and IMOMA-II, across multiple multi-objective evaluation metrics including hypervolume (HV), runtime, and uncertainty.\",\"PeriodicalId\":11646,\"journal\":{\"name\":\"Electronics\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2024-09-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Electronics\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.3390/electronics13173579\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Electronics","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.3390/electronics13173579","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
Interval Constrained Multi-Objective Optimization Scheduling Method for Island-Integrated Energy Systems Based on Meta-Learning and Enhanced Proximal Policy Optimization
Multiple uncertainties from source–load and energy conversion significantly impact the real-time dispatch of an island integrated energy system (IIES). This paper addresses the day-ahead scheduling problems of IIES under these conditions, aiming to minimize daily economic costs and maximize the output of renewable energies. We introduce an innovative algorithm for Interval Constrained Multi-objective Optimization Problems (ICMOPs), which incorporates meta-learning and an improved Proximal Policy Optimization with Clipped Objective (PPO-CLIP) approach. This algorithm fills a notable gap in the application of DRL to complex ICMOPs within the field. Initially, the multi-objective problem is decomposed into several single-objective problems using a uniform weight decomposition method. A meta-model trained via meta-learning enables fine-tuning to adapt solutions for subsidiary problems once the initial training is complete. Additionally, we enhance the PPO-CLIP framework with a novel strategy that integrates probability shifts and Generalized Advantage Estimation (GAE). In the final stage of scheduling plan selection, a technique for identifying interval turning points is employed to choose the optimal plan from the Pareto solution set. The results demonstrate that the method not only secures excellent scheduling solutions in complex environments through its robust generalization capabilities but also shows significant improvements over interval-constrained multi-objective evolutionary algorithms, such as IP-MOEA, ICMOABC, and IMOMA-II, across multiple multi-objective evaluation metrics including hypervolume (HV), runtime, and uncertainty.
ElectronicsComputer Science-Computer Networks and Communications
CiteScore
1.10
自引率
10.30%
发文量
3515
审稿时长
16.71 days
期刊介绍:
Electronics (ISSN 2079-9292; CODEN: ELECGJ) is an international, open access journal on the science of electronics and its applications published quarterly online by MDPI.