{"title":"利用多代理近端政策优化将多微网的碳捕获和利用与点对点能源交易相结合","authors":"Ming Chen;Zhirong Shen;Lin Wang;Guanglin Zhang","doi":"10.1109/TCNS.2024.3393642","DOIUrl":null,"url":null,"abstract":"Microgrids integrated with distributed renewable energy are regarded as a crucial evolution toward economical and environmentally sustainable power systems. Carbon capture and utilization (CCU) technologies and peer-to-peer (P2P) energy trading schemes are two potential strategies for mitigating carbon emissions by capturing the emitted CO<inline-formula><tex-math>$_{2}$</tex-math></inline-formula> or trading surplus renewable energy, respectively. Hence, a collaborative energy scheduling model that combines CCU with P2P energy trading is needed under the coupling of multiple energy domains, including electricity, CO<inline-formula><tex-math>$_{2}$</tex-math></inline-formula>, and natural gas. In this article, we investigate a novel multimicrogrid framework that jointly considers CCU and P2P trading, aimed at reducing costs and mitigating carbon emissions. Correspondingly, an energy-coupled decision-interdependent multimicrogrid energy scheduling problem is developed that involves the stochastic system states, such as intermittent renewable generation and unpredictable loads. We regard each microgrid as an agent and adopt a multiagent proximal policy optimization (MAPPO) algorithm for distributing the interdependent energy scheduling actions to each agent. This algorithm can cope with the high-dimensional continuous action space and find the energy coordination policy without requiring system future statistical information. In particular, we introduce the centralized training with decentralized execution (CTDE) mechanism, which alleviates the nonstationarity of the environment via centralized training and alleviates the curse of dimensionality via decentralized execution. Simulation results demonstrate that the proposed joint CCU-P2P energy coordination model and the CTDE-based MAPPO algorithm outperform other models in achieving economic and environmental benefits.","PeriodicalId":56023,"journal":{"name":"IEEE Transactions on Control of Network Systems","volume":"11 4","pages":"2173-2186"},"PeriodicalIF":4.0000,"publicationDate":"2024-04-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Combined Carbon Capture and Utilization With Peer-to-Peer Energy Trading for Multimicrogrids Using Multiagent Proximal Policy Optimization\",\"authors\":\"Ming Chen;Zhirong Shen;Lin Wang;Guanglin Zhang\",\"doi\":\"10.1109/TCNS.2024.3393642\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Microgrids integrated with distributed renewable energy are regarded as a crucial evolution toward economical and environmentally sustainable power systems. Carbon capture and utilization (CCU) technologies and peer-to-peer (P2P) energy trading schemes are two potential strategies for mitigating carbon emissions by capturing the emitted CO<inline-formula><tex-math>$_{2}$</tex-math></inline-formula> or trading surplus renewable energy, respectively. Hence, a collaborative energy scheduling model that combines CCU with P2P energy trading is needed under the coupling of multiple energy domains, including electricity, CO<inline-formula><tex-math>$_{2}$</tex-math></inline-formula>, and natural gas. In this article, we investigate a novel multimicrogrid framework that jointly considers CCU and P2P trading, aimed at reducing costs and mitigating carbon emissions. Correspondingly, an energy-coupled decision-interdependent multimicrogrid energy scheduling problem is developed that involves the stochastic system states, such as intermittent renewable generation and unpredictable loads. We regard each microgrid as an agent and adopt a multiagent proximal policy optimization (MAPPO) algorithm for distributing the interdependent energy scheduling actions to each agent. This algorithm can cope with the high-dimensional continuous action space and find the energy coordination policy without requiring system future statistical information. In particular, we introduce the centralized training with decentralized execution (CTDE) mechanism, which alleviates the nonstationarity of the environment via centralized training and alleviates the curse of dimensionality via decentralized execution. Simulation results demonstrate that the proposed joint CCU-P2P energy coordination model and the CTDE-based MAPPO algorithm outperform other models in achieving economic and environmental benefits.\",\"PeriodicalId\":56023,\"journal\":{\"name\":\"IEEE Transactions on Control of Network Systems\",\"volume\":\"11 4\",\"pages\":\"2173-2186\"},\"PeriodicalIF\":4.0000,\"publicationDate\":\"2024-04-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Control of Network Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10508475/\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Control of Network Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10508475/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Combined Carbon Capture and Utilization With Peer-to-Peer Energy Trading for Multimicrogrids Using Multiagent Proximal Policy Optimization
Microgrids integrated with distributed renewable energy are regarded as a crucial evolution toward economical and environmentally sustainable power systems. Carbon capture and utilization (CCU) technologies and peer-to-peer (P2P) energy trading schemes are two potential strategies for mitigating carbon emissions by capturing the emitted CO$_{2}$ or trading surplus renewable energy, respectively. Hence, a collaborative energy scheduling model that combines CCU with P2P energy trading is needed under the coupling of multiple energy domains, including electricity, CO$_{2}$, and natural gas. In this article, we investigate a novel multimicrogrid framework that jointly considers CCU and P2P trading, aimed at reducing costs and mitigating carbon emissions. Correspondingly, an energy-coupled decision-interdependent multimicrogrid energy scheduling problem is developed that involves the stochastic system states, such as intermittent renewable generation and unpredictable loads. We regard each microgrid as an agent and adopt a multiagent proximal policy optimization (MAPPO) algorithm for distributing the interdependent energy scheduling actions to each agent. This algorithm can cope with the high-dimensional continuous action space and find the energy coordination policy without requiring system future statistical information. In particular, we introduce the centralized training with decentralized execution (CTDE) mechanism, which alleviates the nonstationarity of the environment via centralized training and alleviates the curse of dimensionality via decentralized execution. Simulation results demonstrate that the proposed joint CCU-P2P energy coordination model and the CTDE-based MAPPO algorithm outperform other models in achieving economic and environmental benefits.
期刊介绍:
The IEEE Transactions on Control of Network Systems is committed to the timely publication of high-impact papers at the intersection of control systems and network science. In particular, the journal addresses research on the analysis, design and implementation of networked control systems, as well as control over networks. Relevant work includes the full spectrum from basic research on control systems to the design of engineering solutions for automatic control of, and over, networks. The topics covered by this journal include: Coordinated control and estimation over networks, Control and computation over sensor networks, Control under communication constraints, Control and performance analysis issues that arise in the dynamics of networks used in application areas such as communications, computers, transportation, manufacturing, Web ranking and aggregation, social networks, biology, power systems, economics, Synchronization of activities across a controlled network, Stability analysis of controlled networks, Analysis of networks as hybrid dynamical systems.