Dong Yan;Zhan Shi;Xinying Wang;Yiying Gao;Tianjiao Pu;Jiye Wang
{"title":"Efficient and Stable Learning for Distribution Network Operation: A Model-Based Reinforcement Learning Approach","authors":"Dong Yan;Zhan Shi;Xinying Wang;Yiying Gao;Tianjiao Pu;Jiye Wang","doi":"10.17775/CSEEJPES.2023.09100","DOIUrl":null,"url":null,"abstract":"This paper discusses the application of deep reinforcement learning (DRL) to the economic operation of power distribution networks, a complex system involving numerous flexible resources. Despite the improved control flexibility, traditional prediction-plus-optimization models struggle to adapt to rapidly shifting demands. Modern artificial intelligence (AI) methods, particularly DRL methods, promise faster decision-making but face challenges, including inefficient training and real-world application. This study introduces a reward evaluation system to assess the effectiveness of various strategies and proposes an enhanced algorithm based on the Model-based DRL approach. Incorporating a state transition model, the proposed algorithm augments data and enhances dynamic deduction, improving training efficiency. The effectiveness is demonstrated in various operational scenarios, showing notable enhancements in rationality and transfer generalization.","PeriodicalId":10729,"journal":{"name":"CSEE Journal of Power and Energy Systems","volume":"11 3","pages":"1080-1092"},"PeriodicalIF":6.9000,"publicationDate":"2025-01-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10838271","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"CSEE Journal of Power and Energy Systems","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10838271/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
引用次数: 0
Abstract
This paper discusses the application of deep reinforcement learning (DRL) to the economic operation of power distribution networks, a complex system involving numerous flexible resources. Despite the improved control flexibility, traditional prediction-plus-optimization models struggle to adapt to rapidly shifting demands. Modern artificial intelligence (AI) methods, particularly DRL methods, promise faster decision-making but face challenges, including inefficient training and real-world application. This study introduces a reward evaluation system to assess the effectiveness of various strategies and proposes an enhanced algorithm based on the Model-based DRL approach. Incorporating a state transition model, the proposed algorithm augments data and enhances dynamic deduction, improving training efficiency. The effectiveness is demonstrated in various operational scenarios, showing notable enhancements in rationality and transfer generalization.
期刊介绍:
The CSEE Journal of Power and Energy Systems (JPES) is an international bimonthly journal published by the Chinese Society for Electrical Engineering (CSEE) in collaboration with CEPRI (China Electric Power Research Institute) and IEEE (The Institute of Electrical and Electronics Engineers) Inc. Indexed by SCI, Scopus, INSPEC, CSAD (Chinese Science Abstracts Database), DOAJ, and ProQuest, it serves as a platform for reporting cutting-edge theories, methods, technologies, and applications shaping the development of power systems in energy transition. The journal offers authors an international platform to enhance the reach and impact of their contributions.