{"title":"复合干扰下电力系统负荷频率控制的脑启发深度强化学习","authors":"Xiaoming Sun;Chen Peng;Xinchun Jia;Yajian Zhang","doi":"10.1109/TII.2025.3552697","DOIUrl":null,"url":null,"abstract":"This article proposes a brain-inspired deep reinforcement learning (DRL)-based load frequency control framework for power systems with composite interference of internal noise and external load fluctuation. Specifically, inspired by the decision-making process of human brain, some historical, present, and future characteristics of system states are thoroughly extracted into the experience pool for the DRL agent to train efficiently. Meanwhile, a progressive training mechanism that divides the training process into stages through gradually increasing the training objectives is designed for less blindness during training. Moreover, in response to the composite interference, some simulative interferences are learned beforehand to promote the adaptability of the DRL agent. Experimental results on a power system of single generating unit demonstrate that the proposed method is competent in controlling the frequency while ensuring the load supply under composite interference, and is superior to the comparative methods in control performance and training efficiency.","PeriodicalId":13301,"journal":{"name":"IEEE Transactions on Industrial Informatics","volume":"21 7","pages":"5182-5190"},"PeriodicalIF":9.9000,"publicationDate":"2025-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Brain-Inspired Deep Reinforcement Learning for Load Frequency Control of Power Systems With Composite Interference\",\"authors\":\"Xiaoming Sun;Chen Peng;Xinchun Jia;Yajian Zhang\",\"doi\":\"10.1109/TII.2025.3552697\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This article proposes a brain-inspired deep reinforcement learning (DRL)-based load frequency control framework for power systems with composite interference of internal noise and external load fluctuation. Specifically, inspired by the decision-making process of human brain, some historical, present, and future characteristics of system states are thoroughly extracted into the experience pool for the DRL agent to train efficiently. Meanwhile, a progressive training mechanism that divides the training process into stages through gradually increasing the training objectives is designed for less blindness during training. Moreover, in response to the composite interference, some simulative interferences are learned beforehand to promote the adaptability of the DRL agent. Experimental results on a power system of single generating unit demonstrate that the proposed method is competent in controlling the frequency while ensuring the load supply under composite interference, and is superior to the comparative methods in control performance and training efficiency.\",\"PeriodicalId\":13301,\"journal\":{\"name\":\"IEEE Transactions on Industrial Informatics\",\"volume\":\"21 7\",\"pages\":\"5182-5190\"},\"PeriodicalIF\":9.9000,\"publicationDate\":\"2025-04-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Industrial Informatics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10949494/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Industrial Informatics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10949494/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Brain-Inspired Deep Reinforcement Learning for Load Frequency Control of Power Systems With Composite Interference
This article proposes a brain-inspired deep reinforcement learning (DRL)-based load frequency control framework for power systems with composite interference of internal noise and external load fluctuation. Specifically, inspired by the decision-making process of human brain, some historical, present, and future characteristics of system states are thoroughly extracted into the experience pool for the DRL agent to train efficiently. Meanwhile, a progressive training mechanism that divides the training process into stages through gradually increasing the training objectives is designed for less blindness during training. Moreover, in response to the composite interference, some simulative interferences are learned beforehand to promote the adaptability of the DRL agent. Experimental results on a power system of single generating unit demonstrate that the proposed method is competent in controlling the frequency while ensuring the load supply under composite interference, and is superior to the comparative methods in control performance and training efficiency.
期刊介绍:
The IEEE Transactions on Industrial Informatics is a multidisciplinary journal dedicated to publishing technical papers that connect theory with practical applications of informatics in industrial settings. It focuses on the utilization of information in intelligent, distributed, and agile industrial automation and control systems. The scope includes topics such as knowledge-based and AI-enhanced automation, intelligent computer control systems, flexible and collaborative manufacturing, industrial informatics in software-defined vehicles and robotics, computer vision, industrial cyber-physical and industrial IoT systems, real-time and networked embedded systems, security in industrial processes, industrial communications, systems interoperability, and human-machine interaction.