Yongli Wang, Shuquan Li, Daomin Qu, Shaokun Jia, Xi Gan, Yuze Ma, Yaling Sun
{"title":"An Integrated Energy System Optimization Method Considering Q Learning Algorithm","authors":"Yongli Wang, Shuquan Li, Daomin Qu, Shaokun Jia, Xi Gan, Yuze Ma, Yaling Sun","doi":"10.1109/CISCE50729.2020.00077","DOIUrl":null,"url":null,"abstract":"In recent years, the frequent natural disasters worldwide and their effects have attracted great attention of the international community. In this context, the traditional reliability research is not enough to support the safe operation of the power grid, and the concept of toughness emerges as the times require. In this paper, the dynamic power flow model of natural gas network is adopted, and the coupling relationship between distribution network reconfiguration in physical layer and information layer is considered. Based on this, Q learning algorithm is introduced to solve the complex problem. The simulation results show that the Q learning algorithm can achieve better convergence while solving the problem. The improved initialization method and the adopted confidence interval upper bound algorithm can significantly improve the computational efficiency and make the results converge to a better solution. Compared with the conventional mixed integer linear programming model, Q learning algorithm has better optimization results.","PeriodicalId":101777,"journal":{"name":"2020 International Conference on Communications, Information System and Computer Engineering (CISCE)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 International Conference on Communications, Information System and Computer Engineering (CISCE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CISCE50729.2020.00077","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
In recent years, the frequent natural disasters worldwide and their effects have attracted great attention of the international community. In this context, the traditional reliability research is not enough to support the safe operation of the power grid, and the concept of toughness emerges as the times require. In this paper, the dynamic power flow model of natural gas network is adopted, and the coupling relationship between distribution network reconfiguration in physical layer and information layer is considered. Based on this, Q learning algorithm is introduced to solve the complex problem. The simulation results show that the Q learning algorithm can achieve better convergence while solving the problem. The improved initialization method and the adopted confidence interval upper bound algorithm can significantly improve the computational efficiency and make the results converge to a better solution. Compared with the conventional mixed integer linear programming model, Q learning algorithm has better optimization results.