Fangyuan Sun, Shu Su, R. Diao, Han Cheng, Da Meng, Shuai Lu
{"title":"基于强化学习的充电站EV-PV协调策略","authors":"Fangyuan Sun, Shu Su, R. Diao, Han Cheng, Da Meng, Shuai Lu","doi":"10.1109/ITECAsia-Pacific56316.2022.9942164","DOIUrl":null,"url":null,"abstract":"Coordinated charging activities of electric vehicles (EVs) in charging stations with distributed photovoltaic (PV) resources plays an important role in promoting PV consumption, saving electricity costs and improving profits for charging stations. However, the uncertainties caused by PV power output and EV arrivals impose grand challenges to achieve the desired optimal control performance. This paper presents a novel real-time EV-PV coordination strategy using distributed reinforcement learning (RL) agents, for providing real-time controls based on high-precision short-term prediction of PV outputs and EV arrivals, which can effectively avoid large deviations between actual and optimal conditions. The proposed RL-based control strategy can balance short-term and long-term benefits and achieve global optimization for charging stations. The feasibility and effectiveness of the proposed algorithm are verified by comprehensive case studies with realistic EV charging station data.","PeriodicalId":45126,"journal":{"name":"Asia-Pacific Journal-Japan Focus","volume":"12 1","pages":"1-6"},"PeriodicalIF":0.2000,"publicationDate":"2022-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Prediction-Based EV-PV Coordination Strategy for Charging Stations Using Reinforcement Learning\",\"authors\":\"Fangyuan Sun, Shu Su, R. Diao, Han Cheng, Da Meng, Shuai Lu\",\"doi\":\"10.1109/ITECAsia-Pacific56316.2022.9942164\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Coordinated charging activities of electric vehicles (EVs) in charging stations with distributed photovoltaic (PV) resources plays an important role in promoting PV consumption, saving electricity costs and improving profits for charging stations. However, the uncertainties caused by PV power output and EV arrivals impose grand challenges to achieve the desired optimal control performance. This paper presents a novel real-time EV-PV coordination strategy using distributed reinforcement learning (RL) agents, for providing real-time controls based on high-precision short-term prediction of PV outputs and EV arrivals, which can effectively avoid large deviations between actual and optimal conditions. The proposed RL-based control strategy can balance short-term and long-term benefits and achieve global optimization for charging stations. The feasibility and effectiveness of the proposed algorithm are verified by comprehensive case studies with realistic EV charging station data.\",\"PeriodicalId\":45126,\"journal\":{\"name\":\"Asia-Pacific Journal-Japan Focus\",\"volume\":\"12 1\",\"pages\":\"1-6\"},\"PeriodicalIF\":0.2000,\"publicationDate\":\"2022-10-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Asia-Pacific Journal-Japan Focus\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ITECAsia-Pacific56316.2022.9942164\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"AREA STUDIES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Asia-Pacific Journal-Japan Focus","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ITECAsia-Pacific56316.2022.9942164","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"AREA STUDIES","Score":null,"Total":0}
Prediction-Based EV-PV Coordination Strategy for Charging Stations Using Reinforcement Learning
Coordinated charging activities of electric vehicles (EVs) in charging stations with distributed photovoltaic (PV) resources plays an important role in promoting PV consumption, saving electricity costs and improving profits for charging stations. However, the uncertainties caused by PV power output and EV arrivals impose grand challenges to achieve the desired optimal control performance. This paper presents a novel real-time EV-PV coordination strategy using distributed reinforcement learning (RL) agents, for providing real-time controls based on high-precision short-term prediction of PV outputs and EV arrivals, which can effectively avoid large deviations between actual and optimal conditions. The proposed RL-based control strategy can balance short-term and long-term benefits and achieve global optimization for charging stations. The feasibility and effectiveness of the proposed algorithm are verified by comprehensive case studies with realistic EV charging station data.