{"title":"基于深度强化学习的电动汽车充电站优先服务资源分配","authors":"Aslinur Colak , Nilgun Fescioglu-Unver","doi":"10.1016/j.energy.2024.133637","DOIUrl":null,"url":null,"abstract":"<div><div>The demand for public fast charging stations is increasing with the number of electric vehicles on roads. The charging queues and waiting times get longer, especially during the winter season and on holidays. Priority based service at charging stations can provide shorter delay times to vehicles willing to pay more and lower charging prices for vehicles accepting to wait more. Existing studies use classical feedback control and simulation based control methods to maintain the ratio of high and low priority vehicles’ delay times at the station’s target level. Reinforcement learning has been used successfully for real time control in environments with uncertainties. This study proposes a deep Q-Learning based real time resource allocation model for priority service in fast charging stations (DRL-EXP). Results show that the deep learning approach enables DRL-EXP to provide a more stable and faster response than the existing models. DRL-EXP is also applicable to other priority based service systems that act under uncertainties and require real time control.</div></div>","PeriodicalId":11647,"journal":{"name":"Energy","volume":"313 ","pages":"Article 133637"},"PeriodicalIF":9.0000,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep reinforcement learning based resource allocation for electric vehicle charging stations with priority service\",\"authors\":\"Aslinur Colak , Nilgun Fescioglu-Unver\",\"doi\":\"10.1016/j.energy.2024.133637\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The demand for public fast charging stations is increasing with the number of electric vehicles on roads. The charging queues and waiting times get longer, especially during the winter season and on holidays. Priority based service at charging stations can provide shorter delay times to vehicles willing to pay more and lower charging prices for vehicles accepting to wait more. Existing studies use classical feedback control and simulation based control methods to maintain the ratio of high and low priority vehicles’ delay times at the station’s target level. Reinforcement learning has been used successfully for real time control in environments with uncertainties. This study proposes a deep Q-Learning based real time resource allocation model for priority service in fast charging stations (DRL-EXP). Results show that the deep learning approach enables DRL-EXP to provide a more stable and faster response than the existing models. DRL-EXP is also applicable to other priority based service systems that act under uncertainties and require real time control.</div></div>\",\"PeriodicalId\":11647,\"journal\":{\"name\":\"Energy\",\"volume\":\"313 \",\"pages\":\"Article 133637\"},\"PeriodicalIF\":9.0000,\"publicationDate\":\"2024-11-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Energy\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0360544224034157\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENERGY & FUELS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Energy","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0360544224034157","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
Deep reinforcement learning based resource allocation for electric vehicle charging stations with priority service
The demand for public fast charging stations is increasing with the number of electric vehicles on roads. The charging queues and waiting times get longer, especially during the winter season and on holidays. Priority based service at charging stations can provide shorter delay times to vehicles willing to pay more and lower charging prices for vehicles accepting to wait more. Existing studies use classical feedback control and simulation based control methods to maintain the ratio of high and low priority vehicles’ delay times at the station’s target level. Reinforcement learning has been used successfully for real time control in environments with uncertainties. This study proposes a deep Q-Learning based real time resource allocation model for priority service in fast charging stations (DRL-EXP). Results show that the deep learning approach enables DRL-EXP to provide a more stable and faster response than the existing models. DRL-EXP is also applicable to other priority based service systems that act under uncertainties and require real time control.
期刊介绍:
Energy is a multidisciplinary, international journal that publishes research and analysis in the field of energy engineering. Our aim is to become a leading peer-reviewed platform and a trusted source of information for energy-related topics.
The journal covers a range of areas including mechanical engineering, thermal sciences, and energy analysis. We are particularly interested in research on energy modelling, prediction, integrated energy systems, planning, and management.
Additionally, we welcome papers on energy conservation, efficiency, biomass and bioenergy, renewable energy, electricity supply and demand, energy storage, buildings, and economic and policy issues. These topics should align with our broader multidisciplinary focus.