{"title":"基于强化学习的电动汽车电池优化运动规划","authors":"Himanshu Soni, Vishu Gupta, R. Kumar","doi":"10.1109/ICPECA47973.2019.8975684","DOIUrl":null,"url":null,"abstract":"The increasing demand for electric vehicle and autonomous vehicle as the alternate to the combustion-driven vehicle has motivated the research in the area of motion planning. Motion planmng is a complicated problem as it requires the consideration of multiple entities, mainly human behaviour. In this paper, reinforcement learning techniques are explored for the motion planning of an electnc vehicle(EV) while optimizing battery consumption. The EV travel time has also been evaluated under different reinforcement learning schemes. A traffic simulation network is developed for a high-traffic zone of Jaipur city using Simulation for Urban Mobility(SUMO) software. Model-based and model-free method like value-iteration and q-learning are applied to the developed traffic network. The results show that value iteration and q-learning have shown improved battery consumption. However, value iteration gives greater efficiency in terms of travel time as well as battery consumption.","PeriodicalId":6761,"journal":{"name":"2019 International Conference on Power Electronics, Control and Automation (ICPECA)","volume":"122 1","pages":"1-6"},"PeriodicalIF":0.0000,"publicationDate":"2019-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Motion Planning using Reinforcement Learning for Electric Vehicle Battery optimization(EVBO)\",\"authors\":\"Himanshu Soni, Vishu Gupta, R. Kumar\",\"doi\":\"10.1109/ICPECA47973.2019.8975684\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The increasing demand for electric vehicle and autonomous vehicle as the alternate to the combustion-driven vehicle has motivated the research in the area of motion planning. Motion planmng is a complicated problem as it requires the consideration of multiple entities, mainly human behaviour. In this paper, reinforcement learning techniques are explored for the motion planning of an electnc vehicle(EV) while optimizing battery consumption. The EV travel time has also been evaluated under different reinforcement learning schemes. A traffic simulation network is developed for a high-traffic zone of Jaipur city using Simulation for Urban Mobility(SUMO) software. Model-based and model-free method like value-iteration and q-learning are applied to the developed traffic network. The results show that value iteration and q-learning have shown improved battery consumption. However, value iteration gives greater efficiency in terms of travel time as well as battery consumption.\",\"PeriodicalId\":6761,\"journal\":{\"name\":\"2019 International Conference on Power Electronics, Control and Automation (ICPECA)\",\"volume\":\"122 1\",\"pages\":\"1-6\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 International Conference on Power Electronics, Control and Automation (ICPECA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICPECA47973.2019.8975684\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 International Conference on Power Electronics, Control and Automation (ICPECA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICPECA47973.2019.8975684","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
随着人们对电动汽车和自动驾驶汽车的需求日益增长,运动规划领域的研究也日益深入。运动规划是一个复杂的问题,因为它需要考虑多个实体,主要是人的行为。本文探讨了在优化电池消耗的同时,强化学习技术在电动汽车运动规划中的应用。并对不同强化学习方案下的电动汽车行驶时间进行了评价。利用城市交通仿真软件SUMO (simulation for Urban Mobility)开发了斋浦尔市高交通量区域的交通仿真网络。将值迭代和q学习等基于模型和无模型的方法应用于发达的交通网络。结果表明,值迭代和q-学习可以改善电池消耗。然而,价值迭代在旅行时间和电池消耗方面提供了更高的效率。
Motion Planning using Reinforcement Learning for Electric Vehicle Battery optimization(EVBO)
The increasing demand for electric vehicle and autonomous vehicle as the alternate to the combustion-driven vehicle has motivated the research in the area of motion planning. Motion planmng is a complicated problem as it requires the consideration of multiple entities, mainly human behaviour. In this paper, reinforcement learning techniques are explored for the motion planning of an electnc vehicle(EV) while optimizing battery consumption. The EV travel time has also been evaluated under different reinforcement learning schemes. A traffic simulation network is developed for a high-traffic zone of Jaipur city using Simulation for Urban Mobility(SUMO) software. Model-based and model-free method like value-iteration and q-learning are applied to the developed traffic network. The results show that value iteration and q-learning have shown improved battery consumption. However, value iteration gives greater efficiency in terms of travel time as well as battery consumption.