Research on Vehicle Dispatch Problem Based on Kuhn-Munkres and Reinforcement Learning Algorithm

Mengqi Li, Ziyao Geng, Yi Wang
{"title":"Research on Vehicle Dispatch Problem Based on Kuhn-Munkres and Reinforcement Learning Algorithm","authors":"Mengqi Li, Ziyao Geng, Yi Wang","doi":"10.1109/ICPECA51329.2021.9362615","DOIUrl":null,"url":null,"abstract":"With the development of artificial intelligence and 5G communication technology, autonomous vehicles are gradually becoming more achievable. Autonomous vehicles are used in urban transportation to provide taxi service, which effectively reduces labor cost and realizes intelligent transportation systems. The vehicle system combined with 5G technology can quickly obtain traffic information, which provides a decision basis for the vehicle dispatching. Thus, it is necessary to develop an efficient way to distribute and allocate these vehicles to maximize the potential income for the system. This paper studies the vehicle dispatching based on the travel data from the 2016 New York City Green Taxi data and propose two dispatching methods. First, we consider the dispatching problem as a maximum weight value matching problem. Then a distance-based dispatching method is proposed with the goal of minimizing the waiting time of passengers by using the Kuhn and Munkres (KM) algorithm. Finally, we formulate the decision of vehicle dispatch with a Markov Decision Process (MDP) and introduce a Reinforcement Learning (RL)-based dispatching method, which combines RL algorithm and KM algorithm to solve the dispatching problem with the goal of maximizing long-term revenue of divers. In the experiment, KM algorithm is compared with the full permutation algorithm to prove the effectiveness of KM algorithm. The performance of the distance-based dispatching method and RL-based dispatching method are presented in a small-scale dispatching and a large-scale dispatching. Experiment results show that the total revenue of vehicles is improved by about 20% by using RL-based dispatching method, compared to dispatching method based on the distance. Thus, RL-based dispatching method is more effective in a dispatching platform. It could be used by future public autonomous vehicle companies to achieve the fulfill the need of maximizing the potential income for the system.","PeriodicalId":119798,"journal":{"name":"2021 IEEE International Conference on Power Electronics, Computer Applications (ICPECA)","volume":"133 1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-01-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE International Conference on Power Electronics, Computer Applications (ICPECA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICPECA51329.2021.9362615","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

With the development of artificial intelligence and 5G communication technology, autonomous vehicles are gradually becoming more achievable. Autonomous vehicles are used in urban transportation to provide taxi service, which effectively reduces labor cost and realizes intelligent transportation systems. The vehicle system combined with 5G technology can quickly obtain traffic information, which provides a decision basis for the vehicle dispatching. Thus, it is necessary to develop an efficient way to distribute and allocate these vehicles to maximize the potential income for the system. This paper studies the vehicle dispatching based on the travel data from the 2016 New York City Green Taxi data and propose two dispatching methods. First, we consider the dispatching problem as a maximum weight value matching problem. Then a distance-based dispatching method is proposed with the goal of minimizing the waiting time of passengers by using the Kuhn and Munkres (KM) algorithm. Finally, we formulate the decision of vehicle dispatch with a Markov Decision Process (MDP) and introduce a Reinforcement Learning (RL)-based dispatching method, which combines RL algorithm and KM algorithm to solve the dispatching problem with the goal of maximizing long-term revenue of divers. In the experiment, KM algorithm is compared with the full permutation algorithm to prove the effectiveness of KM algorithm. The performance of the distance-based dispatching method and RL-based dispatching method are presented in a small-scale dispatching and a large-scale dispatching. Experiment results show that the total revenue of vehicles is improved by about 20% by using RL-based dispatching method, compared to dispatching method based on the distance. Thus, RL-based dispatching method is more effective in a dispatching platform. It could be used by future public autonomous vehicle companies to achieve the fulfill the need of maximizing the potential income for the system.
基于Kuhn-Munkres和强化学习算法的车辆调度问题研究
随着人工智能和5G通信技术的发展,自动驾驶汽车逐渐变得越来越容易实现。自动驾驶汽车在城市交通中提供出租车服务,有效降低人工成本,实现智能交通系统。结合5G技术的车载系统可以快速获取交通信息,为车辆调度提供决策依据。因此,有必要开发一种有效的方式来分配和分配这些车辆,以最大限度地提高系统的潜在收入。本文基于2016年纽约市绿色出租车的出行数据,对车辆调度进行了研究,提出了两种调度方法。首先,我们将调度问题看作是一个最大权值匹配问题。在此基础上,提出了一种基于距离的调度方法,利用库恩和蒙克雷斯(Kuhn and Munkres, KM)算法,以最小化乘客等待时间为目标。最后,我们用马尔可夫决策过程(MDP)来制定车辆调度决策,并引入了一种基于强化学习(RL)的调度方法,该方法结合RL算法和KM算法来解决以潜水员长期收益最大化为目标的调度问题。在实验中,将KM算法与全置换算法进行了比较,证明了KM算法的有效性。介绍了基于距离的调度方法和基于rl的调度方法在小规模调度和大规模调度中的性能。实验结果表明,与基于距离的调度方法相比,基于rl的调度方法使车辆的总收益提高了约20%。因此,基于rl的调度方法在调度平台中更为有效。它可以被未来的公共自动驾驶汽车公司使用,以实现系统潜在收入最大化的需求。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信