基于数据驱动强化学习的多目标路径推荐系统

Ankur Sarker, Haiying Shen, Kamran Kowsari
{"title":"基于数据驱动强化学习的多目标路径推荐系统","authors":"Ankur Sarker, Haiying Shen, Kamran Kowsari","doi":"10.1109/MASS50613.2020.00023","DOIUrl":null,"url":null,"abstract":"Driving route recommendation systems have been becoming popular due to high demands on such systems and their high socio-economic impacts. Existing route recommendation systems cannot provide a well-balanced route by considering the user preference on multiple criteria or make route recommendation in a short time. This paper presents a multi-objective route recommendation system considering three different attributes (i.e., fuel consumption, travel time, and air quality). The proposed route recommendation system uses the Q-learning based reinforcement learning algorithm to leverage the available datasets to make route recommendations in a timely manner. First, we build a road network graph using a publicly available map service (i.e., OpenStreetMap) and other real-world datasets on traffic, weather, and air substances. Second, we utilize the existing predictors for air quality, travel time, and fuel consumption estimations to update the road network graph periodically. Third, we design the route recommendation system using the Q-learning reinforcement learning approach considering the given user’s preference for travel time, fuel consumption, and air quality. To evaluate the proposed approach’s performance, we conduct experimental evaluations based on the real-world datasets with publicly available map service.","PeriodicalId":105795,"journal":{"name":"2020 IEEE 17th International Conference on Mobile Ad Hoc and Sensor Systems (MASS)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"A Data-Driven Reinforcement Learning Based Multi-Objective Route Recommendation System\",\"authors\":\"Ankur Sarker, Haiying Shen, Kamran Kowsari\",\"doi\":\"10.1109/MASS50613.2020.00023\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Driving route recommendation systems have been becoming popular due to high demands on such systems and their high socio-economic impacts. Existing route recommendation systems cannot provide a well-balanced route by considering the user preference on multiple criteria or make route recommendation in a short time. This paper presents a multi-objective route recommendation system considering three different attributes (i.e., fuel consumption, travel time, and air quality). The proposed route recommendation system uses the Q-learning based reinforcement learning algorithm to leverage the available datasets to make route recommendations in a timely manner. First, we build a road network graph using a publicly available map service (i.e., OpenStreetMap) and other real-world datasets on traffic, weather, and air substances. Second, we utilize the existing predictors for air quality, travel time, and fuel consumption estimations to update the road network graph periodically. Third, we design the route recommendation system using the Q-learning reinforcement learning approach considering the given user’s preference for travel time, fuel consumption, and air quality. To evaluate the proposed approach’s performance, we conduct experimental evaluations based on the real-world datasets with publicly available map service.\",\"PeriodicalId\":105795,\"journal\":{\"name\":\"2020 IEEE 17th International Conference on Mobile Ad Hoc and Sensor Systems (MASS)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 IEEE 17th International Conference on Mobile Ad Hoc and Sensor Systems (MASS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/MASS50613.2020.00023\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 IEEE 17th International Conference on Mobile Ad Hoc and Sensor Systems (MASS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/MASS50613.2020.00023","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4

摘要

由于对驾驶路线推荐系统的高要求和高社会经济影响,驾驶路线推荐系统已经变得越来越受欢迎。现有的路线推荐系统不能综合考虑用户在多个条件下的偏好,也不能在较短的时间内进行路线推荐。本文提出了一种考虑三种不同属性(油耗、行程时间和空气质量)的多目标路线推荐系统。本文提出的路线推荐系统采用基于q学习的强化学习算法,利用可用的数据集及时进行路线推荐。首先,我们使用公开可用的地图服务(即OpenStreetMap)和其他关于交通、天气和空气物质的真实世界数据集构建道路网络图。其次,我们利用现有的空气质量、旅行时间和燃料消耗预测来定期更新道路网络图。第三,考虑给定用户对旅行时间、燃料消耗和空气质量的偏好,使用Q-learning强化学习方法设计路线推荐系统。为了评估所提出的方法的性能,我们基于公开可用的地图服务的真实数据集进行了实验评估。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A Data-Driven Reinforcement Learning Based Multi-Objective Route Recommendation System
Driving route recommendation systems have been becoming popular due to high demands on such systems and their high socio-economic impacts. Existing route recommendation systems cannot provide a well-balanced route by considering the user preference on multiple criteria or make route recommendation in a short time. This paper presents a multi-objective route recommendation system considering three different attributes (i.e., fuel consumption, travel time, and air quality). The proposed route recommendation system uses the Q-learning based reinforcement learning algorithm to leverage the available datasets to make route recommendations in a timely manner. First, we build a road network graph using a publicly available map service (i.e., OpenStreetMap) and other real-world datasets on traffic, weather, and air substances. Second, we utilize the existing predictors for air quality, travel time, and fuel consumption estimations to update the road network graph periodically. Third, we design the route recommendation system using the Q-learning reinforcement learning approach considering the given user’s preference for travel time, fuel consumption, and air quality. To evaluate the proposed approach’s performance, we conduct experimental evaluations based on the real-world datasets with publicly available map service.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信