Can Li, Lei Bai, Lina Yao, S. Travis Waller, Wei Liu
{"title":"交通运输强化学习应用的文献计量学分析与综述","authors":"Can Li, Lei Bai, Lina Yao, S. Travis Waller, Wei Liu","doi":"10.1080/21680566.2023.2179461","DOIUrl":null,"url":null,"abstract":"Transportation is the backbone of the economy and urban development. Improving the efficiency, sustainability, resilience, and intelligence of transportation systems is critical and also challenging. The constantly changing traffic conditions, the uncertain influence of external factors (e.g. weather, accidents), and the interactions among multiple travel modes and multi-type flows result in the dynamic and stochastic natures of transportation systems. The planning, operation, and control of transportation systems require flexible and adaptable strategies in order to deal with uncertainty, non-linearity, variability, and high complexity. In this context, Reinforcement Learning (RL) that enables autonomous decision-makers to interact with the complex environment, learn from the experiences, and select optimal actions has been rapidly emerging as one of the most useful approaches for smart transportation applications. This paper conducts a bibliometric analysis to identify the development of RL-based methods for transportation applications, representative journals/conferences, and leading topics in recent 10 years. Then, this paper presents a comprehensive literature review on applications of RL in transportation based on specific topics. The potential future research directions of RL applications and developments are also discussed.","PeriodicalId":48872,"journal":{"name":"Transportmetrica B-Transport Dynamics","volume":"34 1","pages":"0"},"PeriodicalIF":3.3000,"publicationDate":"2023-03-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A bibliometric analysis and review on reinforcement learning for transportation applications\",\"authors\":\"Can Li, Lei Bai, Lina Yao, S. Travis Waller, Wei Liu\",\"doi\":\"10.1080/21680566.2023.2179461\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Transportation is the backbone of the economy and urban development. Improving the efficiency, sustainability, resilience, and intelligence of transportation systems is critical and also challenging. The constantly changing traffic conditions, the uncertain influence of external factors (e.g. weather, accidents), and the interactions among multiple travel modes and multi-type flows result in the dynamic and stochastic natures of transportation systems. The planning, operation, and control of transportation systems require flexible and adaptable strategies in order to deal with uncertainty, non-linearity, variability, and high complexity. In this context, Reinforcement Learning (RL) that enables autonomous decision-makers to interact with the complex environment, learn from the experiences, and select optimal actions has been rapidly emerging as one of the most useful approaches for smart transportation applications. This paper conducts a bibliometric analysis to identify the development of RL-based methods for transportation applications, representative journals/conferences, and leading topics in recent 10 years. Then, this paper presents a comprehensive literature review on applications of RL in transportation based on specific topics. The potential future research directions of RL applications and developments are also discussed.\",\"PeriodicalId\":48872,\"journal\":{\"name\":\"Transportmetrica B-Transport Dynamics\",\"volume\":\"34 1\",\"pages\":\"0\"},\"PeriodicalIF\":3.3000,\"publicationDate\":\"2023-03-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Transportmetrica B-Transport Dynamics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1080/21680566.2023.2179461\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"TRANSPORTATION\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Transportmetrica B-Transport Dynamics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/21680566.2023.2179461","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"TRANSPORTATION","Score":null,"Total":0}
A bibliometric analysis and review on reinforcement learning for transportation applications
Transportation is the backbone of the economy and urban development. Improving the efficiency, sustainability, resilience, and intelligence of transportation systems is critical and also challenging. The constantly changing traffic conditions, the uncertain influence of external factors (e.g. weather, accidents), and the interactions among multiple travel modes and multi-type flows result in the dynamic and stochastic natures of transportation systems. The planning, operation, and control of transportation systems require flexible and adaptable strategies in order to deal with uncertainty, non-linearity, variability, and high complexity. In this context, Reinforcement Learning (RL) that enables autonomous decision-makers to interact with the complex environment, learn from the experiences, and select optimal actions has been rapidly emerging as one of the most useful approaches for smart transportation applications. This paper conducts a bibliometric analysis to identify the development of RL-based methods for transportation applications, representative journals/conferences, and leading topics in recent 10 years. Then, this paper presents a comprehensive literature review on applications of RL in transportation based on specific topics. The potential future research directions of RL applications and developments are also discussed.
期刊介绍:
Transportmetrica B is an international journal that aims to bring together contributions of advanced research in understanding and practical experience in handling the dynamic aspects of transport systems and behavior, and hence the sub-title is set as “Transport Dynamics”.
Transport dynamics can be considered from various scales and scopes ranging from dynamics in traffic flow, travel behavior (e.g. learning process), logistics, transport policy, to traffic control. Thus, the journal welcomes research papers that address transport dynamics from a broad perspective, ranging from theoretical studies to empirical analysis of transport systems or behavior based on actual data.
The scope of Transportmetrica B includes, but is not limited to, the following: dynamic traffic assignment, dynamic transit assignment, dynamic activity-based modeling, applications of system dynamics in transport planning, logistics planning and optimization, traffic flow analysis, dynamic programming in transport modeling and optimization, traffic control, land-use and transport dynamics, day-to-day learning process (model and behavioral studies), time-series analysis of transport data and demand, traffic emission modeling, time-dependent transport policy analysis, transportation network reliability and vulnerability, simulation of traffic system and travel behavior, longitudinal analysis of traveler behavior, etc.