Xiao Jing;Xin Pei;Pengpeng Xu;Yun Yue;Chunyang Han
{"title":"高速公路物流强化学习驱动的智能货车调度算法","authors":"Xiao Jing;Xin Pei;Pengpeng Xu;Yun Yue;Chunyang Han","doi":"10.23919/CSMS.2024.0016","DOIUrl":null,"url":null,"abstract":"Freeway logistics plays a pivotal role in economic development. Although the rapid development in big data and artificial intelligence motivates long-haul freeway logistics towards informatization and intellectualization, the transportation of bulk commodities still faces serious challenges arisen from dispersed freight demands and the lack of co-ordination among different operators. The present study thereby proposed intelligent algorithms for truck dispatching for freeway logistics. Specifically, our contributions include the establishment of mathematical models for full-truckload (FTL) and less-than-truckload (LTL) transportation modes, respectively, and the introduction of reinforcement learning with deep Q-networks tailored for each transportation mode to improve the decision-making in order acceptance and truck repositioning. Simulation experiments based on the real-world freeway logistics data collected in Guiyang, China show that our algorithms improved operational profitability substantially with a 76% and 30% revenue increase for FTL and LTL modes, respectively, compared with single-stage optimization. These results demonstrate the potential of reinforcement learning in revolutionizing freeway logistics and should lay a foundation for future research in intelligent logistics systems.","PeriodicalId":65786,"journal":{"name":"复杂系统建模与仿真(英文)","volume":"4 4","pages":"368-386"},"PeriodicalIF":0.0000,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10820940","citationCount":"0","resultStr":"{\"title\":\"Reinforcement Learning-Driven Intelligent Truck Dispatching Algorithms for Freeway Logistics\",\"authors\":\"Xiao Jing;Xin Pei;Pengpeng Xu;Yun Yue;Chunyang Han\",\"doi\":\"10.23919/CSMS.2024.0016\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Freeway logistics plays a pivotal role in economic development. Although the rapid development in big data and artificial intelligence motivates long-haul freeway logistics towards informatization and intellectualization, the transportation of bulk commodities still faces serious challenges arisen from dispersed freight demands and the lack of co-ordination among different operators. The present study thereby proposed intelligent algorithms for truck dispatching for freeway logistics. Specifically, our contributions include the establishment of mathematical models for full-truckload (FTL) and less-than-truckload (LTL) transportation modes, respectively, and the introduction of reinforcement learning with deep Q-networks tailored for each transportation mode to improve the decision-making in order acceptance and truck repositioning. Simulation experiments based on the real-world freeway logistics data collected in Guiyang, China show that our algorithms improved operational profitability substantially with a 76% and 30% revenue increase for FTL and LTL modes, respectively, compared with single-stage optimization. These results demonstrate the potential of reinforcement learning in revolutionizing freeway logistics and should lay a foundation for future research in intelligent logistics systems.\",\"PeriodicalId\":65786,\"journal\":{\"name\":\"复杂系统建模与仿真(英文)\",\"volume\":\"4 4\",\"pages\":\"368-386\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10820940\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"复杂系统建模与仿真(英文)\",\"FirstCategoryId\":\"1089\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10820940/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"复杂系统建模与仿真(英文)","FirstCategoryId":"1089","ListUrlMain":"https://ieeexplore.ieee.org/document/10820940/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Reinforcement Learning-Driven Intelligent Truck Dispatching Algorithms for Freeway Logistics
Freeway logistics plays a pivotal role in economic development. Although the rapid development in big data and artificial intelligence motivates long-haul freeway logistics towards informatization and intellectualization, the transportation of bulk commodities still faces serious challenges arisen from dispersed freight demands and the lack of co-ordination among different operators. The present study thereby proposed intelligent algorithms for truck dispatching for freeway logistics. Specifically, our contributions include the establishment of mathematical models for full-truckload (FTL) and less-than-truckload (LTL) transportation modes, respectively, and the introduction of reinforcement learning with deep Q-networks tailored for each transportation mode to improve the decision-making in order acceptance and truck repositioning. Simulation experiments based on the real-world freeway logistics data collected in Guiyang, China show that our algorithms improved operational profitability substantially with a 76% and 30% revenue increase for FTL and LTL modes, respectively, compared with single-stage optimization. These results demonstrate the potential of reinforcement learning in revolutionizing freeway logistics and should lay a foundation for future research in intelligent logistics systems.