{"title":"PPORM: A PPO-assisted packet reordering mechanism of heterogeneous VANETs for enhancing goodput and stability in fog computing","authors":"Xiaoya Zhang , Yuyang Zhang , Ping Dong , Xiaojiang Du , Chengxiao Yu , Hongke Zhang","doi":"10.1016/j.vehcom.2025.100894","DOIUrl":null,"url":null,"abstract":"<div><div>Integrated Vehicular Networks (VANETs) constructed through the collaboration of various heterogeneous networks, such as 4G, 5G, satellite networks, and Unmanned Aerial Vehicle (UAV) networks, provide an effective solution to the resource constraints between vehicles and edge fog computing nodes. Reordering Buffer (RB) is crucial in concurrent data transmission between vehicles and edge fog computing nodes via heterogeneous VANETs. RB is in charge of storing out-of-order packets, waiting for packets with smaller sequence numbers, and delivering in-order packets to upper-layer applications. However, current packet reordering mechanisms are challenging in providing stable and high goodput due to the inappropriate timeout timers and uneven delivery rules. In this paper, we propose a PPO-assisted packet reordering mechanism (PPORM) to achieve optimal control of packet delivery. We first transform the goodput maximization problem into the optimal timeout threshold of RB and the optimal delivery moment of each packet. Secondly, we introduce a Proximal Policy Optimization-assisted Timeout Threshold Updating (TTU) algorithm to dynamically adjust the threshold in response to real-time changes in network conditions. Further, we present a Multifactor Smooth Delivery (MSD) algorithm to regulate the optimal queuing delay for each packet and enhance the stability of the real-time throughput as much as possible. Experimental results show that PPORM improves goodput by <span><math><mn>6.94</mn><mtext>%</mtext><mo>∼</mo><mn>45.57</mn><mtext>%</mtext></math></span> and improves stability by <span><math><mn>32.5</mn><mtext>%</mtext><mo>∼</mo><mn>49.58</mn><mtext>%</mtext></math></span> compared with other baseline algorithms.</div></div>","PeriodicalId":54346,"journal":{"name":"Vehicular Communications","volume":"53 ","pages":"Article 100894"},"PeriodicalIF":5.8000,"publicationDate":"2025-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Vehicular Communications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S221420962500021X","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
引用次数: 0
Abstract
Integrated Vehicular Networks (VANETs) constructed through the collaboration of various heterogeneous networks, such as 4G, 5G, satellite networks, and Unmanned Aerial Vehicle (UAV) networks, provide an effective solution to the resource constraints between vehicles and edge fog computing nodes. Reordering Buffer (RB) is crucial in concurrent data transmission between vehicles and edge fog computing nodes via heterogeneous VANETs. RB is in charge of storing out-of-order packets, waiting for packets with smaller sequence numbers, and delivering in-order packets to upper-layer applications. However, current packet reordering mechanisms are challenging in providing stable and high goodput due to the inappropriate timeout timers and uneven delivery rules. In this paper, we propose a PPO-assisted packet reordering mechanism (PPORM) to achieve optimal control of packet delivery. We first transform the goodput maximization problem into the optimal timeout threshold of RB and the optimal delivery moment of each packet. Secondly, we introduce a Proximal Policy Optimization-assisted Timeout Threshold Updating (TTU) algorithm to dynamically adjust the threshold in response to real-time changes in network conditions. Further, we present a Multifactor Smooth Delivery (MSD) algorithm to regulate the optimal queuing delay for each packet and enhance the stability of the real-time throughput as much as possible. Experimental results show that PPORM improves goodput by and improves stability by compared with other baseline algorithms.
期刊介绍:
Vehicular communications is a growing area of communications between vehicles and including roadside communication infrastructure. Advances in wireless communications are making possible sharing of information through real time communications between vehicles and infrastructure. This has led to applications to increase safety of vehicles and communication between passengers and the Internet. Standardization efforts on vehicular communication are also underway to make vehicular transportation safer, greener and easier.
The aim of the journal is to publish high quality peer–reviewed papers in the area of vehicular communications. The scope encompasses all types of communications involving vehicles, including vehicle–to–vehicle and vehicle–to–infrastructure. The scope includes (but not limited to) the following topics related to vehicular communications:
Vehicle to vehicle and vehicle to infrastructure communications
Channel modelling, modulating and coding
Congestion Control and scalability issues
Protocol design, testing and verification
Routing in vehicular networks
Security issues and countermeasures
Deployment and field testing
Reducing energy consumption and enhancing safety of vehicles
Wireless in–car networks
Data collection and dissemination methods
Mobility and handover issues
Safety and driver assistance applications
UAV
Underwater communications
Autonomous cooperative driving
Social networks
Internet of vehicles
Standardization of protocols.