{"title":"基于深度强化学习的自适应变长滑动窗口网络编码在fanet中的低延迟传输","authors":"Bo Song;Lei Xu;Xiulin Qiu;Yaqi Ke;Yuwang Yang","doi":"10.1109/LWC.2025.3543921","DOIUrl":null,"url":null,"abstract":"Future flying ad-hoc networks (FANETs) need to address issues related to delay and channel interference while ensuring high data transmission accuracy. In this letter, we propose a proximal policy optimization (PPO)-based adaptive adjustment algorithm for sliding window-based network coding to mitigate channel contention and signal degradation caused by increased traffic load. We model the adaptive adjustment of the sliding window size as a Markov decision process, considering effective rate, node congestion, and total delay in the reward function. To further improve the algorithm’s performance, we enhance PPO with long short-term memory (LSTM) networks to process time-series data. Experimental results demonstrate that our method reduces delay, improves packet delivery rate and throughput compared with traditional sliding window network coding algorithms.","PeriodicalId":13343,"journal":{"name":"IEEE Wireless Communications Letters","volume":"14 5","pages":"1441-1445"},"PeriodicalIF":5.5000,"publicationDate":"2025-02-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Adaptive Variable Length Sliding Window Network Coding for Low Latency Transmission in FANETs via Deep Reinforcement Learning\",\"authors\":\"Bo Song;Lei Xu;Xiulin Qiu;Yaqi Ke;Yuwang Yang\",\"doi\":\"10.1109/LWC.2025.3543921\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Future flying ad-hoc networks (FANETs) need to address issues related to delay and channel interference while ensuring high data transmission accuracy. In this letter, we propose a proximal policy optimization (PPO)-based adaptive adjustment algorithm for sliding window-based network coding to mitigate channel contention and signal degradation caused by increased traffic load. We model the adaptive adjustment of the sliding window size as a Markov decision process, considering effective rate, node congestion, and total delay in the reward function. To further improve the algorithm’s performance, we enhance PPO with long short-term memory (LSTM) networks to process time-series data. Experimental results demonstrate that our method reduces delay, improves packet delivery rate and throughput compared with traditional sliding window network coding algorithms.\",\"PeriodicalId\":13343,\"journal\":{\"name\":\"IEEE Wireless Communications Letters\",\"volume\":\"14 5\",\"pages\":\"1441-1445\"},\"PeriodicalIF\":5.5000,\"publicationDate\":\"2025-02-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Wireless Communications Letters\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10896754/\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Wireless Communications Letters","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10896754/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
Adaptive Variable Length Sliding Window Network Coding for Low Latency Transmission in FANETs via Deep Reinforcement Learning
Future flying ad-hoc networks (FANETs) need to address issues related to delay and channel interference while ensuring high data transmission accuracy. In this letter, we propose a proximal policy optimization (PPO)-based adaptive adjustment algorithm for sliding window-based network coding to mitigate channel contention and signal degradation caused by increased traffic load. We model the adaptive adjustment of the sliding window size as a Markov decision process, considering effective rate, node congestion, and total delay in the reward function. To further improve the algorithm’s performance, we enhance PPO with long short-term memory (LSTM) networks to process time-series data. Experimental results demonstrate that our method reduces delay, improves packet delivery rate and throughput compared with traditional sliding window network coding algorithms.
期刊介绍:
IEEE Wireless Communications Letters publishes short papers in a rapid publication cycle on advances in the state-of-the-art of wireless communications. Both theoretical contributions (including new techniques, concepts, and analyses) and practical contributions (including system experiments and prototypes, and new applications) are encouraged. This journal focuses on the physical layer and the link layer of wireless communication systems.