Karel Toledo , Guillermo Donoso , Daniel Psijas , Javier Baladron
{"title":"Transforming wireless network efficiency with UAV path planning using deep reinforcement learning","authors":"Karel Toledo , Guillermo Donoso , Daniel Psijas , Javier Baladron","doi":"10.1016/j.comcom.2026.108568","DOIUrl":null,"url":null,"abstract":"<div><div>Unmanned aerial vehicles (UAVs) are emerging as a key enabler for enhancing wireless network performance in dynamic and challenging environments. This paper systematically studied a deep reinforcement learning (DRL) framework for optimizing the trajectories of UAVs operating as mobile base station (MoBS). The problem is formulated as a Markov decision process (MDP) and solved using two DRL algorithms: Deep Q-network (DQN) and Proximal Policy Optimization (PPO). Seven reward functions are designed to maximize average channel capacity and fairness among ground terminals (GTs). The work further presents an in-depth analysis of reward shaping, diverse network configurations, and hyperparameter tuning. Simulation results show that the proposed approach outperforms static and non-adaptive baselines, achieving near-optimal performance under uncertain GT movement patterns. Scalability evaluations demonstrate strong generalization to larger network areas, providing valuable insights for DRL-based UAV path planning in next-generation wireless networks.</div></div>","PeriodicalId":55224,"journal":{"name":"Computer Communications","volume":"255 ","pages":"Article 108568"},"PeriodicalIF":4.2000,"publicationDate":"2026-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Communications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0140366426001581","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/5/22 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Unmanned aerial vehicles (UAVs) are emerging as a key enabler for enhancing wireless network performance in dynamic and challenging environments. This paper systematically studied a deep reinforcement learning (DRL) framework for optimizing the trajectories of UAVs operating as mobile base station (MoBS). The problem is formulated as a Markov decision process (MDP) and solved using two DRL algorithms: Deep Q-network (DQN) and Proximal Policy Optimization (PPO). Seven reward functions are designed to maximize average channel capacity and fairness among ground terminals (GTs). The work further presents an in-depth analysis of reward shaping, diverse network configurations, and hyperparameter tuning. Simulation results show that the proposed approach outperforms static and non-adaptive baselines, achieving near-optimal performance under uncertain GT movement patterns. Scalability evaluations demonstrate strong generalization to larger network areas, providing valuable insights for DRL-based UAV path planning in next-generation wireless networks.
期刊介绍:
Computer and Communications networks are key infrastructures of the information society with high socio-economic value as they contribute to the correct operations of many critical services (from healthcare to finance and transportation). Internet is the core of today''s computer-communication infrastructures. This has transformed the Internet, from a robust network for data transfer between computers, to a global, content-rich, communication and information system where contents are increasingly generated by the users, and distributed according to human social relations. Next-generation network technologies, architectures and protocols are therefore required to overcome the limitations of the legacy Internet and add new capabilities and services. The future Internet should be ubiquitous, secure, resilient, and closer to human communication paradigms.
Computer Communications is a peer-reviewed international journal that publishes high-quality scientific articles (both theory and practice) and survey papers covering all aspects of future computer communication networks (on all layers, except the physical layer), with a special attention to the evolution of the Internet architecture, protocols, services, and applications.