Transforming wireless network efficiency with UAV path planning using deep reinforcement learning

IF 4.2 3区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS
Computer Communications Pub Date : 2026-06-01 Epub Date: 2026-05-22 DOI:10.1016/j.comcom.2026.108568
Karel Toledo , Guillermo Donoso , Daniel Psijas , Javier Baladron
{"title":"Transforming wireless network efficiency with UAV path planning using deep reinforcement learning","authors":"Karel Toledo ,&nbsp;Guillermo Donoso ,&nbsp;Daniel Psijas ,&nbsp;Javier Baladron","doi":"10.1016/j.comcom.2026.108568","DOIUrl":null,"url":null,"abstract":"<div><div>Unmanned aerial vehicles (UAVs) are emerging as a key enabler for enhancing wireless network performance in dynamic and challenging environments. This paper systematically studied a deep reinforcement learning (DRL) framework for optimizing the trajectories of UAVs operating as mobile base station (MoBS). The problem is formulated as a Markov decision process (MDP) and solved using two DRL algorithms: Deep Q-network (DQN) and Proximal Policy Optimization (PPO). Seven reward functions are designed to maximize average channel capacity and fairness among ground terminals (GTs). The work further presents an in-depth analysis of reward shaping, diverse network configurations, and hyperparameter tuning. Simulation results show that the proposed approach outperforms static and non-adaptive baselines, achieving near-optimal performance under uncertain GT movement patterns. Scalability evaluations demonstrate strong generalization to larger network areas, providing valuable insights for DRL-based UAV path planning in next-generation wireless networks.</div></div>","PeriodicalId":55224,"journal":{"name":"Computer Communications","volume":"255 ","pages":"Article 108568"},"PeriodicalIF":4.2000,"publicationDate":"2026-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Communications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0140366426001581","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/5/22 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Unmanned aerial vehicles (UAVs) are emerging as a key enabler for enhancing wireless network performance in dynamic and challenging environments. This paper systematically studied a deep reinforcement learning (DRL) framework for optimizing the trajectories of UAVs operating as mobile base station (MoBS). The problem is formulated as a Markov decision process (MDP) and solved using two DRL algorithms: Deep Q-network (DQN) and Proximal Policy Optimization (PPO). Seven reward functions are designed to maximize average channel capacity and fairness among ground terminals (GTs). The work further presents an in-depth analysis of reward shaping, diverse network configurations, and hyperparameter tuning. Simulation results show that the proposed approach outperforms static and non-adaptive baselines, achieving near-optimal performance under uncertain GT movement patterns. Scalability evaluations demonstrate strong generalization to larger network areas, providing valuable insights for DRL-based UAV path planning in next-generation wireless networks.
基于深度强化学习的无人机路径规划改造无线网络效率
无人驾驶飞行器(uav)正在成为在动态和具有挑战性的环境中增强无线网络性能的关键推动者。本文系统地研究了一种用于无人机移动基站飞行轨迹优化的深度强化学习(DRL)框架。该问题被表述为马尔可夫决策过程(MDP),并使用两种DRL算法:Deep Q-network (DQN)和Proximal Policy Optimization (PPO)来解决。设计了七个奖励函数,以最大限度地提高地面终端(gt)之间的平均信道容量和公平性。这项工作进一步深入分析了奖励形成、不同的网络配置和超参数调优。仿真结果表明,该方法优于静态基线和非自适应基线,在不确定的GT运动模式下实现了接近最优的性能。可扩展性评估展示了对更大网络区域的强大泛化,为下一代无线网络中基于drl的无人机路径规划提供了有价值的见解。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Computer Communications
Computer Communications 工程技术-电信学
CiteScore
14.10
自引率
5.00%
发文量
397
审稿时长
66 days
期刊介绍: Computer and Communications networks are key infrastructures of the information society with high socio-economic value as they contribute to the correct operations of many critical services (from healthcare to finance and transportation). Internet is the core of today''s computer-communication infrastructures. This has transformed the Internet, from a robust network for data transfer between computers, to a global, content-rich, communication and information system where contents are increasingly generated by the users, and distributed according to human social relations. Next-generation network technologies, architectures and protocols are therefore required to overcome the limitations of the legacy Internet and add new capabilities and services. The future Internet should be ubiquitous, secure, resilient, and closer to human communication paradigms. Computer Communications is a peer-reviewed international journal that publishes high-quality scientific articles (both theory and practice) and survey papers covering all aspects of future computer communication networks (on all layers, except the physical layer), with a special attention to the evolution of the Internet architecture, protocols, services, and applications.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书