用强化学习革新fanet:优化数据转发和实时适应性

IF 6.3 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Yasir Ibraheem Mohammed;Rosilah Hassan;Mohammad Kamrul Hasan;Shayla Islam;Huda Saleh Abbas;Muhammad Asghar Khan;Muhammad Attique Khan
{"title":"用强化学习革新fanet:优化数据转发和实时适应性","authors":"Yasir Ibraheem Mohammed;Rosilah Hassan;Mohammad Kamrul Hasan;Shayla Islam;Huda Saleh Abbas;Muhammad Asghar Khan;Muhammad Attique Khan","doi":"10.1109/OJCOMS.2025.3565471","DOIUrl":null,"url":null,"abstract":"Uncrewed Aerial Vehicles (UAVs), commonly known as drones, have significantly advanced wireless communication frameworks by enabling the formation of Flying Ad-Hoc Networks (FANETs). FANETs facilitate autonomous collaboration among UAVs through decentralized and self-organizing communication protocols, proving especially effective in dynamic applications such as military surveillance, disaster management, and environmental monitoring. Nevertheless, traditional routing algorithms, initially developed for terrestrial networks, often fail to meet the unique challenges of FANETs, notably their high mobility and frequently changing network topologies. A framework was proposed to address these challenges; this paper formulates a multi-objective optimization problem aimed at optimizing UAV trajectories, enhancing energy efficiency, and maximizing communication range to improve overall data forwarding performance. A Reinforcement Learning (RL)-based agent is created that constantly enhances its decision-making capacity by utilizing real-time feedback and dynamically chooses best forwarding tactics. This work also combines developments in large-scale data collecting from Wireless Sensor Networks (WSNs), using mobile sinks supported by FANETs in conjunction with multi-objective optimization approaches to improve data collecting efficiency greatly. Experimental tests show that the suggested RL-based techniques outperform conventional routing protocols by properly lowering delays and raising the Packet Delivery Ratio (PDR). Moreover, simulation findings show the better scalability and adaptability of RL-enabled UAV networks, stressing its possible use in dynamic real-world situations such as disaster relief operations and environmental monitoring tasks.","PeriodicalId":33803,"journal":{"name":"IEEE Open Journal of the Communications Society","volume":"6 ","pages":"4295-4310"},"PeriodicalIF":6.3000,"publicationDate":"2025-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10979975","citationCount":"0","resultStr":"{\"title\":\"Revolutionizing FANETs With Reinforcement Learning: Optimized Data Forwarding and Real-Time Adaptability\",\"authors\":\"Yasir Ibraheem Mohammed;Rosilah Hassan;Mohammad Kamrul Hasan;Shayla Islam;Huda Saleh Abbas;Muhammad Asghar Khan;Muhammad Attique Khan\",\"doi\":\"10.1109/OJCOMS.2025.3565471\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Uncrewed Aerial Vehicles (UAVs), commonly known as drones, have significantly advanced wireless communication frameworks by enabling the formation of Flying Ad-Hoc Networks (FANETs). FANETs facilitate autonomous collaboration among UAVs through decentralized and self-organizing communication protocols, proving especially effective in dynamic applications such as military surveillance, disaster management, and environmental monitoring. Nevertheless, traditional routing algorithms, initially developed for terrestrial networks, often fail to meet the unique challenges of FANETs, notably their high mobility and frequently changing network topologies. A framework was proposed to address these challenges; this paper formulates a multi-objective optimization problem aimed at optimizing UAV trajectories, enhancing energy efficiency, and maximizing communication range to improve overall data forwarding performance. A Reinforcement Learning (RL)-based agent is created that constantly enhances its decision-making capacity by utilizing real-time feedback and dynamically chooses best forwarding tactics. This work also combines developments in large-scale data collecting from Wireless Sensor Networks (WSNs), using mobile sinks supported by FANETs in conjunction with multi-objective optimization approaches to improve data collecting efficiency greatly. Experimental tests show that the suggested RL-based techniques outperform conventional routing protocols by properly lowering delays and raising the Packet Delivery Ratio (PDR). Moreover, simulation findings show the better scalability and adaptability of RL-enabled UAV networks, stressing its possible use in dynamic real-world situations such as disaster relief operations and environmental monitoring tasks.\",\"PeriodicalId\":33803,\"journal\":{\"name\":\"IEEE Open Journal of the Communications Society\",\"volume\":\"6 \",\"pages\":\"4295-4310\"},\"PeriodicalIF\":6.3000,\"publicationDate\":\"2025-04-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10979975\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Open Journal of the Communications Society\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10979975/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Open Journal of the Communications Society","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10979975/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

无人驾驶飞行器(uav),通常被称为无人机,通过形成飞行自组织网络(fanet),具有显著先进的无线通信框架。fanet通过分散和自组织通信协议促进无人机之间的自主协作,在军事监视、灾害管理和环境监测等动态应用中特别有效。然而,最初为地面网络开发的传统路由算法往往无法满足fanet的独特挑战,特别是其高移动性和频繁变化的网络拓扑结构。提出了一个框架来应对这些挑战;本文提出了一种多目标优化问题,旨在优化无人机轨迹,提高能效,最大化通信距离,以提高整体数据转发性能。建立了一个基于强化学习的智能体,利用实时反馈不断增强其决策能力,并动态选择最佳转发策略。这项工作还结合了无线传感器网络(WSNs)大规模数据收集的发展,使用由fanet支持的移动接收器与多目标优化方法相结合,大大提高了数据收集效率。实验结果表明,本文提出的基于rl的路由技术通过适当降低延迟和提高分组投递率(PDR)来优于传统路由协议。此外,仿真结果表明,rl支持的无人机网络具有更好的可扩展性和适应性,强调了其在救灾行动和环境监测任务等动态现实情况下的可能应用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Revolutionizing FANETs With Reinforcement Learning: Optimized Data Forwarding and Real-Time Adaptability
Uncrewed Aerial Vehicles (UAVs), commonly known as drones, have significantly advanced wireless communication frameworks by enabling the formation of Flying Ad-Hoc Networks (FANETs). FANETs facilitate autonomous collaboration among UAVs through decentralized and self-organizing communication protocols, proving especially effective in dynamic applications such as military surveillance, disaster management, and environmental monitoring. Nevertheless, traditional routing algorithms, initially developed for terrestrial networks, often fail to meet the unique challenges of FANETs, notably their high mobility and frequently changing network topologies. A framework was proposed to address these challenges; this paper formulates a multi-objective optimization problem aimed at optimizing UAV trajectories, enhancing energy efficiency, and maximizing communication range to improve overall data forwarding performance. A Reinforcement Learning (RL)-based agent is created that constantly enhances its decision-making capacity by utilizing real-time feedback and dynamically chooses best forwarding tactics. This work also combines developments in large-scale data collecting from Wireless Sensor Networks (WSNs), using mobile sinks supported by FANETs in conjunction with multi-objective optimization approaches to improve data collecting efficiency greatly. Experimental tests show that the suggested RL-based techniques outperform conventional routing protocols by properly lowering delays and raising the Packet Delivery Ratio (PDR). Moreover, simulation findings show the better scalability and adaptability of RL-enabled UAV networks, stressing its possible use in dynamic real-world situations such as disaster relief operations and environmental monitoring tasks.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
13.70
自引率
3.80%
发文量
94
审稿时长
10 weeks
期刊介绍: The IEEE Open Journal of the Communications Society (OJ-COMS) is an open access, all-electronic journal that publishes original high-quality manuscripts on advances in the state of the art of telecommunications systems and networks. The papers in IEEE OJ-COMS are included in Scopus. Submissions reporting new theoretical findings (including novel methods, concepts, and studies) and practical contributions (including experiments and development of prototypes) are welcome. Additionally, survey and tutorial articles are considered. The IEEE OJCOMS received its debut impact factor of 7.9 according to the Journal Citation Reports (JCR) 2023. The IEEE Open Journal of the Communications Society covers science, technology, applications and standards for information organization, collection and transfer using electronic, optical and wireless channels and networks. Some specific areas covered include: Systems and network architecture, control and management Protocols, software, and middleware Quality of service, reliability, and security Modulation, detection, coding, and signaling Switching and routing Mobile and portable communications Terminals and other end-user devices Networks for content distribution and distributed computing Communications-based distributed resources control.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信