{"title":"用强化学习革新fanet:优化数据转发和实时适应性","authors":"Yasir Ibraheem Mohammed;Rosilah Hassan;Mohammad Kamrul Hasan;Shayla Islam;Huda Saleh Abbas;Muhammad Asghar Khan;Muhammad Attique Khan","doi":"10.1109/OJCOMS.2025.3565471","DOIUrl":null,"url":null,"abstract":"Uncrewed Aerial Vehicles (UAVs), commonly known as drones, have significantly advanced wireless communication frameworks by enabling the formation of Flying Ad-Hoc Networks (FANETs). FANETs facilitate autonomous collaboration among UAVs through decentralized and self-organizing communication protocols, proving especially effective in dynamic applications such as military surveillance, disaster management, and environmental monitoring. Nevertheless, traditional routing algorithms, initially developed for terrestrial networks, often fail to meet the unique challenges of FANETs, notably their high mobility and frequently changing network topologies. A framework was proposed to address these challenges; this paper formulates a multi-objective optimization problem aimed at optimizing UAV trajectories, enhancing energy efficiency, and maximizing communication range to improve overall data forwarding performance. A Reinforcement Learning (RL)-based agent is created that constantly enhances its decision-making capacity by utilizing real-time feedback and dynamically chooses best forwarding tactics. This work also combines developments in large-scale data collecting from Wireless Sensor Networks (WSNs), using mobile sinks supported by FANETs in conjunction with multi-objective optimization approaches to improve data collecting efficiency greatly. Experimental tests show that the suggested RL-based techniques outperform conventional routing protocols by properly lowering delays and raising the Packet Delivery Ratio (PDR). Moreover, simulation findings show the better scalability and adaptability of RL-enabled UAV networks, stressing its possible use in dynamic real-world situations such as disaster relief operations and environmental monitoring tasks.","PeriodicalId":33803,"journal":{"name":"IEEE Open Journal of the Communications Society","volume":"6 ","pages":"4295-4310"},"PeriodicalIF":6.3000,"publicationDate":"2025-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10979975","citationCount":"0","resultStr":"{\"title\":\"Revolutionizing FANETs With Reinforcement Learning: Optimized Data Forwarding and Real-Time Adaptability\",\"authors\":\"Yasir Ibraheem Mohammed;Rosilah Hassan;Mohammad Kamrul Hasan;Shayla Islam;Huda Saleh Abbas;Muhammad Asghar Khan;Muhammad Attique Khan\",\"doi\":\"10.1109/OJCOMS.2025.3565471\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Uncrewed Aerial Vehicles (UAVs), commonly known as drones, have significantly advanced wireless communication frameworks by enabling the formation of Flying Ad-Hoc Networks (FANETs). FANETs facilitate autonomous collaboration among UAVs through decentralized and self-organizing communication protocols, proving especially effective in dynamic applications such as military surveillance, disaster management, and environmental monitoring. Nevertheless, traditional routing algorithms, initially developed for terrestrial networks, often fail to meet the unique challenges of FANETs, notably their high mobility and frequently changing network topologies. A framework was proposed to address these challenges; this paper formulates a multi-objective optimization problem aimed at optimizing UAV trajectories, enhancing energy efficiency, and maximizing communication range to improve overall data forwarding performance. A Reinforcement Learning (RL)-based agent is created that constantly enhances its decision-making capacity by utilizing real-time feedback and dynamically chooses best forwarding tactics. This work also combines developments in large-scale data collecting from Wireless Sensor Networks (WSNs), using mobile sinks supported by FANETs in conjunction with multi-objective optimization approaches to improve data collecting efficiency greatly. Experimental tests show that the suggested RL-based techniques outperform conventional routing protocols by properly lowering delays and raising the Packet Delivery Ratio (PDR). Moreover, simulation findings show the better scalability and adaptability of RL-enabled UAV networks, stressing its possible use in dynamic real-world situations such as disaster relief operations and environmental monitoring tasks.\",\"PeriodicalId\":33803,\"journal\":{\"name\":\"IEEE Open Journal of the Communications Society\",\"volume\":\"6 \",\"pages\":\"4295-4310\"},\"PeriodicalIF\":6.3000,\"publicationDate\":\"2025-04-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10979975\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Open Journal of the Communications Society\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10979975/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Open Journal of the Communications Society","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10979975/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Revolutionizing FANETs With Reinforcement Learning: Optimized Data Forwarding and Real-Time Adaptability
Uncrewed Aerial Vehicles (UAVs), commonly known as drones, have significantly advanced wireless communication frameworks by enabling the formation of Flying Ad-Hoc Networks (FANETs). FANETs facilitate autonomous collaboration among UAVs through decentralized and self-organizing communication protocols, proving especially effective in dynamic applications such as military surveillance, disaster management, and environmental monitoring. Nevertheless, traditional routing algorithms, initially developed for terrestrial networks, often fail to meet the unique challenges of FANETs, notably their high mobility and frequently changing network topologies. A framework was proposed to address these challenges; this paper formulates a multi-objective optimization problem aimed at optimizing UAV trajectories, enhancing energy efficiency, and maximizing communication range to improve overall data forwarding performance. A Reinforcement Learning (RL)-based agent is created that constantly enhances its decision-making capacity by utilizing real-time feedback and dynamically chooses best forwarding tactics. This work also combines developments in large-scale data collecting from Wireless Sensor Networks (WSNs), using mobile sinks supported by FANETs in conjunction with multi-objective optimization approaches to improve data collecting efficiency greatly. Experimental tests show that the suggested RL-based techniques outperform conventional routing protocols by properly lowering delays and raising the Packet Delivery Ratio (PDR). Moreover, simulation findings show the better scalability and adaptability of RL-enabled UAV networks, stressing its possible use in dynamic real-world situations such as disaster relief operations and environmental monitoring tasks.
期刊介绍:
The IEEE Open Journal of the Communications Society (OJ-COMS) is an open access, all-electronic journal that publishes original high-quality manuscripts on advances in the state of the art of telecommunications systems and networks. The papers in IEEE OJ-COMS are included in Scopus. Submissions reporting new theoretical findings (including novel methods, concepts, and studies) and practical contributions (including experiments and development of prototypes) are welcome. Additionally, survey and tutorial articles are considered. The IEEE OJCOMS received its debut impact factor of 7.9 according to the Journal Citation Reports (JCR) 2023.
The IEEE Open Journal of the Communications Society covers science, technology, applications and standards for information organization, collection and transfer using electronic, optical and wireless channels and networks. Some specific areas covered include:
Systems and network architecture, control and management
Protocols, software, and middleware
Quality of service, reliability, and security
Modulation, detection, coding, and signaling
Switching and routing
Mobile and portable communications
Terminals and other end-user devices
Networks for content distribution and distributed computing
Communications-based distributed resources control.