R. Millar, Leila Hashemi, Armin Mahmoodi, Robert Walter Meyer, J. Laliberté
{"title":"基于联合贝叶斯信念网络和多目标强化学习算法的无人与有人无人机数据网络集成","authors":"R. Millar, Leila Hashemi, Armin Mahmoodi, Robert Walter Meyer, J. Laliberté","doi":"10.1139/dsa-2022-0043","DOIUrl":null,"url":null,"abstract":"This paper presents and assesses the feasibility and potential of a novel concept: the operation of multiple unmanned vehicles (UAV) commanded and supported by a manned “Tender” air vehicle carrying a pilot and flight manager(s). The \"Tender\" is equipped to flexibly and economically monitor and manage multiple diverse UAVs over otherwise inaccessible terrain through wireless communication. Further, this paper seeks to find the optimal trajectories for UAVs to collect data from sensors in a predefined continuous space. We formulate the path-planning problem for a cooperative, and a diverse swarm of UAVs tasked with optimizing multiple objectives simultaneously with the goal of maximizing accumulated data within a given flight time within cloud data processing constraints as well as minimizing the probable imposed risk during UAVs mission. To this end, as the problem is formulated as a convex optimization model, and we propose a low complexity Multi-Objective Reinforcement Learning (MORL) algorithm with a provable performance guarantee to solve the problem efficiently. We show that the MORL architecture can be successfully trained and allows each UAV to map each observation of the network state to an action to make optimal movement decisions.","PeriodicalId":202289,"journal":{"name":"Drone Systems and Applications","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-01-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Integrating Unmanned and Manned UAVs data network based on combined Bayesian Belief network and Multi-objective reinforcement learning algorithm\",\"authors\":\"R. Millar, Leila Hashemi, Armin Mahmoodi, Robert Walter Meyer, J. Laliberté\",\"doi\":\"10.1139/dsa-2022-0043\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper presents and assesses the feasibility and potential of a novel concept: the operation of multiple unmanned vehicles (UAV) commanded and supported by a manned “Tender” air vehicle carrying a pilot and flight manager(s). The \\\"Tender\\\" is equipped to flexibly and economically monitor and manage multiple diverse UAVs over otherwise inaccessible terrain through wireless communication. Further, this paper seeks to find the optimal trajectories for UAVs to collect data from sensors in a predefined continuous space. We formulate the path-planning problem for a cooperative, and a diverse swarm of UAVs tasked with optimizing multiple objectives simultaneously with the goal of maximizing accumulated data within a given flight time within cloud data processing constraints as well as minimizing the probable imposed risk during UAVs mission. To this end, as the problem is formulated as a convex optimization model, and we propose a low complexity Multi-Objective Reinforcement Learning (MORL) algorithm with a provable performance guarantee to solve the problem efficiently. We show that the MORL architecture can be successfully trained and allows each UAV to map each observation of the network state to an action to make optimal movement decisions.\",\"PeriodicalId\":202289,\"journal\":{\"name\":\"Drone Systems and Applications\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-01-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Drone Systems and Applications\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1139/dsa-2022-0043\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Drone Systems and Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1139/dsa-2022-0043","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Integrating Unmanned and Manned UAVs data network based on combined Bayesian Belief network and Multi-objective reinforcement learning algorithm
This paper presents and assesses the feasibility and potential of a novel concept: the operation of multiple unmanned vehicles (UAV) commanded and supported by a manned “Tender” air vehicle carrying a pilot and flight manager(s). The "Tender" is equipped to flexibly and economically monitor and manage multiple diverse UAVs over otherwise inaccessible terrain through wireless communication. Further, this paper seeks to find the optimal trajectories for UAVs to collect data from sensors in a predefined continuous space. We formulate the path-planning problem for a cooperative, and a diverse swarm of UAVs tasked with optimizing multiple objectives simultaneously with the goal of maximizing accumulated data within a given flight time within cloud data processing constraints as well as minimizing the probable imposed risk during UAVs mission. To this end, as the problem is formulated as a convex optimization model, and we propose a low complexity Multi-Objective Reinforcement Learning (MORL) algorithm with a provable performance guarantee to solve the problem efficiently. We show that the MORL architecture can be successfully trained and allows each UAV to map each observation of the network state to an action to make optimal movement decisions.