Ross D. Arnold, M. Osinski, Christopher Reddy, Austin Lowey
{"title":"基于无人机系统群的协同搜救强化学习","authors":"Ross D. Arnold, M. Osinski, Christopher Reddy, Austin Lowey","doi":"10.1109/HST56032.2022.10025435","DOIUrl":null,"url":null,"abstract":"This work presents a novel approach to search and rescue, and other wide-area search problems, by combining the effectiveness of deep reinforcement learning (DRL) with the power of Subsumption architecture in a collaborative multi-agent system. We present a multi-agent parameter-sharing deep reinforcement learning paradigm with an action space consisting of the activation of an array of premade “roles.” Each role is a collection of individual behaviors organized in a Subsumption-inspired hierarchy. We describe a low-cost implementation of our approach and its results using a basic DRL algorithm, DQN, and a simple reward signal. Using only a small amount of training time and power with our minimal implementation, we were able to see improvement in swarm performance over baseline statistical methods. These results indicate that our technique can be extended to achieve even greater performance results over a wide variety of problem sets. Additionally, this technique can be extended to many problems within the swarm and collaborative multi-agent system space.","PeriodicalId":162426,"journal":{"name":"2022 IEEE International Symposium on Technologies for Homeland Security (HST)","volume":"6 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Reinforcement Learning for Collaborative Search and Rescue Using Unmanned Aircraft System Swarms\",\"authors\":\"Ross D. Arnold, M. Osinski, Christopher Reddy, Austin Lowey\",\"doi\":\"10.1109/HST56032.2022.10025435\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This work presents a novel approach to search and rescue, and other wide-area search problems, by combining the effectiveness of deep reinforcement learning (DRL) with the power of Subsumption architecture in a collaborative multi-agent system. We present a multi-agent parameter-sharing deep reinforcement learning paradigm with an action space consisting of the activation of an array of premade “roles.” Each role is a collection of individual behaviors organized in a Subsumption-inspired hierarchy. We describe a low-cost implementation of our approach and its results using a basic DRL algorithm, DQN, and a simple reward signal. Using only a small amount of training time and power with our minimal implementation, we were able to see improvement in swarm performance over baseline statistical methods. These results indicate that our technique can be extended to achieve even greater performance results over a wide variety of problem sets. Additionally, this technique can be extended to many problems within the swarm and collaborative multi-agent system space.\",\"PeriodicalId\":162426,\"journal\":{\"name\":\"2022 IEEE International Symposium on Technologies for Homeland Security (HST)\",\"volume\":\"6 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-11-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE International Symposium on Technologies for Homeland Security (HST)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/HST56032.2022.10025435\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE International Symposium on Technologies for Homeland Security (HST)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/HST56032.2022.10025435","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Reinforcement Learning for Collaborative Search and Rescue Using Unmanned Aircraft System Swarms
This work presents a novel approach to search and rescue, and other wide-area search problems, by combining the effectiveness of deep reinforcement learning (DRL) with the power of Subsumption architecture in a collaborative multi-agent system. We present a multi-agent parameter-sharing deep reinforcement learning paradigm with an action space consisting of the activation of an array of premade “roles.” Each role is a collection of individual behaviors organized in a Subsumption-inspired hierarchy. We describe a low-cost implementation of our approach and its results using a basic DRL algorithm, DQN, and a simple reward signal. Using only a small amount of training time and power with our minimal implementation, we were able to see improvement in swarm performance over baseline statistical methods. These results indicate that our technique can be extended to achieve even greater performance results over a wide variety of problem sets. Additionally, this technique can be extended to many problems within the swarm and collaborative multi-agent system space.