Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems最新文献

筛选

英文中文

Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems 第20届自主智能体与多智能体系统国际会议论文集

Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems Pub Date : 2020-12-18 DOI: 10.5555/3463952

Aravind Venugopal, Elizabeth Bondi-Kelly, Harshavardhan Kamarthi, Keval Dholakia, Balaraman Ravindran, M. Tambe

{"title":"Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems","authors":"Aravind Venugopal, Elizabeth Bondi-Kelly, Harshavardhan Kamarthi, Keval Dholakia, Balaraman Ravindran, M. Tambe","doi":"10.5555/3463952","DOIUrl":"https://doi.org/10.5555/3463952","url":null,"abstract":"Green Security Games (GSGs) have been successfully used in the protection of valuable resources such as fisheries, forests and wildlife. While real-world deployment involves both resource allocation and subsequent coordinated patrolling with communication and real-time, uncertain information, previous game models do not fully address both of these stages simultaneously. Furthermore, adopting existing solution strategies is difficult since they do not scale well for larger, more complex variants of the game models. We therefore first propose a novel GSG model that combines defender allocation, patrolling, real-time drone notification to human patrollers, and drones sending warning signals to attackers. The model further incorporates uncertainty for real-time decision-making within a team of drones and human patrollers. Second, we present CombSGPO, a novel and scalable algorithm based on reinforcement learning, to compute a defender strategy for this game model. CombSGPO performs policy search over a multi-dimensional, discrete action space to compute an allocation strategy that is best suited to a best-response patrolling strategy for the defender, learnt by training a multi-agent Deep Q-Network. We show via experiments that CombSGPO converges to better strategies and is more scalable than comparable approaches. Third, we provide a detailed analysis of the coordination and signaling behavior learnt by CombSGPO, showing group formation between defender resources and patrolling formations based on signaling and notifications between resources. Importantly, we find that strategic signaling emerges in the final learnt strategy. Finally, we perform experiments to evaluate these strategies under different levels of uncertainty.","PeriodicalId":447893,"journal":{"name":"Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134368649","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 5

Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems 第20届自主智能体与多智能体系统国际会议论文集

Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems Pub Date : 1900-01-01 DOI: 10.5555/3461017

引用次数: 16