Proceedings of the ... International Joint Conference on Autonomous Agents and Multiagent Systems : AAMAS. International Joint Conference on Autonomous Agents and Multiagent Systems最新文献

Reinforcement Learning Interventions on Boundedly Rational Human Agents in Frictionful Tasks. 在摩擦任务中对有限理性的人类代理进行强化学习干预。

Proceedings of the ... International Joint Conference on Autonomous Agents and Multiagent Systems : AAMAS. International Joint Conference on Autonomous Agents and Multiagent Systems Pub Date : 2024-05-01 Epub Date: 2024-05-06

Eura Nofshin, Siddharth Swaroop, Weiwei Pan, Susan Murphy, Finale Doshi-Velez

{"title":"Reinforcement Learning Interventions on Boundedly Rational Human Agents in Frictionful Tasks.","authors":"Eura Nofshin, Siddharth Swaroop, Weiwei Pan, Susan Murphy, Finale Doshi-Velez","doi":"","DOIUrl":"","url":null,"abstract":"Many important behavior changes are frictionful; they require individuals to expend effort over a long period with little immediate gratification. Here, an artificial intelligence (AI) agent can provide personalized interventions to help individuals stick to their goals. In these settings, the AI agent must personalize rapidly (before the individual disengages) and interpretably, to help us understand the behavioral interventions. In this paper, we introduce Behavior Model Reinforcement Learning (BMRL), a framework in which an AI agent intervenes on the parameters of a Markov Decision Process (MDP) belonging to a boundedly rational human agent. Our formulation of the human decision-maker as a planning agent allows us to attribute undesirable human policies (ones that do not lead to the goal) to their maladapted MDP parameters, such as an extremely low discount factor. Furthermore, we propose a class of tractable human models that captures fundamental behaviors in frictionful tasks. Introducing a notion of MDP equivalence specific to BMRL, we theoretically and empirically show that AI planning with our human models can lead to helpful policies on a wide range of more complex, ground-truth humans.","PeriodicalId":93357,"journal":{"name":"Proceedings of the ... International Joint Conference on Autonomous Agents and Multiagent Systems : AAMAS. International Joint Conference on Autonomous Agents and Multiagent Systems","volume":"2024 ","pages":"1482-1491"},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11460771/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142395887","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

An Active Learning Method for the Comparison of Agent-based Models. 基于智能体模型比较的主动学习方法。

Proceedings of the ... International Joint Conference on Autonomous Agents and Multiagent Systems : AAMAS. International Joint Conference on Autonomous Agents and Multiagent Systems Pub Date : 2020-05-01 Epub Date: 2020-05-05

Swapna Thorve, Zhihao Hu, Kiran Lakkaraju, Joshua Letchford, Anil Vullikanti, Achla Marathe, Samarth Swarup

引用次数: 0

Finding Spatial Clusters Susceptible to Epidemic Outbreaks due to Undervaccination. 发现由于疫苗接种不足而易受流行病爆发影响的空间集群。

Proceedings of the ... International Joint Conference on Autonomous Agents and Multiagent Systems : AAMAS. International Joint Conference on Autonomous Agents and Multiagent Systems Pub Date : 2020-05-01 Epub Date: 2020-05-05

Jose Cadena, Achla Marathe, Anil Vullikanti

{"title":"Finding Spatial Clusters Susceptible to Epidemic Outbreaks due to Undervaccination.","authors":"Jose Cadena, Achla Marathe, Anil Vullikanti","doi":"","DOIUrl":"","url":null,"abstract":"Geographical clusters of undervaccinated populations have emerged in various parts of the United States in recent years. Public health response involves surveillance and field work, which is very resource intensive. Given that public health resources are often limited, identifying and rank-ordering critical clusters can help prioritize and allocate scarce resources for surveillance and quick intervention. We quantify the criticality of a cluster as the additional number of infections caused if the cluster is underimmunized. We focus on finding clusters that maximize this measure and develop efficient approximation algorithms for finding critical clusters by exploiting structural properties of the problem. Our methods involve solving a more general problem of maximizing a submodular function on a graph with connectivity constraints. We apply our methods to the state of Minnesota, where we find clusters with significantly higher criticality than those obtained by heuristics used in public health.","PeriodicalId":93357,"journal":{"name":"Proceedings of the ... International Joint Conference on Autonomous Agents and Multiagent Systems : AAMAS. International Joint Conference on Autonomous Agents and Multiagent Systems","volume":"2020 ","pages":"1786-1788"},"PeriodicalIF":0.0,"publicationDate":"2020-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8300049/pdf/nihms-1639096.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39223536","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Theoretical Background 理论背景

Proceedings of the ... International Joint Conference on Autonomous Agents and Multiagent Systems : AAMAS. International Joint Conference on Autonomous Agents and Multiagent Systems Pub Date : 2020-03-20 DOI: 10.1201/9780429289613-2

M. Mahmoud

引用次数: 0

Behavior Model Calibration for Epidemic Simulations. 流行病模拟的行为模型校准。

Proceedings of the ... International Joint Conference on Autonomous Agents and Multiagent Systems : AAMAS. International Joint Conference on Autonomous Agents and Multiagent Systems Pub Date : 2018-07-01 Epub Date: 2018-07-09

Meghendra Singh, Achla Marathe, Madhav V Marathe, Samarth Swarup

引用次数: 0

An Anti-attack Model for Centralized C2C Reputation Evaluation Agent 集中式C2C信誉评估代理的抗攻击模型

Proceedings of the ... International Joint Conference on Autonomous Agents and Multiagent Systems : AAMAS. International Joint Conference on Autonomous Agents and Multiagent Systems Pub Date : 2016-01-01 DOI: 10.1109/ICA.2016.023

Shujuan Ji, Baohua Liu, Benfa Zou, Chun-jin Zhang

引用次数: 0

Unifying Control in a Layered Agent Architecture 分层代理体系结构中的统一控制

Proceedings of the ... International Joint Conference on Autonomous Agents and Multiagent Systems : AAMAS. International Joint Conference on Autonomous Agents and Multiagent Systems Pub Date : 2011-07-08 DOI: 10.22028/D291-25052

K. Fischer, J. Müller, M. Pischel

{"title":"Unifying Control in a Layered Agent Architecture","authors":"K. Fischer, J. Müller, M. Pischel","doi":"10.22028/D291-25052","DOIUrl":"https://doi.org/10.22028/D291-25052","url":null,"abstract":"In this paper, we set up a unifying perspective of the individual control layers of the architecture InteRRaP for autonomous interacting agents. InteRRaP is a pragmatic approach to designing complex dynamic agent societies, e.g. for robotics Muller & Pischel and cooperative scheduling applications Fischer et al.94. It is based on three general functions describing how the actions an agent commits to are derived from its perception and from its mental model: belief revision and abstraction, situation recognition and goal activation, and planning and scheduling. It is argued that each InteRRaP control layer - the behaviour-based layer, the local planning layer, and the cooperative planning layer - can be described by a combination of different instantiations of these control functions. The basic structure of a control layer is defined. The individual functions and their implementation in the different layers are outlined. We demonstrate various options for the design of interacting agents within this framework by means of an interacting robots application. The performance of different agent types in a multiagent environment is empirically evaluated by a series of experiments.","PeriodicalId":93357,"journal":{"name":"Proceedings of the ... International Joint Conference on Autonomous Agents and Multiagent Systems : AAMAS. International Joint Conference on Autonomous Agents and Multiagent Systems","volume":"11 1","pages":"446"},"PeriodicalIF":0.0,"publicationDate":"2011-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87971255","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 57

Spike Detection and Sorting: Combining Algebraic Differentiations with ICA 脉冲检测与排序:代数微分与ICA的结合

Proceedings of the ... International Joint Conference on Autonomous Agents and Multiagent Systems : AAMAS. International Joint Conference on Autonomous Agents and Multiagent Systems Pub Date : 2009-03-16 DOI: 10.1007/978-3-642-00599-2_60

Z. Tiganj, M. Mboup

引用次数: 16

Estimating Phase Linearity in the Frequency-Domain ICA Demixing Matrix 频域ICA解混矩阵的相位线性估计

Proceedings of the ... International Joint Conference on Autonomous Agents and Multiagent Systems : AAMAS. International Joint Conference on Autonomous Agents and Multiagent Systems Pub Date : 2009-03-16 DOI: 10.1007/978-3-642-00599-2_46

Keisuke Toyama, Mark D. Plumbley

引用次数: 2

An Implementation of Floral Scent Recognition System Using ICA Combined with Correlation Coefficients 基于ICA和相关系数的花香识别系统实现

Proceedings of the ... International Joint Conference on Autonomous Agents and Multiagent Systems : AAMAS. International Joint Conference on Autonomous Agents and Multiagent Systems Pub Date : 2009-03-16 DOI: 10.1007/978-3-642-00599-2_82

B. Cheon, Yong-Wan Roh, Dong-Ju Kim, Kwang-seok Hong

引用次数: 3