Learning to Avoid Tragedies: Boundedly Rational Agents in Feedback-Evolving Games

IF 7 1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS
IEEE Transactions on Automatic Control Pub Date : 2026-10-01 Epub Date: 2026-04-29 DOI:10.1109/TAC.2026.3685548
R. Gavin;K. Paarporn;M. Cao
{"title":"Learning to Avoid Tragedies: Boundedly Rational Agents in Feedback-Evolving Games","authors":"R. Gavin;K. Paarporn;M. Cao","doi":"10.1109/TAC.2026.3685548","DOIUrl":null,"url":null,"abstract":"Many populations of individuals interact with a common pool of resources. Examples include fishermen and their fisheries and herders and their common land for pasture. The framework of feedback-evolving games incorporates this game-environment feedback, in which a population’s actions affect a shared environment, and in turn, the changing environment shapes incentives for future behaviors. A primary assumption in these models is that agents employ imitative learning processes, leading to the replicator equation describing their behavior. In this article, we investigate the dynamics when agents follow the logit protocol, a boundedly rational and information-based learning process. The primary question we seek to address is whether this more sophisticated learning process can avert tragic outcomes in scenarios where simpler, imitative learning cannot. To do so, we fully characterize stability properties for all two-strategy evolutionary games with environmental feedback, and find that there are regimes where logit learning can avoid tragedies where imitation learning cannot. Interestingly, this can only occur for intermediate levels of rationality. Then, we propose optimal incentive policies that a system operator could implement to promote the health of the environment. We identify cases where, counterintuitively, raising the population’s rationality level leads to worse environmental outcomes when applying the optimal incentive policy.","PeriodicalId":13201,"journal":{"name":"IEEE Transactions on Automatic Control","volume":"71 10","pages":"6401-6415"},"PeriodicalIF":7.0000,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Automatic Control","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11499399/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/4/29 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Many populations of individuals interact with a common pool of resources. Examples include fishermen and their fisheries and herders and their common land for pasture. The framework of feedback-evolving games incorporates this game-environment feedback, in which a population’s actions affect a shared environment, and in turn, the changing environment shapes incentives for future behaviors. A primary assumption in these models is that agents employ imitative learning processes, leading to the replicator equation describing their behavior. In this article, we investigate the dynamics when agents follow the logit protocol, a boundedly rational and information-based learning process. The primary question we seek to address is whether this more sophisticated learning process can avert tragic outcomes in scenarios where simpler, imitative learning cannot. To do so, we fully characterize stability properties for all two-strategy evolutionary games with environmental feedback, and find that there are regimes where logit learning can avoid tragedies where imitation learning cannot. Interestingly, this can only occur for intermediate levels of rationality. Then, we propose optimal incentive policies that a system operator could implement to promote the health of the environment. We identify cases where, counterintuitively, raising the population’s rationality level leads to worse environmental outcomes when applying the optimal incentive policy.
学习避免悲剧:反馈进化游戏中的有限理性代理
许多个体群体与一个公共资源池相互作用。例子包括渔民和他们的渔场,以及牧民和他们的公共牧场。反馈进化游戏的框架包含了这种游戏环境反馈,即玩家的行为会影响共享的环境,而环境的变化反过来又会形成对未来行为的激励。这些模型的一个主要假设是,代理采用模仿学习过程,导致复制方程描述他们的行为。在本文中,我们研究了当智能体遵循logit协议时的动态,这是一个有界理性和基于信息的学习过程。我们试图解决的主要问题是,在简单的模仿学习无法避免的情况下,这种更复杂的学习过程是否可以避免悲惨的结果。为此,我们充分描述了所有具有环境反馈的双策略进化博弈的稳定性特性,并发现存在逻辑学习可以避免模仿学习无法避免的悲剧的机制。有趣的是,这只会发生在中等水平的理性中。然后,我们提出了系统运营商可以实施的最优激励政策,以促进环境的健康。我们发现,在应用最优激励政策时,提高人口的理性水平会导致更糟糕的环境结果,这与直觉相反。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Automatic Control
IEEE Transactions on Automatic Control 工程技术-工程:电子与电气
CiteScore
11.30
自引率
5.90%
发文量
824
审稿时长
9 months
期刊介绍: In the IEEE Transactions on Automatic Control, the IEEE Control Systems Society publishes high-quality papers on the theory, design, and applications of control engineering. Two types of contributions are regularly considered: 1) Papers: Presentation of significant research, development, or application of control concepts. 2) Technical Notes and Correspondence: Brief technical notes, comments on published areas or established control topics, corrections to papers and notes published in the Transactions. In addition, special papers (tutorials, surveys, and perspectives on the theory and applications of control systems topics) are solicited.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书