{"title":"Learning to Avoid Tragedies: Boundedly Rational Agents in Feedback-Evolving Games","authors":"R. Gavin;K. Paarporn;M. Cao","doi":"10.1109/TAC.2026.3685548","DOIUrl":null,"url":null,"abstract":"Many populations of individuals interact with a common pool of resources. Examples include fishermen and their fisheries and herders and their common land for pasture. The framework of feedback-evolving games incorporates this game-environment feedback, in which a population’s actions affect a shared environment, and in turn, the changing environment shapes incentives for future behaviors. A primary assumption in these models is that agents employ imitative learning processes, leading to the replicator equation describing their behavior. In this article, we investigate the dynamics when agents follow the logit protocol, a boundedly rational and information-based learning process. The primary question we seek to address is whether this more sophisticated learning process can avert tragic outcomes in scenarios where simpler, imitative learning cannot. To do so, we fully characterize stability properties for all two-strategy evolutionary games with environmental feedback, and find that there are regimes where logit learning can avoid tragedies where imitation learning cannot. Interestingly, this can only occur for intermediate levels of rationality. Then, we propose optimal incentive policies that a system operator could implement to promote the health of the environment. We identify cases where, counterintuitively, raising the population’s rationality level leads to worse environmental outcomes when applying the optimal incentive policy.","PeriodicalId":13201,"journal":{"name":"IEEE Transactions on Automatic Control","volume":"71 10","pages":"6401-6415"},"PeriodicalIF":7.0000,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Automatic Control","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11499399/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/4/29 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Many populations of individuals interact with a common pool of resources. Examples include fishermen and their fisheries and herders and their common land for pasture. The framework of feedback-evolving games incorporates this game-environment feedback, in which a population’s actions affect a shared environment, and in turn, the changing environment shapes incentives for future behaviors. A primary assumption in these models is that agents employ imitative learning processes, leading to the replicator equation describing their behavior. In this article, we investigate the dynamics when agents follow the logit protocol, a boundedly rational and information-based learning process. The primary question we seek to address is whether this more sophisticated learning process can avert tragic outcomes in scenarios where simpler, imitative learning cannot. To do so, we fully characterize stability properties for all two-strategy evolutionary games with environmental feedback, and find that there are regimes where logit learning can avoid tragedies where imitation learning cannot. Interestingly, this can only occur for intermediate levels of rationality. Then, we propose optimal incentive policies that a system operator could implement to promote the health of the environment. We identify cases where, counterintuitively, raising the population’s rationality level leads to worse environmental outcomes when applying the optimal incentive policy.
期刊介绍:
In the IEEE Transactions on Automatic Control, the IEEE Control Systems Society publishes high-quality papers on the theory, design, and applications of control engineering. Two types of contributions are regularly considered:
1) Papers: Presentation of significant research, development, or application of control concepts.
2) Technical Notes and Correspondence: Brief technical notes, comments on published areas or established control topics, corrections to papers and notes published in the Transactions.
In addition, special papers (tutorials, surveys, and perspectives on the theory and applications of control systems topics) are solicited.