{"title":"通过强化学习促进自愿囚徒困境博弈中的合作。","authors":"Yijie Huang, Yanhong Chen","doi":"10.1063/5.0267846","DOIUrl":null,"url":null,"abstract":"<p><p>Reinforcement learning technology has been empirically demonstrated to facilitate cooperation in game models. However, traditional research has primarily focused on two-strategy frameworks (cooperation and defection), which inadequately captures the complexity of real-world scenarios. To address this limitation, we integrated Q-learning into the prisoner's dilemma game, incorporating three strategies: cooperation, defection, and going it alone. We defined each agent's state based on the number of neighboring agents opting for cooperation and included social payoff in the Q-table update process. Numerical simulations indicate that this framework significantly enhances cooperation and average payoff as the degree of social-attention increases. This phenomenon occurs because social payoff enables individuals to move beyond narrow self-interest and consider broader social benefits. Additionally, we conducted a thorough analysis of the mechanisms underlying this enhancement of cooperation.</p>","PeriodicalId":9974,"journal":{"name":"Chaos","volume":"35 4","pages":""},"PeriodicalIF":2.7000,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Promoting cooperation in the voluntary prisoner's dilemma game via reinforcement learning.\",\"authors\":\"Yijie Huang, Yanhong Chen\",\"doi\":\"10.1063/5.0267846\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Reinforcement learning technology has been empirically demonstrated to facilitate cooperation in game models. However, traditional research has primarily focused on two-strategy frameworks (cooperation and defection), which inadequately captures the complexity of real-world scenarios. To address this limitation, we integrated Q-learning into the prisoner's dilemma game, incorporating three strategies: cooperation, defection, and going it alone. We defined each agent's state based on the number of neighboring agents opting for cooperation and included social payoff in the Q-table update process. Numerical simulations indicate that this framework significantly enhances cooperation and average payoff as the degree of social-attention increases. This phenomenon occurs because social payoff enables individuals to move beyond narrow self-interest and consider broader social benefits. Additionally, we conducted a thorough analysis of the mechanisms underlying this enhancement of cooperation.</p>\",\"PeriodicalId\":9974,\"journal\":{\"name\":\"Chaos\",\"volume\":\"35 4\",\"pages\":\"\"},\"PeriodicalIF\":2.7000,\"publicationDate\":\"2025-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Chaos\",\"FirstCategoryId\":\"100\",\"ListUrlMain\":\"https://doi.org/10.1063/5.0267846\",\"RegionNum\":2,\"RegionCategory\":\"数学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MATHEMATICS, APPLIED\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Chaos","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.1063/5.0267846","RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MATHEMATICS, APPLIED","Score":null,"Total":0}
Promoting cooperation in the voluntary prisoner's dilemma game via reinforcement learning.
Reinforcement learning technology has been empirically demonstrated to facilitate cooperation in game models. However, traditional research has primarily focused on two-strategy frameworks (cooperation and defection), which inadequately captures the complexity of real-world scenarios. To address this limitation, we integrated Q-learning into the prisoner's dilemma game, incorporating three strategies: cooperation, defection, and going it alone. We defined each agent's state based on the number of neighboring agents opting for cooperation and included social payoff in the Q-table update process. Numerical simulations indicate that this framework significantly enhances cooperation and average payoff as the degree of social-attention increases. This phenomenon occurs because social payoff enables individuals to move beyond narrow self-interest and consider broader social benefits. Additionally, we conducted a thorough analysis of the mechanisms underlying this enhancement of cooperation.
期刊介绍:
Chaos: An Interdisciplinary Journal of Nonlinear Science is a peer-reviewed journal devoted to increasing the understanding of nonlinear phenomena and describing the manifestations in a manner comprehensible to researchers from a broad spectrum of disciplines.