{"title":"基于邻居依赖的合作密度惩罚的局部平均场近端政策优化促进空间公共物品博弈中的合作","authors":"Jinshuo Yang;Zhaoqilin Yang;Wenjie Zhou;Xin Wang;Youliang Tian","doi":"10.1109/TCSS.2026.3720953","DOIUrl":null,"url":null,"abstract":"Spatial public goods games involve localized interactions and high-dimensional state spaces, making stable cooperation difficult. Traditional approaches often struggle to effectively capture neighborhood-level strategic interactions and dynamically align individual incentives with collective welfare. To resolve this issue, this article introduces a novel intelligent decision-making framework called local mean field proximal policy optimization with neighbor-dependent cooperative density punishment (LMFPPO-NCDP). The conventional mean field concept is reformulated as a localized statistical representation embedded into policy learning, enabling agents to adapt to neighborhood level cooperation dynamics. Additionally, a NCDP mechanism penalizes defectors according to local cooperation density without direct costs to cooperators. Experimental results demonstrate that LMFPPO-NCDP promotes rapid and stable cooperation under low enhancement factors. Compared with proximal policy optimization (PPO), Q-learning, and the Fermi update rule, the proposed framework achieves lower cooperation thresholds and more robust cooperative outcomes. Statistical analyses further confirm its robustness and effectiveness across different enhancement factors. The proposed framework provides a computational framework for analyzing adaptive cooperation in spatially structured multiagent systems.","PeriodicalId":13044,"journal":{"name":"IEEE Transactions on Computational Social Systems","volume":"13 5","pages":"5491-5500"},"PeriodicalIF":4.6000,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Promoting Cooperation in Spatial Public Goods Games via Local Mean Field Proximal Policy Optimization With Neighbor-Dependent Cooperative Density Punishment\",\"authors\":\"Jinshuo Yang;Zhaoqilin Yang;Wenjie Zhou;Xin Wang;Youliang Tian\",\"doi\":\"10.1109/TCSS.2026.3720953\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Spatial public goods games involve localized interactions and high-dimensional state spaces, making stable cooperation difficult. Traditional approaches often struggle to effectively capture neighborhood-level strategic interactions and dynamically align individual incentives with collective welfare. To resolve this issue, this article introduces a novel intelligent decision-making framework called local mean field proximal policy optimization with neighbor-dependent cooperative density punishment (LMFPPO-NCDP). The conventional mean field concept is reformulated as a localized statistical representation embedded into policy learning, enabling agents to adapt to neighborhood level cooperation dynamics. Additionally, a NCDP mechanism penalizes defectors according to local cooperation density without direct costs to cooperators. Experimental results demonstrate that LMFPPO-NCDP promotes rapid and stable cooperation under low enhancement factors. Compared with proximal policy optimization (PPO), Q-learning, and the Fermi update rule, the proposed framework achieves lower cooperation thresholds and more robust cooperative outcomes. Statistical analyses further confirm its robustness and effectiveness across different enhancement factors. The proposed framework provides a computational framework for analyzing adaptive cooperation in spatially structured multiagent systems.\",\"PeriodicalId\":13044,\"journal\":{\"name\":\"IEEE Transactions on Computational Social Systems\",\"volume\":\"13 5\",\"pages\":\"5491-5500\"},\"PeriodicalIF\":4.6000,\"publicationDate\":\"2026-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Computational Social Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/11652921/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2026/8/12 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, CYBERNETICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Computational Social Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11652921/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/8/12 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, CYBERNETICS","Score":null,"Total":0}
Promoting Cooperation in Spatial Public Goods Games via Local Mean Field Proximal Policy Optimization With Neighbor-Dependent Cooperative Density Punishment
Spatial public goods games involve localized interactions and high-dimensional state spaces, making stable cooperation difficult. Traditional approaches often struggle to effectively capture neighborhood-level strategic interactions and dynamically align individual incentives with collective welfare. To resolve this issue, this article introduces a novel intelligent decision-making framework called local mean field proximal policy optimization with neighbor-dependent cooperative density punishment (LMFPPO-NCDP). The conventional mean field concept is reformulated as a localized statistical representation embedded into policy learning, enabling agents to adapt to neighborhood level cooperation dynamics. Additionally, a NCDP mechanism penalizes defectors according to local cooperation density without direct costs to cooperators. Experimental results demonstrate that LMFPPO-NCDP promotes rapid and stable cooperation under low enhancement factors. Compared with proximal policy optimization (PPO), Q-learning, and the Fermi update rule, the proposed framework achieves lower cooperation thresholds and more robust cooperative outcomes. Statistical analyses further confirm its robustness and effectiveness across different enhancement factors. The proposed framework provides a computational framework for analyzing adaptive cooperation in spatially structured multiagent systems.
期刊介绍:
IEEE Transactions on Computational Social Systems focuses on such topics as modeling, simulation, analysis and understanding of social systems from the quantitative and/or computational perspective. "Systems" include man-man, man-machine and machine-machine organizations and adversarial situations as well as social media structures and their dynamics. More specifically, the proposed transactions publishes articles on modeling the dynamics of social systems, methodologies for incorporating and representing socio-cultural and behavioral aspects in computational modeling, analysis of social system behavior and structure, and paradigms for social systems modeling and simulation. The journal also features articles on social network dynamics, social intelligence and cognition, social systems design and architectures, socio-cultural modeling and representation, and computational behavior modeling, and their applications.