集体风险社会困境中的社会规范与合作:比较强化学习和基于规范的方法

N. Payette, Áron Székely, G. Andrighetto
{"title":"集体风险社会困境中的社会规范与合作:比较强化学习和基于规范的方法","authors":"N. Payette, Áron Székely, G. Andrighetto","doi":"10.1109/RO-MAN47096.2020.9223561","DOIUrl":null,"url":null,"abstract":"Human cooperation is both powerful and puzzling. Large-scale cooperation among genetically unrelated individuals makes humans unique with respect to all other animal species. Therefore, learning how cooperation emerges and persists is a key question for social scientists. Recently, scholars have recognized the importance of social norms as solutions to major local and large-scale collective action problems, from the management of water resources to the reduction of smoking in public places to the change in fertility practices. Yet a well-founded model of the effect of social norms on human cooperation is still lacking.We present here a version of the Experience-Weighted Attraction (EWA) reinforcement learning model that integrates norm-based considerations into its utility function that we call EWA+Norms. We compare the behaviour of this hybrid model to the standard EWA when applied to a collective risk social dilemma in which groups of individuals must reach a threshold level of cooperation to avoid the risk of catastrophe. We find that standard EWA is not sufficient for generating cooperation, but that EWA+Norms is. Next step is to compare simulation results with human behaviour in large-scale experiments.","PeriodicalId":383722,"journal":{"name":"2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)","volume":"41 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Social norms and cooperation in a collective-risk social dilemma: comparing reinforcing learning and norm-based approaches\",\"authors\":\"N. Payette, Áron Székely, G. Andrighetto\",\"doi\":\"10.1109/RO-MAN47096.2020.9223561\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Human cooperation is both powerful and puzzling. Large-scale cooperation among genetically unrelated individuals makes humans unique with respect to all other animal species. Therefore, learning how cooperation emerges and persists is a key question for social scientists. Recently, scholars have recognized the importance of social norms as solutions to major local and large-scale collective action problems, from the management of water resources to the reduction of smoking in public places to the change in fertility practices. Yet a well-founded model of the effect of social norms on human cooperation is still lacking.We present here a version of the Experience-Weighted Attraction (EWA) reinforcement learning model that integrates norm-based considerations into its utility function that we call EWA+Norms. We compare the behaviour of this hybrid model to the standard EWA when applied to a collective risk social dilemma in which groups of individuals must reach a threshold level of cooperation to avoid the risk of catastrophe. We find that standard EWA is not sufficient for generating cooperation, but that EWA+Norms is. Next step is to compare simulation results with human behaviour in large-scale experiments.\",\"PeriodicalId\":383722,\"journal\":{\"name\":\"2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)\",\"volume\":\"41 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/RO-MAN47096.2020.9223561\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/RO-MAN47096.2020.9223561","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

人类的合作既强大又令人费解。基因不相关的个体之间的大规模合作使人类在所有其他动物物种中独树一帜。因此,了解合作是如何产生和持续的是社会科学家的一个关键问题。最近,学者们已经认识到社会规范作为解决重大地方和大规模集体行动问题的重要性,从水资源管理到减少公共场所吸烟,再到改变生育习惯。然而,社会规范对人类合作的影响仍然缺乏一个有充分根据的模型。我们在这里提出了一个版本的经验加权吸引力(EWA)强化学习模型,该模型将基于规范的考虑集成到其效用函数中,我们称之为EWA+规范。在集体风险社会困境中,个体群体必须达到一定的合作阈值水平才能避免灾难风险,我们将这种混合模型的行为与标准EWA进行了比较。我们发现标准的EWA不足以产生合作,而EWA+规范则足以产生合作。下一步是将模拟结果与大规模实验中的人类行为进行比较。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Social norms and cooperation in a collective-risk social dilemma: comparing reinforcing learning and norm-based approaches
Human cooperation is both powerful and puzzling. Large-scale cooperation among genetically unrelated individuals makes humans unique with respect to all other animal species. Therefore, learning how cooperation emerges and persists is a key question for social scientists. Recently, scholars have recognized the importance of social norms as solutions to major local and large-scale collective action problems, from the management of water resources to the reduction of smoking in public places to the change in fertility practices. Yet a well-founded model of the effect of social norms on human cooperation is still lacking.We present here a version of the Experience-Weighted Attraction (EWA) reinforcement learning model that integrates norm-based considerations into its utility function that we call EWA+Norms. We compare the behaviour of this hybrid model to the standard EWA when applied to a collective risk social dilemma in which groups of individuals must reach a threshold level of cooperation to avoid the risk of catastrophe. We find that standard EWA is not sufficient for generating cooperation, but that EWA+Norms is. Next step is to compare simulation results with human behaviour in large-scale experiments.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信