Chih-Chung Ting, Stefano Palminteri, Maël Lebreton, Jan B Engelmann
{"title":"偶然焦虑对强化学习的难以捉摸的影响。","authors":"Chih-Chung Ting, Stefano Palminteri, Maël Lebreton, Jan B Engelmann","doi":"10.1037/xlm0001033","DOIUrl":null,"url":null,"abstract":"<p><p>Anxiety is a common affective state, characterized by the subjectively unpleasant feelings of dread over an anticipated event. Anxiety is suspected to have important negative consequences on cognition, decision-making, and learning. Yet, despite a recent surge in studies investigating the specific effects of anxiety on reinforcement-learning, no coherent picture has emerged. Here, we investigated the effects of incidental anxiety on instrumental reinforcement-learning, while addressing several issues and defaults identified in a focused literature review. We used a rich experimental design, featuring both a learning and a transfer phase, and a manipulation of outcomes valence (gains vs losses). In two variants (N = 2 × 50) of this experimental paradigm, incidental anxiety was induced with an established threat-of-shock paradigm. Model-free results show that incidental anxiety effects seem limited to a small, but specific increase in postlearning performance measured by a transfer task. A comprehensive modeling effort revealed that, irrespective of the effects of anxiety, individuals give more weight to positive than negative outcomes, and tend to experience the omission of a loss as a gain (and vice versa). However, in line with results from our targeted literature survey, isolating specific computational effects of anxiety on learning per se proved to be challenging. Overall, our results suggest that learning mechanisms are more complex than traditionally presumed, and raise important concerns about the robustness of the effects of anxiety previously identified in simple reinforcement-learning studies. (PsycInfo Database Record (c) 2022 APA, all rights reserved).</p>","PeriodicalId":504300,"journal":{"name":"Journal of Experimental Psychology: Learning, Memory, and Cognition","volume":" ","pages":"619-642"},"PeriodicalIF":0.0000,"publicationDate":"2022-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"7","resultStr":"{\"title\":\"The elusive effects of incidental anxiety on reinforcement-learning.\",\"authors\":\"Chih-Chung Ting, Stefano Palminteri, Maël Lebreton, Jan B Engelmann\",\"doi\":\"10.1037/xlm0001033\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Anxiety is a common affective state, characterized by the subjectively unpleasant feelings of dread over an anticipated event. Anxiety is suspected to have important negative consequences on cognition, decision-making, and learning. Yet, despite a recent surge in studies investigating the specific effects of anxiety on reinforcement-learning, no coherent picture has emerged. Here, we investigated the effects of incidental anxiety on instrumental reinforcement-learning, while addressing several issues and defaults identified in a focused literature review. We used a rich experimental design, featuring both a learning and a transfer phase, and a manipulation of outcomes valence (gains vs losses). In two variants (N = 2 × 50) of this experimental paradigm, incidental anxiety was induced with an established threat-of-shock paradigm. Model-free results show that incidental anxiety effects seem limited to a small, but specific increase in postlearning performance measured by a transfer task. A comprehensive modeling effort revealed that, irrespective of the effects of anxiety, individuals give more weight to positive than negative outcomes, and tend to experience the omission of a loss as a gain (and vice versa). However, in line with results from our targeted literature survey, isolating specific computational effects of anxiety on learning per se proved to be challenging. Overall, our results suggest that learning mechanisms are more complex than traditionally presumed, and raise important concerns about the robustness of the effects of anxiety previously identified in simple reinforcement-learning studies. (PsycInfo Database Record (c) 2022 APA, all rights reserved).</p>\",\"PeriodicalId\":504300,\"journal\":{\"name\":\"Journal of Experimental Psychology: Learning, Memory, and Cognition\",\"volume\":\" \",\"pages\":\"619-642\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"7\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Experimental Psychology: Learning, Memory, and Cognition\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1037/xlm0001033\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2021/9/13 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Experimental Psychology: Learning, Memory, and Cognition","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/xlm0001033","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2021/9/13 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 7
摘要
焦虑是一种常见的情感状态,其特征是对预期事件的主观不愉快的恐惧感觉。焦虑被怀疑对认知、决策和学习有重要的负面影响。然而,尽管最近调查焦虑对强化学习的具体影响的研究激增,但没有出现连贯的图景。在这里,我们调查了偶然焦虑对工具性强化学习的影响,同时解决了在一篇重点文献综述中发现的几个问题和默认值。我们采用了丰富的实验设计,包括学习阶段和迁移阶段,以及对结果效价(收益与损失)的操纵。在该实验范式的两个变体(N = 2 × 50)中,偶发焦虑是用既定的休克威胁范式诱导的。无模型结果表明,附带的焦虑效应似乎仅限于通过迁移任务测量的学习后表现的微小但具体的增加。一项全面的建模工作表明,无论焦虑的影响如何,个体更重视积极的结果而不是消极的结果,并且倾向于将失去的忽略视为获得(反之亦然)。然而,与我们的目标文献调查结果一致,孤立焦虑对学习本身的特定计算影响被证明是具有挑战性的。总的来说,我们的研究结果表明,学习机制比传统假设的要复杂得多,并且对之前在简单的强化学习研究中发现的焦虑效应的稳健性提出了重要的关注。(PsycInfo Database Record (c) 2022 APA,版权所有)。
The elusive effects of incidental anxiety on reinforcement-learning.
Anxiety is a common affective state, characterized by the subjectively unpleasant feelings of dread over an anticipated event. Anxiety is suspected to have important negative consequences on cognition, decision-making, and learning. Yet, despite a recent surge in studies investigating the specific effects of anxiety on reinforcement-learning, no coherent picture has emerged. Here, we investigated the effects of incidental anxiety on instrumental reinforcement-learning, while addressing several issues and defaults identified in a focused literature review. We used a rich experimental design, featuring both a learning and a transfer phase, and a manipulation of outcomes valence (gains vs losses). In two variants (N = 2 × 50) of this experimental paradigm, incidental anxiety was induced with an established threat-of-shock paradigm. Model-free results show that incidental anxiety effects seem limited to a small, but specific increase in postlearning performance measured by a transfer task. A comprehensive modeling effort revealed that, irrespective of the effects of anxiety, individuals give more weight to positive than negative outcomes, and tend to experience the omission of a loss as a gain (and vice versa). However, in line with results from our targeted literature survey, isolating specific computational effects of anxiety on learning per se proved to be challenging. Overall, our results suggest that learning mechanisms are more complex than traditionally presumed, and raise important concerns about the robustness of the effects of anxiety previously identified in simple reinforcement-learning studies. (PsycInfo Database Record (c) 2022 APA, all rights reserved).