The elusive effects of incidental anxiety on reinforcement-learning.

Chih-Chung Ting, Stefano Palminteri, Maël Lebreton, Jan B Engelmann
{"title":"The elusive effects of incidental anxiety on reinforcement-learning.","authors":"Chih-Chung Ting,&nbsp;Stefano Palminteri,&nbsp;Maël Lebreton,&nbsp;Jan B Engelmann","doi":"10.1037/xlm0001033","DOIUrl":null,"url":null,"abstract":"<p><p>Anxiety is a common affective state, characterized by the subjectively unpleasant feelings of dread over an anticipated event. Anxiety is suspected to have important negative consequences on cognition, decision-making, and learning. Yet, despite a recent surge in studies investigating the specific effects of anxiety on reinforcement-learning, no coherent picture has emerged. Here, we investigated the effects of incidental anxiety on instrumental reinforcement-learning, while addressing several issues and defaults identified in a focused literature review. We used a rich experimental design, featuring both a learning and a transfer phase, and a manipulation of outcomes valence (gains vs losses). In two variants (N = 2 × 50) of this experimental paradigm, incidental anxiety was induced with an established threat-of-shock paradigm. Model-free results show that incidental anxiety effects seem limited to a small, but specific increase in postlearning performance measured by a transfer task. A comprehensive modeling effort revealed that, irrespective of the effects of anxiety, individuals give more weight to positive than negative outcomes, and tend to experience the omission of a loss as a gain (and vice versa). However, in line with results from our targeted literature survey, isolating specific computational effects of anxiety on learning per se proved to be challenging. Overall, our results suggest that learning mechanisms are more complex than traditionally presumed, and raise important concerns about the robustness of the effects of anxiety previously identified in simple reinforcement-learning studies. (PsycInfo Database Record (c) 2022 APA, all rights reserved).</p>","PeriodicalId":504300,"journal":{"name":"Journal of Experimental Psychology: Learning, Memory, and Cognition","volume":" ","pages":"619-642"},"PeriodicalIF":0.0000,"publicationDate":"2022-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"7","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Experimental Psychology: Learning, Memory, and Cognition","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/xlm0001033","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2021/9/13 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 7

Abstract

Anxiety is a common affective state, characterized by the subjectively unpleasant feelings of dread over an anticipated event. Anxiety is suspected to have important negative consequences on cognition, decision-making, and learning. Yet, despite a recent surge in studies investigating the specific effects of anxiety on reinforcement-learning, no coherent picture has emerged. Here, we investigated the effects of incidental anxiety on instrumental reinforcement-learning, while addressing several issues and defaults identified in a focused literature review. We used a rich experimental design, featuring both a learning and a transfer phase, and a manipulation of outcomes valence (gains vs losses). In two variants (N = 2 × 50) of this experimental paradigm, incidental anxiety was induced with an established threat-of-shock paradigm. Model-free results show that incidental anxiety effects seem limited to a small, but specific increase in postlearning performance measured by a transfer task. A comprehensive modeling effort revealed that, irrespective of the effects of anxiety, individuals give more weight to positive than negative outcomes, and tend to experience the omission of a loss as a gain (and vice versa). However, in line with results from our targeted literature survey, isolating specific computational effects of anxiety on learning per se proved to be challenging. Overall, our results suggest that learning mechanisms are more complex than traditionally presumed, and raise important concerns about the robustness of the effects of anxiety previously identified in simple reinforcement-learning studies. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

偶然焦虑对强化学习的难以捉摸的影响。
焦虑是一种常见的情感状态,其特征是对预期事件的主观不愉快的恐惧感觉。焦虑被怀疑对认知、决策和学习有重要的负面影响。然而,尽管最近调查焦虑对强化学习的具体影响的研究激增,但没有出现连贯的图景。在这里,我们调查了偶然焦虑对工具性强化学习的影响,同时解决了在一篇重点文献综述中发现的几个问题和默认值。我们采用了丰富的实验设计,包括学习阶段和迁移阶段,以及对结果效价(收益与损失)的操纵。在该实验范式的两个变体(N = 2 × 50)中,偶发焦虑是用既定的休克威胁范式诱导的。无模型结果表明,附带的焦虑效应似乎仅限于通过迁移任务测量的学习后表现的微小但具体的增加。一项全面的建模工作表明,无论焦虑的影响如何,个体更重视积极的结果而不是消极的结果,并且倾向于将失去的忽略视为获得(反之亦然)。然而,与我们的目标文献调查结果一致,孤立焦虑对学习本身的特定计算影响被证明是具有挑战性的。总的来说,我们的研究结果表明,学习机制比传统假设的要复杂得多,并且对之前在简单的强化学习研究中发现的焦虑效应的稳健性提出了重要的关注。(PsycInfo Database Record (c) 2022 APA,版权所有)。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信