奖励强化能持久促进目标行为

IF 3.1 3区 医学 Q2 NEUROSCIENCES
Ian C. Ballard, Michael Waskom, Kerry C. Nix, Mark D’Esposito
{"title":"奖励强化能持久促进目标行为","authors":"Ian C. Ballard, Michael Waskom, Kerry C. Nix, Mark D’Esposito","doi":"10.1162/jocn_a_02150","DOIUrl":null,"url":null,"abstract":"Stimulus–response habits benefit behavior by automatizing the selection of rewarding actions. However, this automaticity can come at the cost of reduced flexibility to adapt behavior when circumstances change. The goal-directed system is thought to counteract the habit system by providing the flexibility to pursue context-appropriate behaviors. The dichotomy between habitual action selection and flexible goal-directed behavior has recently been challenged by findings showing that rewards bias both action and goal selection. Here, we test whether reward reinforcement can give rise to habitual goal selection much as it gives rise to habitual action selection. We designed a rewarded, context-based perceptual discrimination task in which performance on one rule was reinforced. Using drift-diffusion models and psychometric analyses, we found that reward facilitates the initiation and execution of rules. Strikingly, we found that these biases persisted in a test phase in which rewards were no longer available. Although this facilitation is consistent with the habitual goal selection hypothesis, we did not find evidence that reward reinforcement reduced cognitive flexibility to implement alternative rules. Together, the findings suggest that reward creates a lasting impact on the selection and execution of goals but may not lead to the inflexibility characteristic of habits. Our findings demonstrate the role of the reward learning system in influencing how the goal-directed system selects and implements goals.","PeriodicalId":51081,"journal":{"name":"Journal of Cognitive Neuroscience","volume":null,"pages":null},"PeriodicalIF":3.1000,"publicationDate":"2024-04-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Reward Reinforcement Creates Enduring Facilitation of Goal-directed Behavior\",\"authors\":\"Ian C. Ballard, Michael Waskom, Kerry C. Nix, Mark D’Esposito\",\"doi\":\"10.1162/jocn_a_02150\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Stimulus–response habits benefit behavior by automatizing the selection of rewarding actions. However, this automaticity can come at the cost of reduced flexibility to adapt behavior when circumstances change. The goal-directed system is thought to counteract the habit system by providing the flexibility to pursue context-appropriate behaviors. The dichotomy between habitual action selection and flexible goal-directed behavior has recently been challenged by findings showing that rewards bias both action and goal selection. Here, we test whether reward reinforcement can give rise to habitual goal selection much as it gives rise to habitual action selection. We designed a rewarded, context-based perceptual discrimination task in which performance on one rule was reinforced. Using drift-diffusion models and psychometric analyses, we found that reward facilitates the initiation and execution of rules. Strikingly, we found that these biases persisted in a test phase in which rewards were no longer available. Although this facilitation is consistent with the habitual goal selection hypothesis, we did not find evidence that reward reinforcement reduced cognitive flexibility to implement alternative rules. Together, the findings suggest that reward creates a lasting impact on the selection and execution of goals but may not lead to the inflexibility characteristic of habits. Our findings demonstrate the role of the reward learning system in influencing how the goal-directed system selects and implements goals.\",\"PeriodicalId\":51081,\"journal\":{\"name\":\"Journal of Cognitive Neuroscience\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2024-04-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Cognitive Neuroscience\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1162/jocn_a_02150\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"NEUROSCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Cognitive Neuroscience","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1162/jocn_a_02150","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"NEUROSCIENCES","Score":null,"Total":0}
引用次数: 0

摘要

刺激-反应习惯通过自动选择有回报的行为而使行为受益。然而,这种自动性的代价可能是,当环境发生变化时,行为调整的灵活性会降低。目标导向系统被认为可以抵消习惯系统的作用,因为它提供了追求与环境相适应行为的灵活性。最近的研究结果表明,奖励同时偏向于行动和目标选择,这对习惯性行动选择和灵活的目标导向行为之间的二分法提出了挑战。在这里,我们检验了奖励强化是否会像习惯性行动选择一样引起习惯性目标选择。我们设计了一个基于情境的奖励性知觉辨别任务,在这个任务中,对一条规则的表现会得到强化。通过漂移扩散模型和心理测量分析,我们发现奖励有助于规则的启动和执行。令人吃惊的是,我们发现这些偏差在没有奖励的测试阶段依然存在。虽然这种促进作用与习惯性目标选择假说一致,但我们并没有发现证据表明奖励强化降低了执行替代规则的认知灵活性。总之,这些研究结果表明,奖励会对目标的选择和执行产生持久的影响,但可能不会导致习惯所特有的不灵活性。我们的研究结果证明了奖励学习系统在影响目标导向系统如何选择和执行目标方面所起的作用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Reward Reinforcement Creates Enduring Facilitation of Goal-directed Behavior
Stimulus–response habits benefit behavior by automatizing the selection of rewarding actions. However, this automaticity can come at the cost of reduced flexibility to adapt behavior when circumstances change. The goal-directed system is thought to counteract the habit system by providing the flexibility to pursue context-appropriate behaviors. The dichotomy between habitual action selection and flexible goal-directed behavior has recently been challenged by findings showing that rewards bias both action and goal selection. Here, we test whether reward reinforcement can give rise to habitual goal selection much as it gives rise to habitual action selection. We designed a rewarded, context-based perceptual discrimination task in which performance on one rule was reinforced. Using drift-diffusion models and psychometric analyses, we found that reward facilitates the initiation and execution of rules. Strikingly, we found that these biases persisted in a test phase in which rewards were no longer available. Although this facilitation is consistent with the habitual goal selection hypothesis, we did not find evidence that reward reinforcement reduced cognitive flexibility to implement alternative rules. Together, the findings suggest that reward creates a lasting impact on the selection and execution of goals but may not lead to the inflexibility characteristic of habits. Our findings demonstrate the role of the reward learning system in influencing how the goal-directed system selects and implements goals.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Cognitive Neuroscience
Journal of Cognitive Neuroscience 医学-神经科学
CiteScore
5.30
自引率
3.10%
发文量
151
审稿时长
3-8 weeks
期刊介绍: Journal of Cognitive Neuroscience investigates brain–behavior interaction and promotes lively interchange among the mind sciences.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信