Involvement of the rat anterior cingulate cortex in control of instrumental responses guided by reward expectancy.

IF 2.2
Judith Schweimer, Wolfgang Hauber
{"title":"Involvement of the rat anterior cingulate cortex in control of instrumental responses guided by reward expectancy.","authors":"Judith Schweimer,&nbsp;Wolfgang Hauber","doi":"10.1101/lm.90605","DOIUrl":null,"url":null,"abstract":"<p><p>The anterior cingulate cortex (ACC) plays a critical role in stimulus-reinforcement learning and reward-guided selection of actions. Here we conducted a series of experiments to further elucidate the role of the ACC in instrumental behavior involving effort-based decision-making and instrumental learning guided by reward-predictive stimuli. In Experiment 1, rats were trained on a cost-benefit T-maze task in which they could either choose to climb a barrier to obtain a high reward (four pellets) in one arm or a low reward (two pellets) in the other with no barrier present. In line with previous studies, our data reveal that rats with quinolinic acid lesions of the ACC selected the response involving less work and smaller reward. Experiment 2 demonstrates that breaking points of instrumental performance under a progressive ratio schedule were similar in sham-lesioned and ACC-lesioned rats. Thus, lesions of the ACC did not interfere with the effort a rat is willing to expend to obtain a specific reward in this test. In a subsequent task, we examined effort-based decision-making in a lever-press task where rats had the choice between pressing a lever to receive preferred food pellets under a progressive ratio schedule, or free feeding on a less preferred food, i.e. lab chow. Results show that sham- and ACC-lesioned animals had similar breaking points and ingested comparable amounts of less-preferred food. Together, the results of Experiment 1 and 2 suggest that the ACC plays a role in evaluating how much effort to expend for reward; however, the ACC is not necessary in all situations requiring an assessment of costs and benefits. In Experiment 3 we investigated learning and reversal learning of instrumental responses guided by reward predictive stimuli. A reaction time (RT) task demanding conditioned lever release was used in which the upcoming reward magnitude (five vs. one food pellet) was signalled in advance by discriminative visual stimuli. Results revealed that rats with ACC lesions were able to discriminate reward magnitude-predictive stimuli and to adapt instrumental behavior to reversed stimulus-reward magnitude contingencies. Thus, in a simple discrimination task as used here, the ACC appears not to be required to discriminate reward magnitude-predictive stimuli and to use the learned significance of the stimuli to guide instrumental behavior.</p>","PeriodicalId":520703,"journal":{"name":"Learning & memory (Cold Spring Harbor, N.Y.)","volume":" ","pages":"334-42"},"PeriodicalIF":2.2000,"publicationDate":"2005-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1101/lm.90605","citationCount":"141","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Learning & memory (Cold Spring Harbor, N.Y.)","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1101/lm.90605","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 141

Abstract

The anterior cingulate cortex (ACC) plays a critical role in stimulus-reinforcement learning and reward-guided selection of actions. Here we conducted a series of experiments to further elucidate the role of the ACC in instrumental behavior involving effort-based decision-making and instrumental learning guided by reward-predictive stimuli. In Experiment 1, rats were trained on a cost-benefit T-maze task in which they could either choose to climb a barrier to obtain a high reward (four pellets) in one arm or a low reward (two pellets) in the other with no barrier present. In line with previous studies, our data reveal that rats with quinolinic acid lesions of the ACC selected the response involving less work and smaller reward. Experiment 2 demonstrates that breaking points of instrumental performance under a progressive ratio schedule were similar in sham-lesioned and ACC-lesioned rats. Thus, lesions of the ACC did not interfere with the effort a rat is willing to expend to obtain a specific reward in this test. In a subsequent task, we examined effort-based decision-making in a lever-press task where rats had the choice between pressing a lever to receive preferred food pellets under a progressive ratio schedule, or free feeding on a less preferred food, i.e. lab chow. Results show that sham- and ACC-lesioned animals had similar breaking points and ingested comparable amounts of less-preferred food. Together, the results of Experiment 1 and 2 suggest that the ACC plays a role in evaluating how much effort to expend for reward; however, the ACC is not necessary in all situations requiring an assessment of costs and benefits. In Experiment 3 we investigated learning and reversal learning of instrumental responses guided by reward predictive stimuli. A reaction time (RT) task demanding conditioned lever release was used in which the upcoming reward magnitude (five vs. one food pellet) was signalled in advance by discriminative visual stimuli. Results revealed that rats with ACC lesions were able to discriminate reward magnitude-predictive stimuli and to adapt instrumental behavior to reversed stimulus-reward magnitude contingencies. Thus, in a simple discrimination task as used here, the ACC appears not to be required to discriminate reward magnitude-predictive stimuli and to use the learned significance of the stimuli to guide instrumental behavior.

大鼠前扣带皮层在奖赏预期引导下控制工具性反应的参与。
前扣带皮层(ACC)在刺激强化学习和奖励导向行为选择中起着至关重要的作用。本研究通过一系列实验进一步阐明前扣带皮层在奖励预测刺激引导下的基于努力的决策和工具学习的工具行为中的作用。在实验1中,大鼠接受了一个成本-收益t迷宫任务的训练,在这个任务中,它们可以选择爬上一个障碍,在没有障碍的情况下,一只手臂获得高奖励(四个小球),或者另一只手臂获得低奖励(两个小球)。与之前的研究一致,我们的数据显示,患有喹啉酸损伤的ACC大鼠选择的反应涉及较少的工作和较小的奖励。实验2表明,假性损伤大鼠和acc损伤大鼠在递进比法下的乐器演奏断裂点相似。因此,在这个测试中,前扣带皮层的损伤并不会干扰大鼠为获得特定奖励而付出的努力。在随后的任务中,我们在杠杆按压任务中检查了基于努力的决策,在该任务中,大鼠可以选择按压杠杆以获得渐进比例计划下的首选食物颗粒,或者免费喂食不太喜欢的食物,即实验室食物。结果表明,假性和acc损伤的动物具有相似的断裂点,并且摄入了相当数量的不喜欢的食物。综上所述,实验1和2的结果表明,前扣带皮层在评估为获得奖励而付出多少努力方面发挥了作用;但是,行政协调会并非在所有需要评估成本和效益的情况下都是必要的。实验3研究了奖励预测刺激下工具反应的学习和反转学习。在一项要求条件杠杆释放的反应时间(RT)任务中,即将到来的奖励大小(5 vs 1食物颗粒)通过判别性视觉刺激提前发出信号。结果显示,ACC损伤的大鼠能够区分奖励大小预测刺激,并适应工具行为以逆转刺激-奖励大小的随变。因此,在这里使用的一个简单的区分任务中,前扣带皮层似乎不需要区分奖励大小预测刺激,也不需要使用刺激物的习得意义来指导工具性行为。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书