D2 多巴胺受体的表达、对奖励的反应性以及复杂价值决策任务中的强化学习。

Cristina Banuelos, Kasey Creswell, Catherine Walsh, Stephen B Manuck, Peter J Gianaros, Timothy Verstynen
{"title":"D2 多巴胺受体的表达、对奖励的反应性以及复杂价值决策任务中的强化学习。","authors":"Cristina Banuelos, Kasey Creswell, Catherine Walsh, Stephen B Manuck, Peter J Gianaros, Timothy Verstynen","doi":"10.1093/scan/nsae050","DOIUrl":null,"url":null,"abstract":"<p><p>Different dopamine (DA) subtypes have opposing dynamics at postsynaptic receptors, with the ratio of D1 to D2 receptors determining the relative sensitivity to gains and losses, respectively, during value-based learning. This effective sensitivity to different reward feedback interacts with phasic DA levels to determine the effectiveness of learning, particularly in dynamic feedback situations where the frequency and magnitude of rewards need to be integrated over time to make optimal decisions. We modeled this effect in simulations of the underlying basal ganglia pathways and then tested the predictions in individuals with a variant of the human dopamine receptor D2 (DRD2; -141C Ins/Del and Del/Del) gene that associates with lower levels of D2 receptor expression (N = 119) and compared their performance in the Iowa Gambling Task to noncarrier controls (N = 319). Ventral striatal (VS) reactivity to rewards was measured in the Cards task with fMRI. DRD2 variant carriers made less effective decisions than noncarriers, but this effect was not moderated by VS reward reactivity as is hypothesized by our model. These results suggest that the interaction between DA receptor subtypes and reactivity to rewards during learning may be more complex than originally thought.</p>","PeriodicalId":94208,"journal":{"name":"Social cognitive and affective neuroscience","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11281849/pdf/","citationCount":"0","resultStr":"{\"title\":\"D2 dopamine receptor expression, reactivity to rewards, and reinforcement learning in a complex value-based decision-making task.\",\"authors\":\"Cristina Banuelos, Kasey Creswell, Catherine Walsh, Stephen B Manuck, Peter J Gianaros, Timothy Verstynen\",\"doi\":\"10.1093/scan/nsae050\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Different dopamine (DA) subtypes have opposing dynamics at postsynaptic receptors, with the ratio of D1 to D2 receptors determining the relative sensitivity to gains and losses, respectively, during value-based learning. This effective sensitivity to different reward feedback interacts with phasic DA levels to determine the effectiveness of learning, particularly in dynamic feedback situations where the frequency and magnitude of rewards need to be integrated over time to make optimal decisions. We modeled this effect in simulations of the underlying basal ganglia pathways and then tested the predictions in individuals with a variant of the human dopamine receptor D2 (DRD2; -141C Ins/Del and Del/Del) gene that associates with lower levels of D2 receptor expression (N = 119) and compared their performance in the Iowa Gambling Task to noncarrier controls (N = 319). Ventral striatal (VS) reactivity to rewards was measured in the Cards task with fMRI. DRD2 variant carriers made less effective decisions than noncarriers, but this effect was not moderated by VS reward reactivity as is hypothesized by our model. These results suggest that the interaction between DA receptor subtypes and reactivity to rewards during learning may be more complex than originally thought.</p>\",\"PeriodicalId\":94208,\"journal\":{\"name\":\"Social cognitive and affective neuroscience\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-07-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11281849/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Social cognitive and affective neuroscience\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1093/scan/nsae050\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Social cognitive and affective neuroscience","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/scan/nsae050","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

在基于价值的学习过程中,不同多巴胺亚型在突触后受体上具有相反的动态,D1和D2受体的比例分别决定了对收益和损失的相对敏感性。这种对不同奖励反馈的有效敏感性与阶段性多巴胺水平相互作用,决定了学习的有效性,尤其是在动态反馈的情况下,奖励的频率和幅度需要随着时间的推移进行整合,以做出最佳决策。我们在模拟基底神经节通路时模拟了这种效应,然后在人类多巴胺受体D2(DRD2;-141C Ins/Del和Del/Del)基因变异体(D2受体表达水平较低)(119人)中测试了预测结果,并将他们在爱荷华赌博任务(IGT)中的表现与非携带者对照组(319人)进行了比较。在卡牌任务中,用fMRI测量了腹侧纹状体(VS)对奖励的反应性。与非携带者相比,DRD2变异携带者的决策效率较低,但这种影响并不像我们的模型所假设的那样受VS奖赏反应性的调节。这些结果表明,多巴胺受体亚型与学习过程中对奖赏的反应性之间的相互作用可能比最初想象的更为复杂。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
D2 dopamine receptor expression, reactivity to rewards, and reinforcement learning in a complex value-based decision-making task.

Different dopamine (DA) subtypes have opposing dynamics at postsynaptic receptors, with the ratio of D1 to D2 receptors determining the relative sensitivity to gains and losses, respectively, during value-based learning. This effective sensitivity to different reward feedback interacts with phasic DA levels to determine the effectiveness of learning, particularly in dynamic feedback situations where the frequency and magnitude of rewards need to be integrated over time to make optimal decisions. We modeled this effect in simulations of the underlying basal ganglia pathways and then tested the predictions in individuals with a variant of the human dopamine receptor D2 (DRD2; -141C Ins/Del and Del/Del) gene that associates with lower levels of D2 receptor expression (N = 119) and compared their performance in the Iowa Gambling Task to noncarrier controls (N = 319). Ventral striatal (VS) reactivity to rewards was measured in the Cards task with fMRI. DRD2 variant carriers made less effective decisions than noncarriers, but this effect was not moderated by VS reward reactivity as is hypothesized by our model. These results suggest that the interaction between DA receptor subtypes and reactivity to rewards during learning may be more complex than originally thought.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
8.00
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信