小脑在学习预测奖励中的作用:小脑共济失调的证据

Jonathan Nicholas, Christian Amlang, Chi-Ying R. Lin, Leila Montaser-Kouhsari, Natasha Desai, Ming-Kai Pan, Sheng-Han Kuo, Daphna Shohamy
{"title":"小脑在学习预测奖励中的作用:小脑共济失调的证据","authors":"Jonathan Nicholas, Christian Amlang, Chi-Ying R. Lin, Leila Montaser-Kouhsari, Natasha Desai, Ming-Kai Pan, Sheng-Han Kuo, Daphna Shohamy","doi":"10.1007/s12311-023-01633-2","DOIUrl":null,"url":null,"abstract":"<p>Recent findings in animals have challenged the traditional view of the cerebellum solely as the site of motor control, suggesting that the cerebellum may also be important for learning to predict reward from trial-and-error feedback. Yet, evidence for the role of the cerebellum in reward learning in humans is lacking. Moreover, open questions remain about which specific aspects of reward learning the cerebellum may contribute to. Here we address this gap through an investigation of multiple forms of reward learning in individuals with cerebellum dysfunction, represented by cerebellar ataxia cases. Nineteen participants with cerebellar ataxia and 57 age- and sex-matched healthy controls completed two separate tasks that required learning about reward contingencies from trial-and-error. To probe the selectivity of reward learning processes, the tasks differed in their underlying structure: while one task measured incremental reward learning ability alone, the other allowed participants to use an alternative learning strategy based on episodic memory alongside incremental reward learning. We found that individuals with cerebellar ataxia were profoundly impaired at reward learning from trial-and-error feedback on both tasks, but retained the ability to learn to predict reward based on episodic memory. These findings provide evidence from humans for a specific and necessary role for the cerebellum in incremental learning of reward associations based on reinforcement. More broadly, the findings suggest that alongside its role in motor learning, the cerebellum likely operates in concert with the basal ganglia to support reinforcement learning from reward.</p>","PeriodicalId":22415,"journal":{"name":"The Cerebellum","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The Role of the Cerebellum in Learning to Predict Reward: Evidence from Cerebellar Ataxia\",\"authors\":\"Jonathan Nicholas, Christian Amlang, Chi-Ying R. Lin, Leila Montaser-Kouhsari, Natasha Desai, Ming-Kai Pan, Sheng-Han Kuo, Daphna Shohamy\",\"doi\":\"10.1007/s12311-023-01633-2\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Recent findings in animals have challenged the traditional view of the cerebellum solely as the site of motor control, suggesting that the cerebellum may also be important for learning to predict reward from trial-and-error feedback. Yet, evidence for the role of the cerebellum in reward learning in humans is lacking. Moreover, open questions remain about which specific aspects of reward learning the cerebellum may contribute to. Here we address this gap through an investigation of multiple forms of reward learning in individuals with cerebellum dysfunction, represented by cerebellar ataxia cases. Nineteen participants with cerebellar ataxia and 57 age- and sex-matched healthy controls completed two separate tasks that required learning about reward contingencies from trial-and-error. To probe the selectivity of reward learning processes, the tasks differed in their underlying structure: while one task measured incremental reward learning ability alone, the other allowed participants to use an alternative learning strategy based on episodic memory alongside incremental reward learning. We found that individuals with cerebellar ataxia were profoundly impaired at reward learning from trial-and-error feedback on both tasks, but retained the ability to learn to predict reward based on episodic memory. These findings provide evidence from humans for a specific and necessary role for the cerebellum in incremental learning of reward associations based on reinforcement. More broadly, the findings suggest that alongside its role in motor learning, the cerebellum likely operates in concert with the basal ganglia to support reinforcement learning from reward.</p>\",\"PeriodicalId\":22415,\"journal\":{\"name\":\"The Cerebellum\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-12-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"The Cerebellum\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1007/s12311-023-01633-2\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"The Cerebellum","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s12311-023-01633-2","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

最近在动物身上的研究结果对小脑仅作为运动控制部位的传统观点提出了挑战,表明小脑对于学习从试验和错误反馈中预测奖励也很重要。然而,小脑在人类奖赏学习中的作用还缺乏证据。此外,关于小脑可能在奖励学习的哪些具体方面做出了贡献,仍有一些悬而未决的问题。在这里,我们通过研究以小脑共济失调病例为代表的小脑功能障碍患者的多种奖励学习形式来弥补这一空白。19 名小脑共济失调患者和 57 名年龄和性别匹配的健康对照组患者分别完成了两项任务,这两项任务都要求通过试错学习奖赏条件。为了探究奖赏学习过程的选择性,这两项任务的基本结构有所不同:一项任务仅测量增量奖赏学习能力,而另一项任务则允许参与者在进行增量奖赏学习的同时使用基于外显记忆的替代学习策略。我们发现,在这两项任务中,小脑共济失调患者从试误反馈中学习奖赏的能力严重受损,但他们仍能根据外显记忆学习预测奖赏。这些发现从人类身上证明了小脑在基于强化的奖赏联想增量学习中的特殊和必要作用。更广泛地说,这些研究结果表明,除了在运动学习中发挥作用外,小脑还可能与基底神经节协同运作,支持从奖励中进行强化学习。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

The Role of the Cerebellum in Learning to Predict Reward: Evidence from Cerebellar Ataxia

The Role of the Cerebellum in Learning to Predict Reward: Evidence from Cerebellar Ataxia

Recent findings in animals have challenged the traditional view of the cerebellum solely as the site of motor control, suggesting that the cerebellum may also be important for learning to predict reward from trial-and-error feedback. Yet, evidence for the role of the cerebellum in reward learning in humans is lacking. Moreover, open questions remain about which specific aspects of reward learning the cerebellum may contribute to. Here we address this gap through an investigation of multiple forms of reward learning in individuals with cerebellum dysfunction, represented by cerebellar ataxia cases. Nineteen participants with cerebellar ataxia and 57 age- and sex-matched healthy controls completed two separate tasks that required learning about reward contingencies from trial-and-error. To probe the selectivity of reward learning processes, the tasks differed in their underlying structure: while one task measured incremental reward learning ability alone, the other allowed participants to use an alternative learning strategy based on episodic memory alongside incremental reward learning. We found that individuals with cerebellar ataxia were profoundly impaired at reward learning from trial-and-error feedback on both tasks, but retained the ability to learn to predict reward based on episodic memory. These findings provide evidence from humans for a specific and necessary role for the cerebellum in incremental learning of reward associations based on reinforcement. More broadly, the findings suggest that alongside its role in motor learning, the cerebellum likely operates in concert with the basal ganglia to support reinforcement learning from reward.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信