IF 4.4 2区 医学 Q1 NEUROSCIENCES
Dana M Huvermann, Adam M Berlijn, Andreas Thieme, Friedrich Erdlenbruch, Stefan J Groiss, Andreas Deistung, Manfred Mittelstaedt, Elke Wondzinski, Heike Sievers, Benedikt Frank, Sophia L Göricke, Michael Gliem, Martin Köhrmann, Mario Siebler, Alfons Schnitzler, Christian Bellebaum, Martina Minnerop, Dagmar Timmann, Jutta Peterburs
{"title":"The cerebellum contributes to prediction error coding in reinforcement learning in humans.","authors":"Dana M Huvermann, Adam M Berlijn, Andreas Thieme, Friedrich Erdlenbruch, Stefan J Groiss, Andreas Deistung, Manfred Mittelstaedt, Elke Wondzinski, Heike Sievers, Benedikt Frank, Sophia L Göricke, Michael Gliem, Martin Köhrmann, Mario Siebler, Alfons Schnitzler, Christian Bellebaum, Martina Minnerop, Dagmar Timmann, Jutta Peterburs","doi":"10.1523/JNEUROSCI.1972-24.2025","DOIUrl":null,"url":null,"abstract":"<p><p>Recent rodent data suggest that the cerebellum - a region typically associated with processing sensory prediction errors (PEs) - also processes PEs in reinforcement learning (RL-PEs; i.e., learning from action outcomes). We tested whether cerebellar output is necessary for RL-PE processing in regions more traditionally associated with action-outcome processing, such as striatum and anterior cingulate cortex. The feedback-related negativity (FRN) was measured as a proxy of cerebral RL-PE processing in a probabilistic feedback learning task using electroencephalography. Two complementary experiments were performed in humans. First, patients with chronic cerebellar stroke (20 male, 6 female) and matched healthy controls (19 male, 7 female) were tested. Second, single-pulse cerebellar transcranial magnetic stimulation (TMS) was applied in healthy participants (7 male, 17 female), thus implementing a virtual lesion approach. Consistent with previous studies, learning of action-outcome associations was intact with only minor changes in behavioural flexibility. Importantly, no significant RL-PE processing was observed in the FRN in patients with cerebellar stroke, and in participants receiving cerebellar TMS. Findings in both experiments show that RL-PE processing in the forebrain depends on cerebellar output in humans, complementing and extending previous findings in rodents.<b>Significance statement</b> While processing of prediction errors in reinforcement learning (RL-PEs) is usually attributed to midbrain and forebrain, recent rodent studies have recorded RL-PE signals in the cerebellum. It is not yet clear whether these cerebellar RL-PE signals contribute to RL-PE processing in the forebrain/midbrain. In the current study, we could show that forebrain RL-PE coding is blunted when the cerebellum is affected across two complementary lesion models (patients with cerebellar stroke, cerebellar TMS). Our results support direct involvement of the cerebellum in RL-PE processing. We can further show that the cerebellum is necessary for RL-PE coding in the forebrain.</p>","PeriodicalId":50114,"journal":{"name":"Journal of Neuroscience","volume":" ","pages":""},"PeriodicalIF":4.4000,"publicationDate":"2025-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Neuroscience","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1523/JNEUROSCI.1972-24.2025","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"NEUROSCIENCES","Score":null,"Total":0}
引用次数: 0

摘要

最近的啮齿类动物数据表明,小脑--一个通常与处理感觉预测错误(PE)相关的区域--也处理强化学习(RL-PE;即从动作结果中学习)中的PE。我们测试了小脑输出是否是传统上与动作结果处理相关的区域(如纹状体和前扣带回皮层)进行 RL-PE 处理所必需的。在一项概率反馈学习任务中,我们使用脑电图测量了反馈相关负性(FRN),作为大脑RL-PE处理的替代指标。在人体中进行了两项互补实验。首先,对慢性小脑卒中患者(20 名男性,6 名女性)和匹配的健康对照组(19 名男性,7 名女性)进行了测试。其次,对健康参与者(7 名男性,17 名女性)进行了单脉冲小脑经颅磁刺激(TMS),从而实现了虚拟病变方法。与之前的研究一致,行动-结果联想的学习是完整的,行为灵活性只有轻微变化。重要的是,在小脑中风患者和接受小脑经颅磁刺激的参与者中,均未在 FRN 中观察到明显的 RL-PE 处理。这两项实验的结果表明,前脑的RL-PE处理依赖于人类的小脑输出,补充并扩展了之前在啮齿类动物身上的发现。意义声明 虽然强化学习(RL-PE)中预测错误的处理通常归因于中脑和前脑,但最近的啮齿类动物研究在小脑中记录到了RL-PE信号。目前还不清楚这些小脑RL-PE信号是否有助于前脑/中脑的RL-PE处理。在目前的研究中,我们可以通过两种互补的病变模型(小脑中风患者、小脑TMS)表明,当小脑受到影响时,前脑的RL-PE编码会变得迟钝。我们的结果支持小脑直接参与 RL-PE 处理。我们可以进一步证明,小脑对于前脑的RL-PE编码是必要的。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
The cerebellum contributes to prediction error coding in reinforcement learning in humans.

Recent rodent data suggest that the cerebellum - a region typically associated with processing sensory prediction errors (PEs) - also processes PEs in reinforcement learning (RL-PEs; i.e., learning from action outcomes). We tested whether cerebellar output is necessary for RL-PE processing in regions more traditionally associated with action-outcome processing, such as striatum and anterior cingulate cortex. The feedback-related negativity (FRN) was measured as a proxy of cerebral RL-PE processing in a probabilistic feedback learning task using electroencephalography. Two complementary experiments were performed in humans. First, patients with chronic cerebellar stroke (20 male, 6 female) and matched healthy controls (19 male, 7 female) were tested. Second, single-pulse cerebellar transcranial magnetic stimulation (TMS) was applied in healthy participants (7 male, 17 female), thus implementing a virtual lesion approach. Consistent with previous studies, learning of action-outcome associations was intact with only minor changes in behavioural flexibility. Importantly, no significant RL-PE processing was observed in the FRN in patients with cerebellar stroke, and in participants receiving cerebellar TMS. Findings in both experiments show that RL-PE processing in the forebrain depends on cerebellar output in humans, complementing and extending previous findings in rodents.Significance statement While processing of prediction errors in reinforcement learning (RL-PEs) is usually attributed to midbrain and forebrain, recent rodent studies have recorded RL-PE signals in the cerebellum. It is not yet clear whether these cerebellar RL-PE signals contribute to RL-PE processing in the forebrain/midbrain. In the current study, we could show that forebrain RL-PE coding is blunted when the cerebellum is affected across two complementary lesion models (patients with cerebellar stroke, cerebellar TMS). Our results support direct involvement of the cerebellum in RL-PE processing. We can further show that the cerebellum is necessary for RL-PE coding in the forebrain.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Neuroscience
Journal of Neuroscience 医学-神经科学
CiteScore
9.30
自引率
3.80%
发文量
1164
审稿时长
12 months
期刊介绍: JNeurosci (ISSN 0270-6474) is an official journal of the Society for Neuroscience. It is published weekly by the Society, fifty weeks a year, one volume a year. JNeurosci publishes papers on a broad range of topics of general interest to those working on the nervous system. Authors now have an Open Choice option for their published articles
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信