强迫性与次优选择可变性有关,但在不确定性下不变的强化学习

Junseok K. Lee, Marion Rouault, Valentin Wyart
{"title":"强迫性与次优选择可变性有关,但在不确定性下不变的强化学习","authors":"Junseok K. Lee, Marion Rouault, Valentin Wyart","doi":"10.1038/s44220-024-00364-5","DOIUrl":null,"url":null,"abstract":"Compulsivity has been associated with variable behavior under uncertainty. However, previous work has not distinguished between two main sources of behavioral variability: the stochastic selection of choice options that do not maximize expected reward (choice variability) and random noise in the reinforcement learning process that updates option values from choice outcomes (learning variability). Here we study the relation between dimensional compulsivity and behavioral variability using a computational model that dissociates its two sources. Across two independent datasets (137 and 123 participants), we found that compulsivity is associated with more frequent switches between options, triggered by increased choice variability, but no change in learning variability. This effect of compulsivity on the ‘trait’ component of choice variability is observed even in conditions where this source of behavioral variability yields no cognitive benefits. These findings indicate that compulsive individuals make variable and suboptimal choices under uncertainty, but do not hold degraded representations of option values. Lee et al. find that compulsivity is associated with choice variability under uncertainty, resulting in frequent switching between choice options but no alteration in the ability to learn from the positive or negative outcomes of these choices.","PeriodicalId":74247,"journal":{"name":"Nature mental health","volume":"3 2","pages":"229-241"},"PeriodicalIF":0.0000,"publicationDate":"2025-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Compulsivity is linked to suboptimal choice variability but unaltered reinforcement learning under uncertainty\",\"authors\":\"Junseok K. Lee, Marion Rouault, Valentin Wyart\",\"doi\":\"10.1038/s44220-024-00364-5\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Compulsivity has been associated with variable behavior under uncertainty. However, previous work has not distinguished between two main sources of behavioral variability: the stochastic selection of choice options that do not maximize expected reward (choice variability) and random noise in the reinforcement learning process that updates option values from choice outcomes (learning variability). Here we study the relation between dimensional compulsivity and behavioral variability using a computational model that dissociates its two sources. Across two independent datasets (137 and 123 participants), we found that compulsivity is associated with more frequent switches between options, triggered by increased choice variability, but no change in learning variability. This effect of compulsivity on the ‘trait’ component of choice variability is observed even in conditions where this source of behavioral variability yields no cognitive benefits. These findings indicate that compulsive individuals make variable and suboptimal choices under uncertainty, but do not hold degraded representations of option values. Lee et al. find that compulsivity is associated with choice variability under uncertainty, resulting in frequent switching between choice options but no alteration in the ability to learn from the positive or negative outcomes of these choices.\",\"PeriodicalId\":74247,\"journal\":{\"name\":\"Nature mental health\",\"volume\":\"3 2\",\"pages\":\"229-241\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-01-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Nature mental health\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.nature.com/articles/s44220-024-00364-5\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nature mental health","FirstCategoryId":"1085","ListUrlMain":"https://www.nature.com/articles/s44220-024-00364-5","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

强迫性与不确定性下的可变行为有关。然而,之前的工作并没有区分行为可变性的两个主要来源:没有最大化预期奖励的随机选择选项(选择可变性)和强化学习过程中的随机噪声,从选择结果更新选项值(学习可变性)。在这里,我们研究维度强迫和行为变异性之间的关系,使用一个计算模型,分离其两个来源。在两个独立的数据集(137和123参与者)中,我们发现强迫性与选项之间更频繁的切换有关,这是由增加的选择可变性触发的,但学习可变性没有变化。这种强迫性对选择可变性的“特质”部分的影响即使在这种行为可变性来源不产生认知益处的情况下也能观察到。这些研究结果表明,强迫个体在不确定性下做出可变和次优选择,但不会降低选择值的表征。Lee等人发现,强迫性与不确定性下的选择可变性有关,导致在选择选项之间频繁切换,但从这些选择的积极或消极结果中学习的能力没有改变。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Compulsivity is linked to suboptimal choice variability but unaltered reinforcement learning under uncertainty

Compulsivity is linked to suboptimal choice variability but unaltered reinforcement learning under uncertainty
Compulsivity has been associated with variable behavior under uncertainty. However, previous work has not distinguished between two main sources of behavioral variability: the stochastic selection of choice options that do not maximize expected reward (choice variability) and random noise in the reinforcement learning process that updates option values from choice outcomes (learning variability). Here we study the relation between dimensional compulsivity and behavioral variability using a computational model that dissociates its two sources. Across two independent datasets (137 and 123 participants), we found that compulsivity is associated with more frequent switches between options, triggered by increased choice variability, but no change in learning variability. This effect of compulsivity on the ‘trait’ component of choice variability is observed even in conditions where this source of behavioral variability yields no cognitive benefits. These findings indicate that compulsive individuals make variable and suboptimal choices under uncertainty, but do not hold degraded representations of option values. Lee et al. find that compulsivity is associated with choice variability under uncertainty, resulting in frequent switching between choice options but no alteration in the ability to learn from the positive or negative outcomes of these choices.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信