{"title":"强迫性与次优选择可变性有关,但在不确定性下不变的强化学习","authors":"Junseok K. Lee, Marion Rouault, Valentin Wyart","doi":"10.1038/s44220-024-00364-5","DOIUrl":null,"url":null,"abstract":"Compulsivity has been associated with variable behavior under uncertainty. However, previous work has not distinguished between two main sources of behavioral variability: the stochastic selection of choice options that do not maximize expected reward (choice variability) and random noise in the reinforcement learning process that updates option values from choice outcomes (learning variability). Here we study the relation between dimensional compulsivity and behavioral variability using a computational model that dissociates its two sources. Across two independent datasets (137 and 123 participants), we found that compulsivity is associated with more frequent switches between options, triggered by increased choice variability, but no change in learning variability. This effect of compulsivity on the ‘trait’ component of choice variability is observed even in conditions where this source of behavioral variability yields no cognitive benefits. These findings indicate that compulsive individuals make variable and suboptimal choices under uncertainty, but do not hold degraded representations of option values. Lee et al. find that compulsivity is associated with choice variability under uncertainty, resulting in frequent switching between choice options but no alteration in the ability to learn from the positive or negative outcomes of these choices.","PeriodicalId":74247,"journal":{"name":"Nature mental health","volume":"3 2","pages":"229-241"},"PeriodicalIF":0.0000,"publicationDate":"2025-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Compulsivity is linked to suboptimal choice variability but unaltered reinforcement learning under uncertainty\",\"authors\":\"Junseok K. Lee, Marion Rouault, Valentin Wyart\",\"doi\":\"10.1038/s44220-024-00364-5\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Compulsivity has been associated with variable behavior under uncertainty. However, previous work has not distinguished between two main sources of behavioral variability: the stochastic selection of choice options that do not maximize expected reward (choice variability) and random noise in the reinforcement learning process that updates option values from choice outcomes (learning variability). Here we study the relation between dimensional compulsivity and behavioral variability using a computational model that dissociates its two sources. Across two independent datasets (137 and 123 participants), we found that compulsivity is associated with more frequent switches between options, triggered by increased choice variability, but no change in learning variability. This effect of compulsivity on the ‘trait’ component of choice variability is observed even in conditions where this source of behavioral variability yields no cognitive benefits. These findings indicate that compulsive individuals make variable and suboptimal choices under uncertainty, but do not hold degraded representations of option values. Lee et al. find that compulsivity is associated with choice variability under uncertainty, resulting in frequent switching between choice options but no alteration in the ability to learn from the positive or negative outcomes of these choices.\",\"PeriodicalId\":74247,\"journal\":{\"name\":\"Nature mental health\",\"volume\":\"3 2\",\"pages\":\"229-241\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-01-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Nature mental health\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.nature.com/articles/s44220-024-00364-5\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nature mental health","FirstCategoryId":"1085","ListUrlMain":"https://www.nature.com/articles/s44220-024-00364-5","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Compulsivity is linked to suboptimal choice variability but unaltered reinforcement learning under uncertainty
Compulsivity has been associated with variable behavior under uncertainty. However, previous work has not distinguished between two main sources of behavioral variability: the stochastic selection of choice options that do not maximize expected reward (choice variability) and random noise in the reinforcement learning process that updates option values from choice outcomes (learning variability). Here we study the relation between dimensional compulsivity and behavioral variability using a computational model that dissociates its two sources. Across two independent datasets (137 and 123 participants), we found that compulsivity is associated with more frequent switches between options, triggered by increased choice variability, but no change in learning variability. This effect of compulsivity on the ‘trait’ component of choice variability is observed even in conditions where this source of behavioral variability yields no cognitive benefits. These findings indicate that compulsive individuals make variable and suboptimal choices under uncertainty, but do not hold degraded representations of option values. Lee et al. find that compulsivity is associated with choice variability under uncertainty, resulting in frequent switching between choice options but no alteration in the ability to learn from the positive or negative outcomes of these choices.