Tom Salomon, Alon Itzkovitch, Nathaniel D Daw, Tom Schonberg
{"title":"非强化学习个体差异的计算模型。","authors":"Tom Salomon, Alon Itzkovitch, Nathaniel D Daw, Tom Schonberg","doi":"10.1037/xge0001739","DOIUrl":null,"url":null,"abstract":"<p><p>Cue-Approach Training (CAT) is a paradigm that enhances preferences without external reinforcements, suggesting a potential role for internal learning processes. Here, we developed a novel Bayesian computational model to quantify anticipatory response patterns during the training phase of CAT. This phase includes individual items, and thus, this marker potentially reflects internal learning signals at the item level. Our model, fitted to meta-analysis data from 28 prior CAT experiments, was able to predict individual differences in nonreinforced preference changes using a key computational marker. Crucially, two new experiments manipulated the training procedure to influence the model's predicted learning marker. As predicted and preregistered, the manipulation successfully induced differential preference changes, supporting a causal role of our model. These findings demonstrate powerful potential of our computational framework for investigating intrinsic learning processes. This framework could be used to predict preference changes and opens new avenues for understanding intrinsic motivation and decision making. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>","PeriodicalId":15698,"journal":{"name":"Journal of Experimental Psychology: General","volume":" ","pages":"1888-1915"},"PeriodicalIF":3.7000,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A computational model for individual differences in nonreinforced learning.\",\"authors\":\"Tom Salomon, Alon Itzkovitch, Nathaniel D Daw, Tom Schonberg\",\"doi\":\"10.1037/xge0001739\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Cue-Approach Training (CAT) is a paradigm that enhances preferences without external reinforcements, suggesting a potential role for internal learning processes. Here, we developed a novel Bayesian computational model to quantify anticipatory response patterns during the training phase of CAT. This phase includes individual items, and thus, this marker potentially reflects internal learning signals at the item level. Our model, fitted to meta-analysis data from 28 prior CAT experiments, was able to predict individual differences in nonreinforced preference changes using a key computational marker. Crucially, two new experiments manipulated the training procedure to influence the model's predicted learning marker. As predicted and preregistered, the manipulation successfully induced differential preference changes, supporting a causal role of our model. These findings demonstrate powerful potential of our computational framework for investigating intrinsic learning processes. This framework could be used to predict preference changes and opens new avenues for understanding intrinsic motivation and decision making. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>\",\"PeriodicalId\":15698,\"journal\":{\"name\":\"Journal of Experimental Psychology: General\",\"volume\":\" \",\"pages\":\"1888-1915\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2025-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Experimental Psychology: General\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1037/xge0001739\",\"RegionNum\":1,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/5/22 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"PSYCHOLOGY, EXPERIMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Experimental Psychology: General","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/xge0001739","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/5/22 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"PSYCHOLOGY, EXPERIMENTAL","Score":null,"Total":0}
引用次数: 0
摘要
提示方法训练(CAT)是一种在没有外部强化的情况下增强偏好的范式,表明内部学习过程可能起作用。在此,我们开发了一种新的贝叶斯计算模型来量化CAT训练阶段的预期反应模式。这个阶段包括单独的项目,因此,这个标记潜在地反映了项目级别的内部学习信号。我们的模型与先前28个CAT实验的元分析数据相匹配,能够使用关键的计算标记来预测非强化偏好变化的个体差异。至关重要的是,两个新的实验操纵了训练过程,以影响模型预测的学习标记。正如预测和预登记的那样,操纵成功地诱导了不同偏好的变化,支持了我们模型的因果作用。这些发现证明了我们的计算框架在研究内在学习过程方面的强大潜力。这个框架可以用来预测偏好的变化,并为理解内在动机和决策开辟了新的途径。(PsycInfo Database Record (c) 2025 APA,版权所有)。
A computational model for individual differences in nonreinforced learning.
Cue-Approach Training (CAT) is a paradigm that enhances preferences without external reinforcements, suggesting a potential role for internal learning processes. Here, we developed a novel Bayesian computational model to quantify anticipatory response patterns during the training phase of CAT. This phase includes individual items, and thus, this marker potentially reflects internal learning signals at the item level. Our model, fitted to meta-analysis data from 28 prior CAT experiments, was able to predict individual differences in nonreinforced preference changes using a key computational marker. Crucially, two new experiments manipulated the training procedure to influence the model's predicted learning marker. As predicted and preregistered, the manipulation successfully induced differential preference changes, supporting a causal role of our model. These findings demonstrate powerful potential of our computational framework for investigating intrinsic learning processes. This framework could be used to predict preference changes and opens new avenues for understanding intrinsic motivation and decision making. (PsycInfo Database Record (c) 2025 APA, all rights reserved).
期刊介绍:
The Journal of Experimental Psychology: General publishes articles describing empirical work that bridges the traditional interests of two or more communities of psychology. The work may touch on issues dealt with in JEP: Learning, Memory, and Cognition, JEP: Human Perception and Performance, JEP: Animal Behavior Processes, or JEP: Applied, but may also concern issues in other subdisciplines of psychology, including social processes, developmental processes, psychopathology, neuroscience, or computational modeling. Articles in JEP: General may be longer than the usual journal publication if necessary, but shorter articles that bridge subdisciplines will also be considered.