EXPRESS:乌鸦明显的统计推断可能反映了简单的强化学习。

IF 1.5 3区 心理学 Q4 PHYSIOLOGY
David N George, Dominic M Dwyer, Mark Haselgrove, Mike E Le Pelley
{"title":"EXPRESS:乌鸦明显的统计推断可能反映了简单的强化学习。","authors":"David N George, Dominic M Dwyer, Mark Haselgrove, Mike E Le Pelley","doi":"10.1177/17470218241305622","DOIUrl":null,"url":null,"abstract":"<p><p>Johnston et al. report results which they argue demonstrate that crows engage in statistical inference during decision-making. They trained two crows to associate a set of stimuli with different reward probabilities (from 10% to 90%) before choice tests between pairs of stimuli. Across most pairwise combinations, and in a control task in which the number of rewards was equated between probabilities, both crows preferred the stimulus associated with higher reward probability. The magnitude of this preference was affected by the absolute difference between the two probabilities, although (contrary to a claim made by Johnston et al. 2023) preference did not reflect the ratio of prior probabilities independently of absolute differences. Johnston et al. argue that preference for the stimulus with the higher reward probability is \"the signature of true statistical inference\" (p. 3238), implemented by an analogue magnitude system that represents the reward probability associated with each stimulus. Here, we show that a simple reinforcement learning model, with no explicit representation of reward probabilities, reproduces the critical features of crows' performance-and indeed better accounts for the observed empirical findings than the concept of statistical inference based on analogue magnitude representations, because it correctly predicts the absence of a ratio effect that would reflect magnitudes when absolute distance is controlled. Contrary to Johnston et al.'s claims, these patterns of behaviour do not necessitate retrieval of calculated reward probabilities from long-term memory and dynamic application of this information across contexts, or (more specifically) require the involvement of an analogue magnitude system in representing abstract probabilities.</p>","PeriodicalId":20869,"journal":{"name":"Quarterly Journal of Experimental Psychology","volume":" ","pages":"17470218241305622"},"PeriodicalIF":1.5000,"publicationDate":"2024-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Apparent statistical inference in crows may reflect simple reinforcement learning.\",\"authors\":\"David N George, Dominic M Dwyer, Mark Haselgrove, Mike E Le Pelley\",\"doi\":\"10.1177/17470218241305622\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Johnston et al. report results which they argue demonstrate that crows engage in statistical inference during decision-making. They trained two crows to associate a set of stimuli with different reward probabilities (from 10% to 90%) before choice tests between pairs of stimuli. Across most pairwise combinations, and in a control task in which the number of rewards was equated between probabilities, both crows preferred the stimulus associated with higher reward probability. The magnitude of this preference was affected by the absolute difference between the two probabilities, although (contrary to a claim made by Johnston et al. 2023) preference did not reflect the ratio of prior probabilities independently of absolute differences. Johnston et al. argue that preference for the stimulus with the higher reward probability is \\\"the signature of true statistical inference\\\" (p. 3238), implemented by an analogue magnitude system that represents the reward probability associated with each stimulus. Here, we show that a simple reinforcement learning model, with no explicit representation of reward probabilities, reproduces the critical features of crows' performance-and indeed better accounts for the observed empirical findings than the concept of statistical inference based on analogue magnitude representations, because it correctly predicts the absence of a ratio effect that would reflect magnitudes when absolute distance is controlled. Contrary to Johnston et al.'s claims, these patterns of behaviour do not necessitate retrieval of calculated reward probabilities from long-term memory and dynamic application of this information across contexts, or (more specifically) require the involvement of an analogue magnitude system in representing abstract probabilities.</p>\",\"PeriodicalId\":20869,\"journal\":{\"name\":\"Quarterly Journal of Experimental Psychology\",\"volume\":\" \",\"pages\":\"17470218241305622\"},\"PeriodicalIF\":1.5000,\"publicationDate\":\"2024-12-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Quarterly Journal of Experimental Psychology\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1177/17470218241305622\",\"RegionNum\":3,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"PHYSIOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Quarterly Journal of Experimental Psychology","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/17470218241305622","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"PHYSIOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

Johnston等人报告的结果表明,乌鸦在决策过程中会进行统计推断。他们训练两只乌鸦在对刺激进行选择测试之前,将一组刺激与不同的奖励概率(从10%到90%)联系起来。在大多数成对组合中,以及在奖励数量相等的控制任务中,两只乌鸦都更喜欢与更高奖励概率相关的刺激。这种偏好的大小受到两个概率之间的绝对差异的影响,尽管(与Johnston et al. 2023的说法相反)偏好并没有独立于绝对差异反映先验概率的比例。Johnston等人认为,对奖励概率较高的刺激的偏好是“真正的统计推断的特征”(第3238页),通过表示与每个刺激相关的奖励概率的模拟幅度系统来实现。在这里,我们展示了一个简单的强化学习模型,没有明确的奖励概率表示,再现了乌鸦表现的关键特征,并且确实比基于模拟大小表示的统计推断概念更好地解释了观察到的经验发现,因为它正确地预测了在绝对距离控制时反映大小的比率效应的缺失。与Johnston等人的说法相反,这些行为模式并不需要从长期记忆中检索计算出的奖励概率,也不需要跨上下文动态应用这些信息,或者(更具体地说)需要参与模拟幅度系统来表示抽象概率。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Apparent statistical inference in crows may reflect simple reinforcement learning.

Johnston et al. report results which they argue demonstrate that crows engage in statistical inference during decision-making. They trained two crows to associate a set of stimuli with different reward probabilities (from 10% to 90%) before choice tests between pairs of stimuli. Across most pairwise combinations, and in a control task in which the number of rewards was equated between probabilities, both crows preferred the stimulus associated with higher reward probability. The magnitude of this preference was affected by the absolute difference between the two probabilities, although (contrary to a claim made by Johnston et al. 2023) preference did not reflect the ratio of prior probabilities independently of absolute differences. Johnston et al. argue that preference for the stimulus with the higher reward probability is "the signature of true statistical inference" (p. 3238), implemented by an analogue magnitude system that represents the reward probability associated with each stimulus. Here, we show that a simple reinforcement learning model, with no explicit representation of reward probabilities, reproduces the critical features of crows' performance-and indeed better accounts for the observed empirical findings than the concept of statistical inference based on analogue magnitude representations, because it correctly predicts the absence of a ratio effect that would reflect magnitudes when absolute distance is controlled. Contrary to Johnston et al.'s claims, these patterns of behaviour do not necessitate retrieval of calculated reward probabilities from long-term memory and dynamic application of this information across contexts, or (more specifically) require the involvement of an analogue magnitude system in representing abstract probabilities.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
3.50
自引率
5.90%
发文量
178
审稿时长
3-8 weeks
期刊介绍: Promoting the interests of scientific psychology and its researchers, QJEP, the journal of the Experimental Psychology Society, is a leading journal with a long-standing tradition of publishing cutting-edge research. Several articles have become classic papers in the fields of attention, perception, learning, memory, language, and reasoning. The journal publishes original articles on any topic within the field of experimental psychology (including comparative research). These include substantial experimental reports, review papers, rapid communications (reporting novel techniques or ground breaking results), comments (on articles previously published in QJEP or on issues of general interest to experimental psychologists), and book reviews. Experimental results are welcomed from all relevant techniques, including behavioural testing, brain imaging and computational modelling. QJEP offers a competitive publication time-scale. Accepted Rapid Communications have priority in the publication cycle and usually appear in print within three months. We aim to publish all accepted (but uncorrected) articles online within seven days. Our Latest Articles page offers immediate publication of articles upon reaching their final form. The journal offers an open access option called Open Select, enabling authors to meet funder requirements to make their article free to read online for all in perpetuity. Authors also benefit from a broad and diverse subscription base that delivers the journal contents to a world-wide readership. Together these features ensure that the journal offers authors the opportunity to raise the visibility of their work to a global audience.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信