An Improved Scoring Algorithm for Indirect Evaluation Measurement With the Evaluative Priming Task

IF 4.3 2区 心理学 Q1 PSYCHOLOGY, SOCIAL
Noga Segal-Gordon, Inbal Kuperwasser, Yoav Bar-Anan
{"title":"An Improved Scoring Algorithm for Indirect Evaluation Measurement With the Evaluative Priming Task","authors":"Noga Segal-Gordon, Inbal Kuperwasser, Yoav Bar-Anan","doi":"10.1177/19485506241273121","DOIUrl":null,"url":null,"abstract":"People tend to categorize the valence of a target stimulus more quickly and accurately if the target appears after a prime stimulus of the same (than of the opposite) valence. The evaluative priming task (EPT) utilizes this priming effect for indirect evaluation measurement but suffers from low reliability. The present research compared the reliability and validity of 2,160 EPT scoring algorithms across 12 datasets. In contrast to current norms to delete trials with error responses and to rely solely on differences in response latency between different task conditions, superior performance was found when incorporating latency and accuracy data, and when basing the score on differences in mean ranking of each condition’s trials by performance (a scale-invariant non-parametric dominance score named G score). We recommend seven new scoring algorithms that, in comparison to current scoring norms, increase internal consistency by a mean of 41% and correlations with other measures by 17%.","PeriodicalId":21853,"journal":{"name":"Social Psychological and Personality Science","volume":null,"pages":null},"PeriodicalIF":4.3000,"publicationDate":"2024-08-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Social Psychological and Personality Science","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/19485506241273121","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, SOCIAL","Score":null,"Total":0}
引用次数: 0

Abstract

People tend to categorize the valence of a target stimulus more quickly and accurately if the target appears after a prime stimulus of the same (than of the opposite) valence. The evaluative priming task (EPT) utilizes this priming effect for indirect evaluation measurement but suffers from low reliability. The present research compared the reliability and validity of 2,160 EPT scoring algorithms across 12 datasets. In contrast to current norms to delete trials with error responses and to rely solely on differences in response latency between different task conditions, superior performance was found when incorporating latency and accuracy data, and when basing the score on differences in mean ranking of each condition’s trials by performance (a scale-invariant non-parametric dominance score named G score). We recommend seven new scoring algorithms that, in comparison to current scoring norms, increase internal consistency by a mean of 41% and correlations with other measures by 17%.
利用评价性引物任务改进间接评价测量的评分算法
如果目标刺激出现在相同(而非相反)情绪的引物刺激之后,人们往往会更快、更准确地对目标刺激的情绪进行分类。评价性引物任务(EPT)就是利用这种引物效应进行间接评价测量的,但其可靠性较低。本研究比较了 12 个数据集中 2,160 种 EPT 评分算法的可靠性和有效性。与删除有错误反应的试验和仅依赖不同任务条件间反应延迟差异的现行标准不同,在纳入延迟和准确性数据,以及根据各条件试验的平均成绩排名差异(一种名为 G 分数的量表不变非参数优势分数)进行评分时,我们发现了更优越的表现。我们推荐了七种新的评分算法,与目前的评分标准相比,其内部一致性平均提高了 41%,与其他测量指标的相关性提高了 17%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
12.50
自引率
1.80%
发文量
77
期刊介绍: Social Psychological and Personality Science (SPPS) is a distinctive journal in the fields of social and personality psychology that focuses on publishing brief empirical study reports, typically limited to 5000 words. The journal's mission is to disseminate research that significantly contributes to the advancement of social psychological and personality science. It welcomes submissions that introduce new theories, present empirical data, propose innovative methods, or offer a combination of these elements. SPPS also places a high value on replication studies, giving them serious consideration regardless of whether they confirm or challenge the original findings, with a particular emphasis on replications of studies initially published in SPPS. The journal is committed to a rapid review and publication process, ensuring that research can swiftly enter the scientific discourse and become an integral part of ongoing academic conversations.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信