{"title":"An Improved Scoring Algorithm for Indirect Evaluation Measurement With the Evaluative Priming Task","authors":"Noga Segal-Gordon, Inbal Kuperwasser, Yoav Bar-Anan","doi":"10.1177/19485506241273121","DOIUrl":null,"url":null,"abstract":"People tend to categorize the valence of a target stimulus more quickly and accurately if the target appears after a prime stimulus of the same (than of the opposite) valence. The evaluative priming task (EPT) utilizes this priming effect for indirect evaluation measurement but suffers from low reliability. The present research compared the reliability and validity of 2,160 EPT scoring algorithms across 12 datasets. In contrast to current norms to delete trials with error responses and to rely solely on differences in response latency between different task conditions, superior performance was found when incorporating latency and accuracy data, and when basing the score on differences in mean ranking of each condition’s trials by performance (a scale-invariant non-parametric dominance score named G score). We recommend seven new scoring algorithms that, in comparison to current scoring norms, increase internal consistency by a mean of 41% and correlations with other measures by 17%.","PeriodicalId":21853,"journal":{"name":"Social Psychological and Personality Science","volume":null,"pages":null},"PeriodicalIF":4.3000,"publicationDate":"2024-08-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Social Psychological and Personality Science","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/19485506241273121","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, SOCIAL","Score":null,"Total":0}
引用次数: 0
Abstract
People tend to categorize the valence of a target stimulus more quickly and accurately if the target appears after a prime stimulus of the same (than of the opposite) valence. The evaluative priming task (EPT) utilizes this priming effect for indirect evaluation measurement but suffers from low reliability. The present research compared the reliability and validity of 2,160 EPT scoring algorithms across 12 datasets. In contrast to current norms to delete trials with error responses and to rely solely on differences in response latency between different task conditions, superior performance was found when incorporating latency and accuracy data, and when basing the score on differences in mean ranking of each condition’s trials by performance (a scale-invariant non-parametric dominance score named G score). We recommend seven new scoring algorithms that, in comparison to current scoring norms, increase internal consistency by a mean of 41% and correlations with other measures by 17%.
期刊介绍:
Social Psychological and Personality Science (SPPS) is a distinctive journal in the fields of social and personality psychology that focuses on publishing brief empirical study reports, typically limited to 5000 words. The journal's mission is to disseminate research that significantly contributes to the advancement of social psychological and personality science. It welcomes submissions that introduce new theories, present empirical data, propose innovative methods, or offer a combination of these elements. SPPS also places a high value on replication studies, giving them serious consideration regardless of whether they confirm or challenge the original findings, with a particular emphasis on replications of studies initially published in SPPS. The journal is committed to a rapid review and publication process, ensuring that research can swiftly enter the scientific discourse and become an integral part of ongoing academic conversations.