自动内隐动机编码至少和人类一样准确,而且速度快99%。

IF 6.4 1区 心理学 Q1 PSYCHOLOGY, SOCIAL
August Håkan Nilsson,J Malte Runge,Adithya V Ganesan,Carl Viggo N G Lövenstierne,Nikita Soni,Oscar N E Kjell
{"title":"自动内隐动机编码至少和人类一样准确,而且速度快99%。","authors":"August Håkan Nilsson,J Malte Runge,Adithya V Ganesan,Carl Viggo N G Lövenstierne,Nikita Soni,Oscar N E Kjell","doi":"10.1037/pspp0000544","DOIUrl":null,"url":null,"abstract":"Implicit motives, nonconscious needs that influence individuals' behaviors and shape their emotions, have been part of personality research for nearly a century but differ from personality traits. The implicit motive assessment is very resource-intensive, involving expert coding of individuals' written stories about ambiguous pictures, and has hampered implicit motive research. Using large language models and machine learning techniques, we aimed to create high-quality implicit motive models that are easy for researchers to use. We trained models to code the need for power, achievement, and affiliation (N = 85,028 sentences). The person-level assessments converged strongly with the holdout data, intraclass correlation coefficient, ICC(1,1) = .85, .87, and .89 for achievement, power, and affiliation, respectively. We demonstrated causal validity by reproducing two classical experimental studies that aroused implicit motives. We let three coders recode sentences where our models and the original coders strongly disagreed. We found that the new coders agreed with our models in 85% of the cases (p < .001, ϕ = .69). Using topic and word embedding analyses, we found specific language associated with each motive to have a high face validity. We argue that these models can be used in addition to, or instead of, human coders. We provide a free, user-friendly framework in the established R-package text and a tutorial for researchers to apply the models to their data, as these models reduce the coding time by over 99% and require no cognitive effort for coding. We hope this coding automation will facilitate a historical implicit motive research renaissance. (PsycInfo Database Record (c) 2025 APA, all rights reserved).","PeriodicalId":16691,"journal":{"name":"Journal of personality and social psychology","volume":"101 1","pages":""},"PeriodicalIF":6.4000,"publicationDate":"2025-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Automatic implicit motive codings are at least as accurate as humans' and 99% faster.\",\"authors\":\"August Håkan Nilsson,J Malte Runge,Adithya V Ganesan,Carl Viggo N G Lövenstierne,Nikita Soni,Oscar N E Kjell\",\"doi\":\"10.1037/pspp0000544\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Implicit motives, nonconscious needs that influence individuals' behaviors and shape their emotions, have been part of personality research for nearly a century but differ from personality traits. The implicit motive assessment is very resource-intensive, involving expert coding of individuals' written stories about ambiguous pictures, and has hampered implicit motive research. Using large language models and machine learning techniques, we aimed to create high-quality implicit motive models that are easy for researchers to use. We trained models to code the need for power, achievement, and affiliation (N = 85,028 sentences). The person-level assessments converged strongly with the holdout data, intraclass correlation coefficient, ICC(1,1) = .85, .87, and .89 for achievement, power, and affiliation, respectively. We demonstrated causal validity by reproducing two classical experimental studies that aroused implicit motives. We let three coders recode sentences where our models and the original coders strongly disagreed. We found that the new coders agreed with our models in 85% of the cases (p < .001, ϕ = .69). Using topic and word embedding analyses, we found specific language associated with each motive to have a high face validity. We argue that these models can be used in addition to, or instead of, human coders. We provide a free, user-friendly framework in the established R-package text and a tutorial for researchers to apply the models to their data, as these models reduce the coding time by over 99% and require no cognitive effort for coding. We hope this coding automation will facilitate a historical implicit motive research renaissance. (PsycInfo Database Record (c) 2025 APA, all rights reserved).\",\"PeriodicalId\":16691,\"journal\":{\"name\":\"Journal of personality and social psychology\",\"volume\":\"101 1\",\"pages\":\"\"},\"PeriodicalIF\":6.4000,\"publicationDate\":\"2025-04-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of personality and social psychology\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1037/pspp0000544\",\"RegionNum\":1,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PSYCHOLOGY, SOCIAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of personality and social psychology","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/pspp0000544","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, SOCIAL","Score":null,"Total":0}
引用次数: 0

摘要

近一个世纪以来,内隐动机,即影响个人行为并塑造其情绪的无意识需求,一直是人格研究的一部分,但与人格特征不同。内隐动机的评估需要耗费大量的资源,需要专家对个人写的关于模糊图片的故事进行编码,这阻碍了内隐动机的研究。利用大型语言模型和机器学习技术,我们旨在创建高质量的内隐动机模型,使研究人员易于使用。我们训练模型来编码对权力、成就和隶属关系的需求(N = 85,028个句子)。个人水平的评估与钉手数据有很强的趋同性,等级内相关系数,成就、权力和隶属关系的ICC(1,1)分别= 0.85、0.87和0.89。我们通过重复两个经典的实验研究来证明因果效度,这些实验研究引起了内隐动机。我们让三个编码员重新编码我们的模型和原始编码员强烈反对的句子。我们发现新的编码员在85%的情况下同意我们的模型(p < 0.001, ϕ = 0.69)。通过主题和词嵌入分析,我们发现与每个动机相关的特定语言具有较高的面孔效度。我们认为,这些模型可以用于人类编码人员之外,或者代替人类编码人员。我们在已建立的r包文本中提供了一个免费的,用户友好的框架,并为研究人员提供了将模型应用于其数据的教程,因为这些模型减少了99%以上的编码时间,并且不需要编码的认知努力。我们希望这种编码自动化将促进历史内隐动机研究的复兴。(PsycInfo Database Record (c) 2025 APA,版权所有)。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Automatic implicit motive codings are at least as accurate as humans' and 99% faster.
Implicit motives, nonconscious needs that influence individuals' behaviors and shape their emotions, have been part of personality research for nearly a century but differ from personality traits. The implicit motive assessment is very resource-intensive, involving expert coding of individuals' written stories about ambiguous pictures, and has hampered implicit motive research. Using large language models and machine learning techniques, we aimed to create high-quality implicit motive models that are easy for researchers to use. We trained models to code the need for power, achievement, and affiliation (N = 85,028 sentences). The person-level assessments converged strongly with the holdout data, intraclass correlation coefficient, ICC(1,1) = .85, .87, and .89 for achievement, power, and affiliation, respectively. We demonstrated causal validity by reproducing two classical experimental studies that aroused implicit motives. We let three coders recode sentences where our models and the original coders strongly disagreed. We found that the new coders agreed with our models in 85% of the cases (p < .001, ϕ = .69). Using topic and word embedding analyses, we found specific language associated with each motive to have a high face validity. We argue that these models can be used in addition to, or instead of, human coders. We provide a free, user-friendly framework in the established R-package text and a tutorial for researchers to apply the models to their data, as these models reduce the coding time by over 99% and require no cognitive effort for coding. We hope this coding automation will facilitate a historical implicit motive research renaissance. (PsycInfo Database Record (c) 2025 APA, all rights reserved).
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
12.70
自引率
3.90%
发文量
250
期刊介绍: Journal of personality and social psychology publishes original papers in all areas of personality and social psychology and emphasizes empirical reports, but may include specialized theoretical, methodological, and review papers.Journal of personality and social psychology is divided into three independently edited sections. Attitudes and Social Cognition addresses all aspects of psychology (e.g., attitudes, cognition, emotion, motivation) that take place in significant micro- and macrolevel social contexts.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信