情境化程度越高越有效:情境策略对强制选择测量的影响

IF 3.7 2区 心理学 Q2 BUSINESS
Lingyue Li, Bo Zhang, Tianjun Sun, Fritz Drasgow
{"title":"情境化程度越高越有效:情境策略对强制选择测量的影响","authors":"Lingyue Li, Bo Zhang, Tianjun Sun, Fritz Drasgow","doi":"10.1007/s10869-024-09983-2","DOIUrl":null,"url":null,"abstract":"<p>Previous studies have shown that contextualization can improve the reliability and criterion-related validity of single-statement personality measures. However, it is unknown whether contextualization has similar effects on forced-choice measures of personality. If so, what type of contextualization is the most effective? The present study provides the first empirical examination of the effects of three types of contextualization on the reliability and criterion-related validity of forced-choice personality measures. Employing an experimental design, we obtained and cross-validated results using two forced-choice personality measures. Results showed that while contextualization has no systematic effect on the reliability of forced-choice scores, it improves their criterion-related validity substantially. Specifically, contextualization of both the statements and instructions yielded the highest levels of criterion-related validity for work-related outcomes, with an average validity coefficient of .18 and an average multiple correlation coefficient of .40 across two measures, followed by statement contextualization only (M<sub>r</sub> = .18, M<sub>multipleR</sub> = .35) and then by instruction contextualization only (M<sub>r</sub> = .14, M<sub>multipleR</sub> = .31). The original scales with no contextualization showed the lowest levels of criterion-related validity (M<sub>r</sub> = .10, M<sub>multipleR</sub> = .27). Contextualization also increased the intercorrelations of personality dimensions. These patterns were well replicated across the two forced-choice scales.</p>","PeriodicalId":48254,"journal":{"name":"Journal of Business and Psychology","volume":"172 1","pages":""},"PeriodicalIF":3.7000,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The More Contextualized, the More Valid: Effects of Contextualization Strategies on Forced-choice Measurement\",\"authors\":\"Lingyue Li, Bo Zhang, Tianjun Sun, Fritz Drasgow\",\"doi\":\"10.1007/s10869-024-09983-2\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Previous studies have shown that contextualization can improve the reliability and criterion-related validity of single-statement personality measures. However, it is unknown whether contextualization has similar effects on forced-choice measures of personality. If so, what type of contextualization is the most effective? The present study provides the first empirical examination of the effects of three types of contextualization on the reliability and criterion-related validity of forced-choice personality measures. Employing an experimental design, we obtained and cross-validated results using two forced-choice personality measures. Results showed that while contextualization has no systematic effect on the reliability of forced-choice scores, it improves their criterion-related validity substantially. Specifically, contextualization of both the statements and instructions yielded the highest levels of criterion-related validity for work-related outcomes, with an average validity coefficient of .18 and an average multiple correlation coefficient of .40 across two measures, followed by statement contextualization only (M<sub>r</sub> = .18, M<sub>multipleR</sub> = .35) and then by instruction contextualization only (M<sub>r</sub> = .14, M<sub>multipleR</sub> = .31). The original scales with no contextualization showed the lowest levels of criterion-related validity (M<sub>r</sub> = .10, M<sub>multipleR</sub> = .27). Contextualization also increased the intercorrelations of personality dimensions. These patterns were well replicated across the two forced-choice scales.</p>\",\"PeriodicalId\":48254,\"journal\":{\"name\":\"Journal of Business and Psychology\",\"volume\":\"172 1\",\"pages\":\"\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2024-09-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Business and Psychology\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1007/s10869-024-09983-2\",\"RegionNum\":2,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"BUSINESS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Business and Psychology","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1007/s10869-024-09983-2","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"BUSINESS","Score":null,"Total":0}
引用次数: 0

摘要

以往的研究表明,情境化可以提高单一陈述人格测量的信度和标准相关效度。然而,情境化对强迫选择型人格测量是否也有类似的效果,目前还不得而知。如果有,哪种情境化最有效?本研究首次实证检验了三种类型的情境化对强迫选择人格测量的信度和标准相关效度的影响。我们采用实验设计,使用两种强迫选择人格测量方法获得并交叉验证了结果。结果表明,虽然情境化对强迫选择得分的信度没有系统性的影响,但却大大提高了其标准相关效度。具体来说,语句和指令的情境化对工作相关结果的标准相关效度水平最高,两项测量的平均效度系数为 0.18,平均多重相关系数为 0.40,其次是仅语句情境化(Mr = 0.18,MmultipleR = 0.35),然后是仅指令情境化(Mr = 0.14,MmultipleR = 0.31)。没有情境化的原始量表显示出最低的标准相关效度(Mr = .10,MmultipleR = .27)。情境化还增加了人格维度之间的相互关系。这些模式在两个强迫选择量表中得到了很好的复制。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
The More Contextualized, the More Valid: Effects of Contextualization Strategies on Forced-choice Measurement

Previous studies have shown that contextualization can improve the reliability and criterion-related validity of single-statement personality measures. However, it is unknown whether contextualization has similar effects on forced-choice measures of personality. If so, what type of contextualization is the most effective? The present study provides the first empirical examination of the effects of three types of contextualization on the reliability and criterion-related validity of forced-choice personality measures. Employing an experimental design, we obtained and cross-validated results using two forced-choice personality measures. Results showed that while contextualization has no systematic effect on the reliability of forced-choice scores, it improves their criterion-related validity substantially. Specifically, contextualization of both the statements and instructions yielded the highest levels of criterion-related validity for work-related outcomes, with an average validity coefficient of .18 and an average multiple correlation coefficient of .40 across two measures, followed by statement contextualization only (Mr = .18, MmultipleR = .35) and then by instruction contextualization only (Mr = .14, MmultipleR = .31). The original scales with no contextualization showed the lowest levels of criterion-related validity (Mr = .10, MmultipleR = .27). Contextualization also increased the intercorrelations of personality dimensions. These patterns were well replicated across the two forced-choice scales.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
8.80
自引率
4.20%
发文量
70
期刊介绍: The Journal of Business and Psychology (JBP) is an international outlet publishing high quality research designed to advance organizational science and practice. Since its inception in 1986, the journal has published impactful scholarship in Industrial/Organizational Psychology, Organizational Behavior, Human Resources Management, Work Psychology, Occupational Psychology, and Vocational Psychology. Typical subject matters include Team processes and effectiveness Customer service and satisfaction Employee recruitment, selection, and promotion Employee engagement and withdrawal Organizational culture and climate Training, development and coaching Mentoring and socialization Performance management, appraisal and feedback Workplace diversity Leadership Workplace health, stress, and safety Employee attitudes and satisfaction Careers and retirement Organizational communication Technology and work Employee motivation and job design Organizational change and development Employee citizenship and deviance Organizational effectiveness Work-nonwork/work-family Rigorous quantitative, qualitative, field-based, and lab-based empirical studies are welcome. Interdisciplinary scholarship is valued and encouraged. Submitted manuscripts should be well-grounded conceptually and make meaningful contributions to scientific understandingsand/or the advancement of science-based practice. The Journal of Business and Psychology is - A high quality/impactful outlet for organizational science research - A journal dedicated to bridging the science/practice divide - A journal striving to create interdisciplinary connections For details on submitting manuscripts, please read the author guidelines found in the far right menu.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信