重新审视人员选择的元分析效度估计:解决范围限制的系统过度修正。

The Journal of applied psychology Pub Date : 2022-11-01 Epub Date: 2021-12-30 DOI:10.1037/apl0000994
Paul R Sackett, Charlene Zhang, Christopher M Berry, Filip Lievens
{"title":"重新审视人员选择的元分析效度估计:解决范围限制的系统过度修正。","authors":"Paul R Sackett,&nbsp;Charlene Zhang,&nbsp;Christopher M Berry,&nbsp;Filip Lievens","doi":"10.1037/apl0000994","DOIUrl":null,"url":null,"abstract":"<p><p>This paper systematically revisits prior meta-analytic conclusions about the criterion-related validity of personnel selection procedures, and particularly the effect of range restriction corrections on those validity estimates. Corrections for range restriction in meta-analyses of predictor-criterion relationships in personnel selection contexts typically involve the use of an artifact distribution. After outlining and critiquing five approaches that have commonly been used to create and apply range restriction artifact distributions, we conclude that each has significant issues that often result in substantial overcorrection and that therefore the validity of many selection procedures for predicting job performance has been substantially overestimated. Revisiting prior meta-analytic conclusions produces revised validity estimates. Key findings are that most of the same selection procedures that ranked high in prior summaries remain high in rank, but with mean validity estimates reduced by .10-.20 points. Structured interviews emerged as the top-ranked selection procedure. We also pair validity estimates with information about mean Black-White subgroup differences per selection procedure, providing information about validity-diversity tradeoffs. We conclude that our selection procedures remain useful, but selection predictor-criterion relationships are considerably lower than previously thought. (PsycInfo Database Record (c) 2022 APA, all rights reserved).</p>","PeriodicalId":169654,"journal":{"name":"The Journal of applied psychology","volume":" ","pages":"2040-2068"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"69","resultStr":"{\"title\":\"Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range.\",\"authors\":\"Paul R Sackett,&nbsp;Charlene Zhang,&nbsp;Christopher M Berry,&nbsp;Filip Lievens\",\"doi\":\"10.1037/apl0000994\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>This paper systematically revisits prior meta-analytic conclusions about the criterion-related validity of personnel selection procedures, and particularly the effect of range restriction corrections on those validity estimates. Corrections for range restriction in meta-analyses of predictor-criterion relationships in personnel selection contexts typically involve the use of an artifact distribution. After outlining and critiquing five approaches that have commonly been used to create and apply range restriction artifact distributions, we conclude that each has significant issues that often result in substantial overcorrection and that therefore the validity of many selection procedures for predicting job performance has been substantially overestimated. Revisiting prior meta-analytic conclusions produces revised validity estimates. Key findings are that most of the same selection procedures that ranked high in prior summaries remain high in rank, but with mean validity estimates reduced by .10-.20 points. Structured interviews emerged as the top-ranked selection procedure. We also pair validity estimates with information about mean Black-White subgroup differences per selection procedure, providing information about validity-diversity tradeoffs. We conclude that our selection procedures remain useful, but selection predictor-criterion relationships are considerably lower than previously thought. (PsycInfo Database Record (c) 2022 APA, all rights reserved).</p>\",\"PeriodicalId\":169654,\"journal\":{\"name\":\"The Journal of applied psychology\",\"volume\":\" \",\"pages\":\"2040-2068\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"69\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"The Journal of applied psychology\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1037/apl0000994\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2021/12/30 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"The Journal of applied psychology","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/apl0000994","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2021/12/30 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 69

摘要

本文系统地回顾了先前关于人员选拔程序的标准相关效度的元分析结论,特别是范围限制修正对这些效度估计的影响。在人员选择环境中,对预测-标准关系的元分析中范围限制的修正通常涉及到使用人工制品分布。在概述和批评了通常用于创建和应用范围限制工件分布的五种方法之后,我们得出结论,每种方法都有重要的问题,这些问题经常导致大量的过度修正,因此,许多预测工作绩效的选择程序的有效性被大大高估了。重新审视先前的元分析结论产生修订的效度估计。主要发现是,大多数在先前摘要中排名较高的相同选择程序仍然排名较高,但平均效度估计降低了0.10 -。20分。结构化面试成为排名第一的选拔程序。我们还将效度估计与每个选择程序的平均黑人-白人亚组差异信息配对,提供有关效度-多样性权衡的信息。我们的结论是,我们的选择程序仍然有用,但选择预测标准的关系比以前认为的要低得多。(PsycInfo Database Record (c) 2022 APA,版权所有)。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range.

This paper systematically revisits prior meta-analytic conclusions about the criterion-related validity of personnel selection procedures, and particularly the effect of range restriction corrections on those validity estimates. Corrections for range restriction in meta-analyses of predictor-criterion relationships in personnel selection contexts typically involve the use of an artifact distribution. After outlining and critiquing five approaches that have commonly been used to create and apply range restriction artifact distributions, we conclude that each has significant issues that often result in substantial overcorrection and that therefore the validity of many selection procedures for predicting job performance has been substantially overestimated. Revisiting prior meta-analytic conclusions produces revised validity estimates. Key findings are that most of the same selection procedures that ranked high in prior summaries remain high in rank, but with mean validity estimates reduced by .10-.20 points. Structured interviews emerged as the top-ranked selection procedure. We also pair validity estimates with information about mean Black-White subgroup differences per selection procedure, providing information about validity-diversity tradeoffs. We conclude that our selection procedures remain useful, but selection predictor-criterion relationships are considerably lower than previously thought. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信