Konrad Kulikowski, Jeffrey M. Cucina, Theodore L. Hayes, In-Sue Oh, Deniz Ones, Chockalingam Viswesvaran
{"title":"为认知能力测试辩护:确认其在人员选择和录取决定中继续使用的证据","authors":"Konrad Kulikowski, Jeffrey M. Cucina, Theodore L. Hayes, In-Sue Oh, Deniz Ones, Chockalingam Viswesvaran","doi":"10.1111/joop.70048","DOIUrl":null,"url":null,"abstract":"<p>We engage with the arguments presented by Woods and Patterson (2023) [Woods, S. A., & Patterson, F. (2023). A critical review of the use of cognitive ability testing for selection into graduate and higher professional occupations. <i>Journal of Occupational and Organizational Psychology</i>, <i>97</i>, 253–272.], regarding the use of cognitive ability tests in employee selection and academic admissions. We examine assumptions about cognitive ability test validity, fairness and bias and address arguments against the use of cognitive ability tests in five ways. First, we highlight that Woods and Patterson's (2023) propositions overly depend on a single study by Sackett et al. (2022) Sackett, P. R., Zhang, C., Berry, C. M., & Lievens, F. (2022). Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range. <i>Journal of Applied Psychology</i>, <i>107</i>(11), 2040–2068.], which has faced significant criticisms. Second, we point out that a test with adverse impact can be used if it is job-related and an unbiased predictor of performance. Third, we question the alleged ‘higher’ objectivity and fairness of alternative non-cognitive selection procedures. Fourth, we critique overgeneralizations of findings from employment contexts to educational settings and challenge the atheoretical basis of rejecting cognitive ability tests in complex work settings. Fifth, we point out that recent calls for reducing the role of cognitive ability testing in selection do not consider the side effects and costs of those presumed alternatives. We advocate for responsible cognitive ability testing by combining it with valid non-cognitive predictors to balance validity and adverse impact, using validated tests by trained professionals, ensuring cultural relevance and effectively communicating test processes.</p>","PeriodicalId":48330,"journal":{"name":"Journal of Occupational and Organizational Psychology","volume":"98 3","pages":""},"PeriodicalIF":4.9000,"publicationDate":"2025-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"In defence of cognitive ability testing: Affirming the evidence for its continued use in personnel selection and admission decisions\",\"authors\":\"Konrad Kulikowski, Jeffrey M. Cucina, Theodore L. Hayes, In-Sue Oh, Deniz Ones, Chockalingam Viswesvaran\",\"doi\":\"10.1111/joop.70048\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>We engage with the arguments presented by Woods and Patterson (2023) [Woods, S. A., & Patterson, F. (2023). A critical review of the use of cognitive ability testing for selection into graduate and higher professional occupations. <i>Journal of Occupational and Organizational Psychology</i>, <i>97</i>, 253–272.], regarding the use of cognitive ability tests in employee selection and academic admissions. We examine assumptions about cognitive ability test validity, fairness and bias and address arguments against the use of cognitive ability tests in five ways. First, we highlight that Woods and Patterson's (2023) propositions overly depend on a single study by Sackett et al. (2022) Sackett, P. R., Zhang, C., Berry, C. M., & Lievens, F. (2022). Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range. <i>Journal of Applied Psychology</i>, <i>107</i>(11), 2040–2068.], which has faced significant criticisms. Second, we point out that a test with adverse impact can be used if it is job-related and an unbiased predictor of performance. Third, we question the alleged ‘higher’ objectivity and fairness of alternative non-cognitive selection procedures. Fourth, we critique overgeneralizations of findings from employment contexts to educational settings and challenge the atheoretical basis of rejecting cognitive ability tests in complex work settings. Fifth, we point out that recent calls for reducing the role of cognitive ability testing in selection do not consider the side effects and costs of those presumed alternatives. We advocate for responsible cognitive ability testing by combining it with valid non-cognitive predictors to balance validity and adverse impact, using validated tests by trained professionals, ensuring cultural relevance and effectively communicating test processes.</p>\",\"PeriodicalId\":48330,\"journal\":{\"name\":\"Journal of Occupational and Organizational Psychology\",\"volume\":\"98 3\",\"pages\":\"\"},\"PeriodicalIF\":4.9000,\"publicationDate\":\"2025-07-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Occupational and Organizational Psychology\",\"FirstCategoryId\":\"91\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/joop.70048\",\"RegionNum\":2,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MANAGEMENT\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Occupational and Organizational Psychology","FirstCategoryId":"91","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/joop.70048","RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MANAGEMENT","Score":null,"Total":0}
引用次数: 0
摘要
我们参与了伍兹和帕特森(2023)提出的论点[伍兹,s.a., &;帕特森,F.(2023)。认知能力测试在研究生和高等职业选择中的应用综述。心理科学学报,2009,33(2):444 - 444。],关于在员工选拔和学术录取中使用认知能力测试。我们研究了关于认知能力测试有效性、公平性和偏见的假设,并以五种方式解决了反对使用认知能力测试的论点。首先,我们强调伍兹和帕特森(2023)的命题过度依赖于Sackett等人(2022)的一项研究。Sackett, p.r., Zhang, C, Berry, C. M, &;Lievens, F.(2022)。重新审视人员选择的元分析效度估计:解决范围限制的系统过度修正。心理学报,29(4),344 - 344。],该计划遭到了严重的批评。其次,我们指出,如果一个测试是与工作相关的,并且是一个无偏的绩效预测器,那么它可以使用不利影响。第三,我们质疑所谓的“更高”的客观性和非认知选择程序的公平性。第四,我们批判了从就业环境到教育环境的研究结果的过度概括,并挑战了在复杂的工作环境中拒绝认知能力测试的理论基础。第五,我们指出,最近呼吁减少认知能力测试在选择中的作用,并没有考虑到这些假设的替代方案的副作用和成本。我们提倡负责任的认知能力测试,将其与有效的非认知预测因素相结合,以平衡有效性和不利影响,使用经过培训的专业人员进行的有效测试,确保文化相关性并有效沟通测试过程。
In defence of cognitive ability testing: Affirming the evidence for its continued use in personnel selection and admission decisions
We engage with the arguments presented by Woods and Patterson (2023) [Woods, S. A., & Patterson, F. (2023). A critical review of the use of cognitive ability testing for selection into graduate and higher professional occupations. Journal of Occupational and Organizational Psychology, 97, 253–272.], regarding the use of cognitive ability tests in employee selection and academic admissions. We examine assumptions about cognitive ability test validity, fairness and bias and address arguments against the use of cognitive ability tests in five ways. First, we highlight that Woods and Patterson's (2023) propositions overly depend on a single study by Sackett et al. (2022) Sackett, P. R., Zhang, C., Berry, C. M., & Lievens, F. (2022). Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range. Journal of Applied Psychology, 107(11), 2040–2068.], which has faced significant criticisms. Second, we point out that a test with adverse impact can be used if it is job-related and an unbiased predictor of performance. Third, we question the alleged ‘higher’ objectivity and fairness of alternative non-cognitive selection procedures. Fourth, we critique overgeneralizations of findings from employment contexts to educational settings and challenge the atheoretical basis of rejecting cognitive ability tests in complex work settings. Fifth, we point out that recent calls for reducing the role of cognitive ability testing in selection do not consider the side effects and costs of those presumed alternatives. We advocate for responsible cognitive ability testing by combining it with valid non-cognitive predictors to balance validity and adverse impact, using validated tests by trained professionals, ensuring cultural relevance and effectively communicating test processes.
期刊介绍:
The Journal of Occupational and Organizational Psychology aims to increase understanding of people and organisations at work including:
- industrial, organizational, work, vocational and personnel psychology
- behavioural and cognitive aspects of industrial relations
- ergonomics and human factors
Innovative or interdisciplinary approaches with a psychological emphasis are particularly welcome. So are papers which develop the links between occupational/organisational psychology and other areas of the discipline, such as social and cognitive psychology.