{"title":"Cross-cultural differences in the use of the “?” Response category of the Job Descriptive Index: An application of the item response tree model","authors":"Philseok Lee, Sean Joo, Zihao Jia","doi":"10.1111/ijsa.12414","DOIUrl":"10.1111/ijsa.12414","url":null,"abstract":"<p>Historically, the “<i>?</i>” response category (i.e., the question mark response category) has been criticized because of the ambiguity of its interpretation. Previous empirical studies of the appropriateness of the “<i>?</i>” response category have generally used methods that cannot disentangle the response style from target psychological traits and have also exclusively focused on Western samples. To further develop our understanding of the “<i>?</i>” response category, we examined the differing use of the “<i>?</i>” response category in the Job Descriptive Index (JDI) between U.S. and Korean samples by using the recently proposed item response tree (IRTree) models. Our research showed that the Korean group more strongly prefers the “<i>?</i>” response category, while the U.S. group more strongly prefers the directional response category (i.e., Yes). In addition, the Korean group tended to interpret the “<i>?</i>” response category as mild agreement, while the U.S. group tended to interpret it as mild disagreement. Our study adds to the scientific body of knowledge on the “<i>?</i>” response category in a cross-cultural context. We hope that our findings presented herein provide valuable insights for researchers and practitioners who want to better understand the “<i>?</i>” response category and develop various psychological assessments in cross-cultural settings.</p>","PeriodicalId":51465,"journal":{"name":"International Journal of Selection and Assessment","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-12-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/ijsa.12414","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43823395","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Better explaining the benefits why AI? Analyzing the impact of explaining the benefits of AI-supported selection on applicant responses","authors":"Alina Köchling, Marius Claus Wehner","doi":"10.1111/ijsa.12412","DOIUrl":"10.1111/ijsa.12412","url":null,"abstract":"<p>Despite the increasing popularity of AI-supported selection tools, knowledge about the actions that can be taken by organizations to increase AI acceptance is still in its infancy, even though multiple studies point out that applicants react negatively to the implementation of AI-supported selection tools. Therefore, this study investigates ways to alter applicant reactions to AI-supported selection. Using a scenario-based between-subject design with participants from the working population (<i>N</i> = 200), we varied the information provided by the organization about the reasons for using an AI-supported selection process (no additional information vs. written information vs. video information) in comparison to a human selection process. Results show that the use of AI without information and with written information decreased perceived fairness, personableness perception, and increased emotional creepiness. In turn, perceived fairness, personableness perceptions, and emotional creepiness mediated the association between an AI-supported selection process, organizational attractiveness, and the intention to further proceed with the selection process. Moreover, results did not differ for applicants who were provided video explanations of the benefits of AI-supported selection tools and those who participated in an actual human selection process. Important implications for research and practice are discussed.</p>","PeriodicalId":51465,"journal":{"name":"International Journal of Selection and Assessment","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/ijsa.12412","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47690905","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Adam J. Vanhove, Brooke Z. Graham, George C. Thornton III
{"title":"Moderators of sex- and race-based subgroup differences in assessment center ratings: A meta-analysis","authors":"Adam J. Vanhove, Brooke Z. Graham, George C. Thornton III","doi":"10.1111/ijsa.12411","DOIUrl":"10.1111/ijsa.12411","url":null,"abstract":"<p>This meta-analysis tested a series of moderators of sex- and race-based subgroup differences using assessment center (AC) field data. We found that sex-based subgroup differences favoring female assessees were smaller among studies that reported: combining AC scores with other tests to compute overall assessment ratings, lower mean correlations between rating dimensions, using more than one assessor to rate assessees in exercises, and providing assessor training. In contrast, we found larger sex-based subgroup differences favoring female assessees among studies that reported: lower proportions of females in assessee pools, conducting a job analysis to design the AC, and using multiple observations of AC dimensions across exercises. We also observed a polynomial effect showing that subgroup differences most strongly favored female assessees in jobs with the highest and lowest rates of female incumbents. We found race-based subgroup differences favoring White assessees were smaller on less cognitively loaded rating dimensions and for jobs with lower rates of Black incumbents. Studies reporting greater overall methodological rigor also showed smaller subgroup differences favoring White assessees. Regarding specific rigor features, studies reporting use of highly qualified assessors and integrating dimension ratings from separate exercises into overall dimension scores showed significantly lower differences favoring White assessees.</p>","PeriodicalId":51465,"journal":{"name":"International Journal of Selection and Assessment","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/ijsa.12411","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41495570","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Franciska Krings, Saranya Manoharan, Alissone Mendes de Oliveira
{"title":"Backlash for high self-promotion at hiring depends on candidates' gender and age","authors":"Franciska Krings, Saranya Manoharan, Alissone Mendes de Oliveira","doi":"10.1111/ijsa.12410","DOIUrl":"10.1111/ijsa.12410","url":null,"abstract":"<p>Previous research has shown that evaluators react negatively to intense, high levels of self-promotion during the interview, in particular when displayed by female candidates, presumably because these behaviors violate the female gender stereotype of being modest and putting others first. We expand this focus on a single social category and examine the joint effects of gender and age on reactions to high self-promotion/low modesty, as both gender and age stereotypes contain normative expectations regarding assertiveness and humility. Results of our experimental study point out two groups at risk of backlash, older women and younger men. While both older female and younger male candidates engaging in high self-promotion were seen as competent, they were regarded as less interpersonally warm, received lower interview performance ratings, and were less likely to be hired. These results provide evidence for the importance of applying an intersectional lens on the effects of self-promotion at hiring. Their implications for theory and practice as well as recommendations for future research are discussed.</p>","PeriodicalId":51465,"journal":{"name":"International Journal of Selection and Assessment","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/ijsa.12410","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48839060","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"How do applicants fake? A response process model of faking on multidimensional forced-choice personality assessments","authors":"Miriam Fuechtenhans, Anna Brown","doi":"10.1111/ijsa.12409","DOIUrl":"10.1111/ijsa.12409","url":null,"abstract":"<p>Faking on personality assessments remains an unsolved issue, raising major concerns regarding their validity and fairness. Although there is a large body of quantitative research investigating the response process of faking on personality assessments, for both rating scales (RS) and multidimensional forced choice (MFC), only a few studies have yet qualitatively investigated the faking cognitions when responding to MFC in a high-stakes context (e.g., Sass et al., 2020). Yet, it could be argued that only when we have a process model that adequately describes the response decisions in high stakes, can we begin to extract valid and useful information from assessments. Thus, this qualitative study investigated the faking cognitions when responding to MFC personality assessment in a high-stakes context. Through cognitive interviews with <i>N</i> = 32 participants, we explored and identified factors influencing the test-takers' decisions regarding specific items and blocks, and factors influencing the willingness to engage in faking in general. Based on these findings, we propose a new response process model of faking forced-choice items, the Activate-Rank-Edit-Submit (A-R-E-S) model. We also make four recommendations for practice of high-stakes assessments using MFC.</p>","PeriodicalId":51465,"journal":{"name":"International Journal of Selection and Assessment","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/ijsa.12409","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42722723","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reduction of faking with the use of a forced-choice personality test: Cross-cultural comparisons between South Korea and the United States","authors":"HyeSun Lee","doi":"10.1111/ijsa.12408","DOIUrl":"10.1111/ijsa.12408","url":null,"abstract":"<p>Forced-choice format tests have been suggested as an alternative to Likert-scale measures for personnel selection due to robustness to faking and response styles. This study compared degrees of faking occurring in Likert-scale and forced-choice five-factor personality tests between South Korea and the United States. Also, it was examined whether the forced-choice format was effective at reducing faking in both countries. Data were collected from 396 incumbents participating in both honest and applicant conditions (<i>N</i><sub>SK</sub> = 179, <i>N</i><sub>US</sub> = 217). Cohen's <i>d</i> values for within-subjects designs (<i>d</i>s<sub>within</sub>) for between the two conditions were utilized to measure magnitudes of faking occurring in each format and country. In both countries, the degrees of faking occurring in the Likert-scale were larger than those from the forced-choice format, and the magnitudes of faking across five personality traits were larger in South Korea by from 0.07 to 0.12 in <i>d</i>s<sub>within</sub>. The forced-choice format appeared to successfully reduce faking for both countries as the average <i>ds</i><sub><i>within</i></sub> decreased by 0.06 in both countries. However, the patterns of faking occurring in the forced-choice format varied between the two countries. In South Korea, degrees of faking in Openness and Conscientiousness increased, whereas those in Extraversion and Agreeableness were substantially decreased. Potential factors leading to trait-specific faking under the forced-choice format were discussed in relation to cultural influence on the perception of personality traits and score estimation in Thurstonian item response theory (IRT) models. Finally, the adverse impact of using forced-choice formats on multicultural selection settings was elaborated.</p>","PeriodicalId":51465,"journal":{"name":"International Journal of Selection and Assessment","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/ijsa.12408","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44496717","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Bart Wille, Fien Heyde, Jasmine Vergauwe, Filip De Fruyt
{"title":"Understanding dark side personality at work: Distinguishing and reviewing nonlinear, interactive, differential, and reciprocal effects","authors":"Bart Wille, Fien Heyde, Jasmine Vergauwe, Filip De Fruyt","doi":"10.1111/ijsa.12407","DOIUrl":"10.1111/ijsa.12407","url":null,"abstract":"<p>The topic of dark side personality at work has received considerable research attention over the past decade, and both qualitative and quantitative reviews of this field have already been published. To show the relevance of dark personality in the work context, existing reviews have typically focused on systematically discussing the different criteria that have been linked to dark traits (e.g., job performance, work attitudes, leadership emergence, etc.). In contrast, and complementing this earlier work, the current review paper summarizes the available literature on this topic by structuring it in terms of the nature of the relationships studied rather than in terms of the types of outcome variables. Doing so, the focus shifts from “<i>What</i> are the outcomes of dark traits?” to “<i>How</i> are dark traits related to work outcomes?” Scrutinizing the nature of these relationships, we specifically focus on four types of effects (i.e., nonlinear, interactive, differential, and reciprocal) that highlight the complexity of how dark side traits operate in the work context. Structured this way, this review first provides a conceptual underpinning of each of these complex effects, followed by a summary of the empirical literature published over the past 10 years. To conclude, we present an integration of this field, provide suggestions for future research, and highlight concrete assessment challenges.</p>","PeriodicalId":51465,"journal":{"name":"International Journal of Selection and Assessment","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44878486","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Nathan A. Bowling, Kevin J. Eschleman, Lucian Zelazny, Gary Burns
{"title":"Are curmudgeon personality scales resistant to response distortion?","authors":"Nathan A. Bowling, Kevin J. Eschleman, Lucian Zelazny, Gary Burns","doi":"10.1111/ijsa.12406","DOIUrl":"10.1111/ijsa.12406","url":null,"abstract":"<p>Curmudgeon personality, which is assessed by having participants evaluate a heterogeneous set of attitude objects, provides an applied value beyond that of more established personality traits. Recent research, for instance, suggests that curmudgeon personality is distinct from the Five Factor Model personality traits and that it predicts unique variance in important criteria, such as job attitudes and well-being. In the current paper we contribute to this literature by testing an explanation of how curmudgeon personality is distinct from other traits—their potential resistance to response distortion. We estimated response distortion for scales of curmudgeon personality and FFM traits across two quasi-experimental studies. As expected, the score shifts between nonapplicant and applicant conditions were smaller for scales of curmudgeon personality compared to scales of emotional stability and conscientiousness. We argue that curmudgeon personality scales may be more resistant to response distortion than are measures of other traits because curmudgeon personality items are semi-implicit and lack an obvious desirable response. The resistance to response distortion should serve as a call to future researchers to test the criterion validity of curmudgeon personality in regard to performance criteria.</p>","PeriodicalId":51465,"journal":{"name":"International Journal of Selection and Assessment","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47115309","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Perceptions of candidate strength in job recruitment: Does candidate race moderate the attractiveness bias in White women?","authors":"Georgia Baker, Mark S. Allen","doi":"10.1111/ijsa.12405","DOIUrl":"10.1111/ijsa.12405","url":null,"abstract":"<p>The attractiveness bias suggests that people who are more attractive will be positively favored across life outcomes. This study sought to test whether candidate attractiveness, sex, and race, affect perceptions of candidate strength in a job recruitment task. In total, 338 White women (<i>M</i><sub>age</sub> = 20.94 ± 5.65) were asked to make judgements of a potential candidate for an administrative job (resume with candidate photograph). The vignettes differed in terms of candidate ability (strong/weak), sex (male/female), race (Black/White), and attractiveness (attractive/less attractive). Participants rated perceived candidate strength and likelihood to invite for interview. Results showed no significant main effects for attractiveness. However, there was a significant interaction for target attractiveness and race, such that attractive/White candidates were more likely to be invited for interview than less attractive/White candidates. There was also a significant main effect for race such that Black candidates were rated as stronger and more likely to be interviewed. Sensitivity analyses (with nonheterosexual women removed from the sample) also showed a main effect for target sex such that female candidates were favored over male candidates. Overall, these findings provide evidence that attractiveness, sex, and race have important, albeit complex, effects on hiring decisions in the workplace.</p>","PeriodicalId":51465,"journal":{"name":"International Journal of Selection and Assessment","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/ijsa.12405","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45735067","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Johannes M. Basch, Klaus G. Melchers, Julia C. Büttner
{"title":"Preselection in the digital age: A comparison of perceptions of asynchronous video interviews with online tests and online application documents in a simulation context","authors":"Johannes M. Basch, Klaus G. Melchers, Julia C. Büttner","doi":"10.1111/ijsa.12403","DOIUrl":"10.1111/ijsa.12403","url":null,"abstract":"<p>Asynchronous video interviews (AVIs) are increasingly used to preselect applicants. Previous research found that interviewees are more skeptical of these interviews compared to other forms of interviews. However, comparing AVIs to other interviews is not completely appropriate because of their lack of interactivity and their use during earlier stages of the selection process. Therefore, we compared perceptions of AVIs with perceptions of other preselection tools (online cognitive ability tests and online application documents). Compared to other preselection instruments, potential applicants do not have more skeptical fairness perceptions of AVIs. However, we found differences for perceived usefulness, perceived ease of use, privacy concerns, and perceptions of organizational attractiveness. Organizations can take this into account when choosing how to preselect their applicants.</p>","PeriodicalId":51465,"journal":{"name":"International Journal of Selection and Assessment","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2022-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/ijsa.12403","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45336252","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}