U. Schroeders, Maximilian Morgenstern, K. Jankowsky, Timo Gnambs
{"title":"Short-Scale Construction Using Meta-Analytic Ant Colony Optimization","authors":"U. Schroeders, Maximilian Morgenstern, K. Jankowsky, Timo Gnambs","doi":"10.1027/1015-5759/a000818","DOIUrl":"https://doi.org/10.1027/1015-5759/a000818","url":null,"abstract":"Abstract: The Need for Cognition Scale (NCS) is a self-report scale measuring individual differences in the tendency to engage in and enjoy thinking. The shortened version with 18 items (NCS-18; Cacioppo et al., 1984 ) has widely been administered in research on persuasion, critical thinking, and educational achievement. Whereas most studies advocated for essential uni-dimensionality, the question remains which psychometric model yields the best representation of the NCS-18. In the present study, we compared six competing measurement models for the NCS-18 with meta-analytic structural equation models using summary data of 87 samples ( N = 90,215). Results demonstrated that the negatively worded items introduced considerable measurement bias that was best accounted for with an acquiescence model. In a further analytical step, we showcased how the pooled correlation matrix can be used to compile short versions of the NCS-18 via Ant Colony Optimization. We examined model fit and reliability of short scales with varying item numbers (between 4 and 15) and a balanced ratio of positively and negatively worded items. We discuss the potentials and limits of the newly proposed method.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2024-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140382969","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Survey Design Moderates Negativity Bias but not Positivity Bias in Self-Reported Job Stress","authors":"Roman Pauli, Jessica Lang","doi":"10.1027/1015-5759/a000806","DOIUrl":"https://doi.org/10.1027/1015-5759/a000806","url":null,"abstract":"Abstract: Self-report measures are both frequently used and criticized in studies of job-related stress. The question remains whether affective dispositions lead to biased assessments. In this study, we examine the extent to which survey characteristics are susceptible to bias by the characteristics of the person making the assessment. Participants ( N = 1,509) in an online split ballot experiment were randomly assigned to report their job stressors using a 2 (task vs. person-related items) × 2 (frequency vs. agreement response format) factorial design. Participants high in neuroticism or negative affectivity, but not positive affectivity, reported more job stressors when responding to person-related items compared to task-related items. Individuals high in neuroticism reported more job stressors when assessed with agreement compared to frequency response format. However, the response format did not alter the relationship between self-reported job stressors and positive or negative affectivity. Findings indicate how survey design can reinforce affectivity bias in the assessments of job stressors. If an assessment is intended to evaluate objective circumstances rather than subjective experiences at work (e.g., the presence of general risk factors within psychosocial risk assessment), it is recommended to employ condition-related questionnaires with task-related item wordings and frequency response formats.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2024-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139624315","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Steven Bißantz, Susanne Frick, Filip Melinscak, D. Iliescu, Eunike Wetzel
{"title":"The Potential of Machine Learning Methods in Psychological Assessment and Test Construction","authors":"Steven Bißantz, Susanne Frick, Filip Melinscak, D. Iliescu, Eunike Wetzel","doi":"10.1027/1015-5759/a000817","DOIUrl":"https://doi.org/10.1027/1015-5759/a000817","url":null,"abstract":"","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2024-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139381301","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An Examination of the Role of Inverted Dark Tetrad Items on Structural Properties and Construct Validity","authors":"Christian Blötner, D. Grüning","doi":"10.1027/1015-5759/a000805","DOIUrl":"https://doi.org/10.1027/1015-5759/a000805","url":null,"abstract":"Abstract: The use of inverted items is under vigorous debate in psychometric research. However, especially in the field of the Dark Tetrad – a compound of the aversive yet subclinical traits Machiavellianism, narcissism, psychopathy, and sadism –, the use of items in which high endorsement indicates low levels appears promising to obtain more information about low scores on the four traits. In this preregistered research ( N = 500), we developed an alternative version of the Short Dark Tetrad (SD4) which – unlike the original SD4 – has a balanced set of regular and inverted items. Following the theory of utilizing inverted items, we demonstrate that more information (in the sense of item response theory) can be obtained from the newly devised Mixed SD4 (MSD4) as compared to the original SD4. Thereby, the scores of the MSD4 can be validly interpreted in the sense of the underlying traits’ theories (i.e., construct validity), and the SD4 and the MSD4 yield highly similar nomological networks. We conclude that including inverted items is advantageous for the assessment of the Dark Tetrad. More generally, we present this case as a demonstration that balanced item sets are necessary to capture traits and behaviors exhaustively.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2023-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139003644","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Evaluating the Psychometric Properties of the Romanian Version of Thriving at Work Scale","authors":"Norberth-Ioan Okros, D. Vîrgă","doi":"10.1027/1015-5759/a000804","DOIUrl":"https://doi.org/10.1027/1015-5759/a000804","url":null,"abstract":"Abstract: The present research aims to evaluate the psychometric properties of the Romanian version of the thriving at work scale (TWS). Three studies were conducted to test the reliability and validity of the TWS. The first study ( N = 451) aimed to adapt and validate the Romanian version of TWS. The confirmatory factor analysis results indicated that the second-order model with 10-items has a good value of the fit indices. The second study ( N = 435) tested measurement invariances, demonstrating that the Romanian version of this scale has varying levels of thriving at work across job tenure and a differential functioning of items 2 and 9 across age. The third study ( N = 312) cross-validated the second-order model. It tested the construct-related validity of TWS with other relevant constructs (job and career satisfaction, burnout, mental health complaints, performance). The results indicated that the TWS is a reliable and valid instrument demonstrating the crucial implications for Romanian working people’s well-being and career development.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2023-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139008151","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Development and Validation of the Work Orientation Questionnaire Short-Form (WOQ-SF)","authors":"Doudou Liu, Yiming Wang, Chaoping Li","doi":"10.1027/1015-5759/a000814","DOIUrl":"https://doi.org/10.1027/1015-5759/a000814","url":null,"abstract":"Abstract: This research aims to develop a 15-item short form of the WOQ (WOQ-SF) and provide evidence for its reliability and validity. In Study 1 ( N = 305), we simplified the WOQ into a short version in line with the scale reduction procedure and recommendations ( Kruyen et al., 2013 ; Stanton et al., 2002 ). The exploratory factor analysis (EFA) reveals that the five factors of the WOQ-SF are conceptually distinct and correlated with each other. In Study 2 ( N = 442), the psychometric properties of the WOQ-SF were investigated. The findings of the confirmatory factor analysis (CFA) confirm a good factor structure. In addition, the measurement invariance of this shortened scale was examined across gender, age, education level, and job tenure. Regarding validity, significant correlations between the WOQ-SF and the original WOQ were found. Furthermore, the WOQ-SF demonstrates relationships with career satisfaction, work engagement, job satisfaction, and career planning, providing evidence for its validity. In sum, the WOQ-SF shows good psychometric properties comparable to the WOQ, suggesting it is a suitable alternative.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2023-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139008877","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Elisha Johnston, Steven P. Reise, Karen L. Spritzer, Ron D. Hays
{"title":"Seeing the Light in Self-Reported Glare","authors":"Elisha Johnston, Steven P. Reise, Karen L. Spritzer, Ron D. Hays","doi":"10.1027/1015-5759/a000798","DOIUrl":"https://doi.org/10.1027/1015-5759/a000798","url":null,"abstract":"Abstract: We conducted a secondary analysis to evaluate two glare items versus a composite score from the two items in a sample of 544 patients (38% women; Mdn = 29 years old; 13% high school education or less) before and after eye surgery. The first question was from a National Eye Institute (NEI) survey and the second question included a definition and picture of glare. At baseline, 28% of participants reported glare on the NEI item versus 39% on the question with the definition and picture. There was 76% agreement between the two questions ( K = .46). Three months after baseline, there was no change in the percentage of participants who reported glare on the NEI question (27%), but a significant decrease in participants reporting glare on the question with the definition and picture (38% at baseline to 25% 3 months later). A 2-item glare scale was more reliable and highly correlated with multi-item measures of halos and starbursts than the individual items. Change in the scale was more strongly associated than the items with the change in satisfaction with vision and with satisfaction with surgery. The scale may provide a better indicator of glare than either item alone.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135136615","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Validity of an Inconsistency Scale for the PID-5 in Community-Dwelling Younger and Older Adults","authors":"Allyson Dubois, Martin Sellbom, Gina Rossi","doi":"10.1027/1015-5759/a000802","DOIUrl":"https://doi.org/10.1027/1015-5759/a000802","url":null,"abstract":"Abstract: The Personality Inventory for DSM-5 (PID-5; Krueger et al., 2012 ) is a self-report questionnaire measuring pathological traits of personality disorders. Keeley and colleagues (2016) developed an Inconsistency Scale for the PID-5 (PID-5-INC) to detect random responses. We examined the ability of the PID-5-INC to detect inconsistent responders in a new linguistic context (Dutch) and age group (older adults). The Dutch PID-5 version ( van der Heijden et al., 2014 ) was administered to two Dutch community-dwelling younger (18–64 years old: N = 439) and older adults (65 years or older: N = 251). The PID-5-INC item pairs showed large interitem correlations in the younger adult sample and at least medium interitem correlations, except for one item pair, in the older adult sample. Similarly to Keeley and colleagues , a cut-off score of 17 was the optimal cut-off point for both the younger and older adult samples. However, for the younger adult sample, a cut-off score of 16 provided an even better balance between specificity and sensitivity. We concluded that our results support the use of the PID-5-INC in Dutch-speaking community-dwelling younger and older adults and point out the importance of including validity scales for self-report questionnaires.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135637092","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Philipp Geisen, Friedemann Trutzenberg, Michael Eid
{"title":"Efficient Measurement of Global Human Identification and Citizenship – Is One Item Sufficient?","authors":"Philipp Geisen, Friedemann Trutzenberg, Michael Eid","doi":"10.1027/1015-5759/a000801","DOIUrl":"https://doi.org/10.1027/1015-5759/a000801","url":null,"abstract":"Abstract: To address the complexity of global challenges (e.g., migration, climate change), research must examine many constructs and their interrelationships. Therefore, efficient assessment methods (e.g., short scales) are required, especially when constructing large-scale social surveys. A widely used instrument for assessing global identification as an important predictor of behavior related to coping with global challenges is the Identification With All Humanity (IWAH) scale ( McFarland et al., 2012 ). With the present study, we aimed to investigate whether this scale can be sufficiently represented by a single item. Using bifactor-(S*I − 1) models, we analyzed whether one item from the scale itself (Item 5) and a related single-item measure from the World Values Survey (WVS; Inglehart et al., 2018 ) could adequately represent a German version of the IWAH scale. The sample ( n = 1,369) was representative of the German population regarding age, gender, income, education, and region of residence. Item 5 showed an appropriate single-item reliability (.82) and represented 64–93% of the true variance in the individual IWAH items, whereas the WVS item (Rel( Y WVS ) = .61) represented 52–81%. To reflect the multidimensionality of the IWAH, a 4-item short scale is recommended.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135635840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Exploring the Validity of the Work Preferences Questionnaire","authors":"Alina N. Stamate, Pascale L. Denis","doi":"10.1027/1015-5759/a000799","DOIUrl":"https://doi.org/10.1027/1015-5759/a000799","url":null,"abstract":"Abstract: This study aimed was to develop and validate a new instrument called the Work Preferences Questionnaire (WPQ) to measure individuals’ preferences for work characteristics that are relevant to today’s work environment. A multi-step approach and two samples were used to develop and validate the WPQ across various industries. In the first study, a group of experts developed a bank of items that were then administered to 984 workers. Exploratory factor analysis revealed a nine-factor structure with good internal consistency. In the second study, an independent sample of 687 workers was used to confirm the factorial structure and highlight the distinctness of the work preference dimensions. The study found small mean differences in interindividual preference scores based on age and confirmed data equivalence between gender and education level. The WPQ addresses limitations of existing measures by focusing on a narrow set of work preferences that are highly relevant in the current work environment and includes modern aspects such as teleworking and work-life balance. The WPQ promises to be an effective tool for research and human resources practices, enabling individuals and organizations to better understand work preferences and make informed decisions about work design and personnel selection.","PeriodicalId":48018,"journal":{"name":"European Journal of Psychological Assessment","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135636048","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}