D. Morillo, F. J. Abad, R. S. Kreitchmann, I. Leenen, P. Hontangas, V. Ponsoda
{"title":"从李克特问卷到强迫选择问卷的旅程:项目参数不变性的证据","authors":"D. Morillo, F. J. Abad, R. S. Kreitchmann, I. Leenen, P. Hontangas, V. Ponsoda","doi":"10.5093/JWOP2019A11","DOIUrl":null,"url":null,"abstract":"Multidimensional forced-choice questionnaires are widely regarded in the personnel selection literature for their ability to control response biases. Recently developed IRT models usually rely on the assumption that item parameters remain invariant when they are paired in forced-choice blocks, without giving it much consideration. This study aims to test this assumption empirically on the MUPP-2PL model, comparing the parameter estimates of the forced-choice format to their graded-scale equivalent on a Big Five personality instrument. The assumption was found to hold reasonably well, especially for the discrimination parameters. In the cases in which it was violated, we briefly discuss the likely factors that may lead to non-invariance. We conclude discussing the practical implications of the results and providing a few guidelines for the design of forced-choice questionnaires based on the invariance assumption.","PeriodicalId":46388,"journal":{"name":"Journal of Work and Organizational Psychology-Revista De Psicologia Del Trabajo Y De Las Organizaciones","volume":"42 1","pages":""},"PeriodicalIF":2.4000,"publicationDate":"2019-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"21","resultStr":"{\"title\":\"The Journey from Likert to Forced-Choice Questionnaires: Evidence of the Invariance of Item Parameters\",\"authors\":\"D. Morillo, F. J. Abad, R. S. Kreitchmann, I. Leenen, P. Hontangas, V. Ponsoda\",\"doi\":\"10.5093/JWOP2019A11\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Multidimensional forced-choice questionnaires are widely regarded in the personnel selection literature for their ability to control response biases. Recently developed IRT models usually rely on the assumption that item parameters remain invariant when they are paired in forced-choice blocks, without giving it much consideration. This study aims to test this assumption empirically on the MUPP-2PL model, comparing the parameter estimates of the forced-choice format to their graded-scale equivalent on a Big Five personality instrument. The assumption was found to hold reasonably well, especially for the discrimination parameters. In the cases in which it was violated, we briefly discuss the likely factors that may lead to non-invariance. We conclude discussing the practical implications of the results and providing a few guidelines for the design of forced-choice questionnaires based on the invariance assumption.\",\"PeriodicalId\":46388,\"journal\":{\"name\":\"Journal of Work and Organizational Psychology-Revista De Psicologia Del Trabajo Y De Las Organizaciones\",\"volume\":\"42 1\",\"pages\":\"\"},\"PeriodicalIF\":2.4000,\"publicationDate\":\"2019-06-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"21\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Work and Organizational Psychology-Revista De Psicologia Del Trabajo Y De Las Organizaciones\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.5093/JWOP2019A11\",\"RegionNum\":3,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"PSYCHOLOGY, APPLIED\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Work and Organizational Psychology-Revista De Psicologia Del Trabajo Y De Las Organizaciones","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.5093/JWOP2019A11","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PSYCHOLOGY, APPLIED","Score":null,"Total":0}
The Journey from Likert to Forced-Choice Questionnaires: Evidence of the Invariance of Item Parameters
Multidimensional forced-choice questionnaires are widely regarded in the personnel selection literature for their ability to control response biases. Recently developed IRT models usually rely on the assumption that item parameters remain invariant when they are paired in forced-choice blocks, without giving it much consideration. This study aims to test this assumption empirically on the MUPP-2PL model, comparing the parameter estimates of the forced-choice format to their graded-scale equivalent on a Big Five personality instrument. The assumption was found to hold reasonably well, especially for the discrimination parameters. In the cases in which it was violated, we briefly discuss the likely factors that may lead to non-invariance. We conclude discussing the practical implications of the results and providing a few guidelines for the design of forced-choice questionnaires based on the invariance assumption.