Timo Seitz, Eunike Wetzel, Benjamin E Hilbig, Thorsten Meiser
{"title":"Using the multidimensional nominal response model to model faking in questionnaire data: The importance of item desirability characteristics.","authors":"Timo Seitz, Eunike Wetzel, Benjamin E Hilbig, Thorsten Meiser","doi":"10.3758/s13428-024-02509-x","DOIUrl":null,"url":null,"abstract":"<p><p>Faking in self-report personality questionnaires describes a deliberate response distortion aimed at presenting oneself in an overly favorable manner. Unless the influence of faking on item responses is taken into account, faking can harm multiple psychometric properties of a test. In the present article, we account for faking using an extension of the multidimensional nominal response model (MNRM), which is an item response theory (IRT) model that offers a flexible framework for modeling different kinds of response biases. Particularly, we investigated under which circumstances the MNRM can adequately adjust substantive trait scores and latent correlations for the influence of faking and examined the role of variation in the way item content is related to social desirability (i.e., item desirability characteristics) in facilitating the modeling of faking and counteracting its detrimental effects. Using a simulation, we found that the inclusion of a faking dimension in the model can overall improve the recovery of substantive trait person parameters and latent correlations between substantive traits, especially when the impact of faking in the data is high. Item desirability characteristics moderated the effect of modeling faking and were themselves associated with different levels of parameter recovery. In an empirical demonstration with N = 1070 test-takers, we also showed that the faking modeling approach in combination with different item desirability characteristics can prove successful in empirical questionnaire data. We end the article with a discussion of implications for psychological assessment.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":" ","pages":"8869-8896"},"PeriodicalIF":4.6000,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11525249/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Behavior Research Methods","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.3758/s13428-024-02509-x","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/9/20 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"PSYCHOLOGY, EXPERIMENTAL","Score":null,"Total":0}
引用次数: 0
Abstract
Faking in self-report personality questionnaires describes a deliberate response distortion aimed at presenting oneself in an overly favorable manner. Unless the influence of faking on item responses is taken into account, faking can harm multiple psychometric properties of a test. In the present article, we account for faking using an extension of the multidimensional nominal response model (MNRM), which is an item response theory (IRT) model that offers a flexible framework for modeling different kinds of response biases. Particularly, we investigated under which circumstances the MNRM can adequately adjust substantive trait scores and latent correlations for the influence of faking and examined the role of variation in the way item content is related to social desirability (i.e., item desirability characteristics) in facilitating the modeling of faking and counteracting its detrimental effects. Using a simulation, we found that the inclusion of a faking dimension in the model can overall improve the recovery of substantive trait person parameters and latent correlations between substantive traits, especially when the impact of faking in the data is high. Item desirability characteristics moderated the effect of modeling faking and were themselves associated with different levels of parameter recovery. In an empirical demonstration with N = 1070 test-takers, we also showed that the faking modeling approach in combination with different item desirability characteristics can prove successful in empirical questionnaire data. We end the article with a discussion of implications for psychological assessment.
自我报告式人格问卷中的作假是指故意歪曲回答,目的是以过于有利的方式表现自己。如果不考虑伪造对项目反应的影响,伪造就会损害测验的多种心理测量属性。多维名义反应模型(MNRM)是一个项目反应理论(IRT)模型,它为不同类型的反应偏差建模提供了一个灵活的框架。特别是,我们研究了多维名义反应模型在什么情况下可以充分调整实质性特质得分和潜在相关性,使其免受作假的影响,并考察了项目内容与社会可取性相关方式的变化(即项目可取性特征)在促进作假建模和抵消其不利影响方面的作用。通过模拟,我们发现在模型中加入伪造维度可以从整体上改善实质性特质人称参数和实质性特质之间潜在相关性的恢复,尤其是当数据中伪造的影响较大时。项目可取性特征调节了建模伪造的效果,其本身也与不同程度的参数恢复有关。在对 N = 1070 名应试者进行的实证演示中,我们还证明了将伪造建模方法与不同的项目可取性特征相结合可以在实证问卷数据中取得成功。文章最后,我们讨论了对心理评估的影响。
期刊介绍:
Behavior Research Methods publishes articles concerned with the methods, techniques, and instrumentation of research in experimental psychology. The journal focuses particularly on the use of computer technology in psychological research. An annual special issue is devoted to this field.