A New Investigation of Fake Resistance of a Multidimensional Forced-Choice Measure: An Application of Differential Item/Test Functioning

IF 2.6 3区管理学 Q2 DEVELOPMENT STUDIES

Public Administration and Development Pub Date : 2021-05-01 DOI:10.25035/PAD.2021.01.004

Philseok Lee, Seang-Hwane Joo

{"title":"A New Investigation of Fake Resistance of a Multidimensional Forced-Choice Measure: An Application of Differential Item/Test Functioning","authors":"Philseok Lee, Seang-Hwane Joo","doi":"10.25035/PAD.2021.01.004","DOIUrl":null,"url":null,"abstract":"To address faking issues associated with Likert-type personality measures, multidimensional forced-choice (MFC) measures have recently come to light as important components of personnel assessment systems. Despite various efforts to investigate the fake resistance of MFC measures, previous research has mainly focused on the scale mean differences between honest and faking conditions. Given the recent psychometric advancements in MFC measures (e.g., Brown & Maydeu-Olivares, 2011; Stark et al., 2005; Lee et al., 2019; Joo et al., 2019), there is a need to investigate the fake resistance of MFC measures through a new methodological lens. This research investigates the fake resistance of MFC measures through recently proposed differential item functioning (DIF) and differential test functioning (DTF) methodologies for MFC measures (Lee, Joo, & Stark, 2020). Overall, our results show that MFC measures are more fake resistant than Likert-type measures at the item and test levels. However, MFC measures may still be susceptible to faking if MFC measures include many mixed blocks consisting of positively and negatively keyed statements within a block. It may be necessary for future research to find an optimal strategy to design mixed blocks in the MFC measures to satisfy the goals of validity and scoring accuracy. Practical implications and limitations are discussed in the paper.","PeriodicalId":39679,"journal":{"name":"Public Administration and Development","volume":"7 1","pages":"4"},"PeriodicalIF":2.6000,"publicationDate":"2021-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"8","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Public Administration and Development","FirstCategoryId":"91","ListUrlMain":"https://doi.org/10.25035/PAD.2021.01.004","RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"DEVELOPMENT STUDIES","Score":null,"Total":0}

引用次数: 8

Abstract

To address faking issues associated with Likert-type personality measures, multidimensional forced-choice (MFC) measures have recently come to light as important components of personnel assessment systems. Despite various efforts to investigate the fake resistance of MFC measures, previous research has mainly focused on the scale mean differences between honest and faking conditions. Given the recent psychometric advancements in MFC measures (e.g., Brown & Maydeu-Olivares, 2011; Stark et al., 2005; Lee et al., 2019; Joo et al., 2019), there is a need to investigate the fake resistance of MFC measures through a new methodological lens. This research investigates the fake resistance of MFC measures through recently proposed differential item functioning (DIF) and differential test functioning (DTF) methodologies for MFC measures (Lee, Joo, & Stark, 2020). Overall, our results show that MFC measures are more fake resistant than Likert-type measures at the item and test levels. However, MFC measures may still be susceptible to faking if MFC measures include many mixed blocks consisting of positively and negatively keyed statements within a block. It may be necessary for future research to find an optimal strategy to design mixed blocks in the MFC measures to satisfy the goals of validity and scoring accuracy. Practical implications and limitations are discussed in the paper.

查看原文本刊更多论文

多维强制选择测度伪电阻的新研究——微分项/测试函数的应用

为了解决与Likert型人格测量相关的造假问题，多维强迫选择（MFC）测量最近被发现是人事评估系统的重要组成部分。尽管人们努力调查MFC措施的虚假抵抗力，但以前的研究主要集中在诚实和虚假条件之间的量表均值差异上。鉴于MFC测量的最新心理测量进展（例如，Brown&Maydeu-Olivares，2011；Stark等人，2005年；Lee等人，2019；Joo等人，2019），有必要通过一个新的方法论视角来研究MFC测量的假抵抗力。本研究通过最近提出的MFC测量的差异项目功能（DIF）和差异测试功能（DTF）方法来调查MFC测量的假抵抗力（Lee，Joo，&Stark，2020）。总体而言，我们的结果表明，在项目和测试层面上，MFC测量比Likert类型的测量更具防伪性。然而，如果MFC度量包括由块内的正键和负键语句组成的许多混合块，则MFC度量可能仍然容易伪造。未来的研究可能有必要找到一种在MFC测量中设计混合块的最佳策略，以满足有效性和评分准确性的目标。本文讨论了实际意义和局限性。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Public Administration and Development Social Sciences-Development

CiteScore

3.30

自引率

12.00%

发文量

期刊介绍： Since its founding in 1949, Public Administration and Development (PAD) has been reviewing and assessing the practice of public administration at the local, regional, national and international levels where it is directed to managing development processes in low and medium income countries. It gives special attention to investigations of the management of all phases of public policy formulation and implementation which have an interest and importance beyond a particular government and state. PAD has a particular interest in the link between public administration practice and management research and provides a professional and academic forum for reporting on new experiences and experiments. PAD also publishes articles on development management research in the NGO sector. It is widely read by academics and practitioners alike, including consultants, donors and policy advisers. With its case study approach, it is also frequently used for teaching and training purposes.