Detecting Careless Responding in Multidimensional Forced-Choice Questionnaires

IF 4.6 Q2 MATERIALS SCIENCE, BIOMATERIALS

ACS Applied Bio Materials Pub Date : 2024-01-12 DOI:10.1177/00131644231222420

Rebekka Kupffer, Susanne Frick, Eunike Wetzel

{"title":"Detecting Careless Responding in Multidimensional Forced-Choice Questionnaires","authors":"Rebekka Kupffer, Susanne Frick, Eunike Wetzel","doi":"10.1177/00131644231222420","DOIUrl":null,"url":null,"abstract":"The multidimensional forced-choice (MFC) format is an alternative to rating scales in which participants rank items according to how well the items describe them. Currently, little is known about how to detect careless responding in MFC data. The aim of this study was to adapt a number of indices used for rating scales to the MFC format and additionally develop several new indices that are unique to the MFC format. We applied these indices to a data set from an online survey ( N = 1,169) that included a series of personality questionnaires in the MFC format. The correlations among the careless responding indices were somewhat lower than those published for rating scales. Results from a latent profile analysis suggested that the majority of the sample (about 76–84%) did not respond carelessly, although the ones who did were characterized by different levels of careless responding. In a simulation study, we simulated different careless responding patterns and varied the overall proportion of carelessness in the samples. With one exception, the indices worked as intended conceptually. Taken together, the results suggest that careless responding also plays an important role in the MFC format. Recommendations on how it can be addressed are discussed.","PeriodicalId":2,"journal":{"name":"ACS Applied Bio Materials","volume":" 20","pages":""},"PeriodicalIF":4.6000,"publicationDate":"2024-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Bio Materials","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/00131644231222420","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, BIOMATERIALS","Score":null,"Total":0}

引用次数: 0

Abstract

The multidimensional forced-choice (MFC) format is an alternative to rating scales in which participants rank items according to how well the items describe them. Currently, little is known about how to detect careless responding in MFC data. The aim of this study was to adapt a number of indices used for rating scales to the MFC format and additionally develop several new indices that are unique to the MFC format. We applied these indices to a data set from an online survey ( N = 1,169) that included a series of personality questionnaires in the MFC format. The correlations among the careless responding indices were somewhat lower than those published for rating scales. Results from a latent profile analysis suggested that the majority of the sample (about 76–84%) did not respond carelessly, although the ones who did were characterized by different levels of careless responding. In a simulation study, we simulated different careless responding patterns and varied the overall proportion of carelessness in the samples. With one exception, the indices worked as intended conceptually. Taken together, the results suggest that careless responding also plays an important role in the MFC format. Recommendations on how it can be addressed are discussed.

查看原文本刊更多论文

检测多维强迫选择问卷中的粗心应答

多维强迫选择（MFC）形式是评分量表的一种替代方法，参与者根据项目对其描述的程度对项目进行排序。目前，人们对如何检测 MFC 数据中的粗心应答知之甚少。本研究的目的是将一些用于评分量表的指数调整为 MFC 格式，并开发出几个 MFC 格式特有的新指数。我们将这些指数应用于一个在线调查（N = 1,169）的数据集，其中包括一系列 MFC 格式的人格问卷。粗心应答指数之间的相关性略低于评级量表的相关性。潜在特征分析的结果表明，大多数样本（约 76-84%）并没有粗心应答，尽管粗心应答者的粗心程度各不相同。在模拟研究中，我们模拟了不同的粗心应答模式，并改变了样本中粗心应答的总体比例。除了一个例外，这些指数都达到了预期的概念效果。总之，研究结果表明，粗心应答在 MFC 格式中也起着重要作用。本文讨论了如何解决这一问题的建议。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

ACS Applied Bio Materials Chemistry-Chemistry (all)

CiteScore

9.40

自引率

2.10%

发文量

464

期刊介绍： ACS Applied Bio Materials is an interdisciplinary journal publishing original research covering all aspects of biomaterials and biointerfaces including and beyond the traditional biosensing, biomedical and therapeutic applications. The journal is devoted to reports of new and original experimental and theoretical research of an applied nature that integrates knowledge in the areas of materials, engineering, physics, bioscience, and chemistry into important bio applications. The journal is specifically interested in work that addresses the relationship between structure and function and assesses the stability and degradation of materials under relevant environmental and biological conditions.