{"title":"基于响应时间的贝叶斯因子混合模型检测粗心应答者。","authors":"Lijin Zhang, Esther Ulitzsch, Benjamin W Domingue","doi":"10.3758/s13428-025-02797-x","DOIUrl":null,"url":null,"abstract":"<p><p>Careless respondents inject noise into data which can distort research findings and compromise model fit. To address this, factor mixture modeling (FMM) has been widely used to identify careless respondents. Traditionally, researchers have relied on reverse-worded questions in FMM to facilitate the detection of careless responding. With the rise of online data collection platforms, response time has appeal as a means for understanding careless behavior. We introduce a Bayesian FMM that leverages this rich source of information to identify careless respondents. By jointly modeling responses and response time, this approach effectively identifies careless individuals rushing through the questionnaire without providing responses that reflect the to-be-measured traits. Our simulation studies demonstrate that this model accurately estimates parameters and classifies respondents as either attentive or careless, while maintaining error rates within acceptable limits. Furthermore, integrating response time enhances model convergence and the precision of classification and estimation. Using mediation models as an example, we illustrate how social science researchers can use this FMM approach to address careless responding in substantive research. An empirical study further tests the applicability of the proposed model in real-world scenarios, comparing its conclusions with traditional methods. To support its use, we provide an R function to streamline implementation.</p>","PeriodicalId":8717,"journal":{"name":"Behavior Research Methods","volume":"57 10","pages":"286"},"PeriodicalIF":3.9000,"publicationDate":"2025-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Bayesian factor mixture modeling with response time for detecting careless respondents.\",\"authors\":\"Lijin Zhang, Esther Ulitzsch, Benjamin W Domingue\",\"doi\":\"10.3758/s13428-025-02797-x\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Careless respondents inject noise into data which can distort research findings and compromise model fit. To address this, factor mixture modeling (FMM) has been widely used to identify careless respondents. Traditionally, researchers have relied on reverse-worded questions in FMM to facilitate the detection of careless responding. With the rise of online data collection platforms, response time has appeal as a means for understanding careless behavior. We introduce a Bayesian FMM that leverages this rich source of information to identify careless respondents. By jointly modeling responses and response time, this approach effectively identifies careless individuals rushing through the questionnaire without providing responses that reflect the to-be-measured traits. Our simulation studies demonstrate that this model accurately estimates parameters and classifies respondents as either attentive or careless, while maintaining error rates within acceptable limits. Furthermore, integrating response time enhances model convergence and the precision of classification and estimation. Using mediation models as an example, we illustrate how social science researchers can use this FMM approach to address careless responding in substantive research. An empirical study further tests the applicability of the proposed model in real-world scenarios, comparing its conclusions with traditional methods. To support its use, we provide an R function to streamline implementation.</p>\",\"PeriodicalId\":8717,\"journal\":{\"name\":\"Behavior Research Methods\",\"volume\":\"57 10\",\"pages\":\"286\"},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2025-09-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Behavior Research Methods\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.3758/s13428-025-02797-x\",\"RegionNum\":2,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PSYCHOLOGY, EXPERIMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Behavior Research Methods","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.3758/s13428-025-02797-x","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, EXPERIMENTAL","Score":null,"Total":0}
Bayesian factor mixture modeling with response time for detecting careless respondents.
Careless respondents inject noise into data which can distort research findings and compromise model fit. To address this, factor mixture modeling (FMM) has been widely used to identify careless respondents. Traditionally, researchers have relied on reverse-worded questions in FMM to facilitate the detection of careless responding. With the rise of online data collection platforms, response time has appeal as a means for understanding careless behavior. We introduce a Bayesian FMM that leverages this rich source of information to identify careless respondents. By jointly modeling responses and response time, this approach effectively identifies careless individuals rushing through the questionnaire without providing responses that reflect the to-be-measured traits. Our simulation studies demonstrate that this model accurately estimates parameters and classifies respondents as either attentive or careless, while maintaining error rates within acceptable limits. Furthermore, integrating response time enhances model convergence and the precision of classification and estimation. Using mediation models as an example, we illustrate how social science researchers can use this FMM approach to address careless responding in substantive research. An empirical study further tests the applicability of the proposed model in real-world scenarios, comparing its conclusions with traditional methods. To support its use, we provide an R function to streamline implementation.
期刊介绍:
Behavior Research Methods publishes articles concerned with the methods, techniques, and instrumentation of research in experimental psychology. The journal focuses particularly on the use of computer technology in psychological research. An annual special issue is devoted to this field.