A Comparison of Treatment after Detecting insufficient effort respondings in Survey data through Simulation study

Wooyoul Na
{"title":"A Comparison of Treatment after Detecting insufficient effort respondings in Survey data through Simulation study","authors":"Wooyoul Na","doi":"10.31158/jeev.2022.35.3.489","DOIUrl":null,"url":null,"abstract":"Since insufficient effort responding(IER) in survey data caused by a variety factors threaten the validity of the data and lead to inaccurate research results, it is necessary to detect and treat IER before conducting the main data analysis is a necessary in order to produce more reliable research results. Nevertheless, it has been insufficient to discuss about treatments how to deal with the data after detecting IER. Accordingly, this purpose of this study is to provide methodological implications about more feasible treatments after detecting IER by comparing complete data analysis, casewise- deletion, and multiple imputation which are applicable after detecting IER through simulation in the context of analyzing categorical confirmatory factor analysis. The main results of this study are as follows. First, It is showed that the casewise deletion tends to perform better than other treatments in terms of goodness-of-fit index and the accuracy of parameter estimation. Second, complete data analysis tends to perform poorly in the goodness-of-fit index and showed inaccurate results in estimating the relationship between constructs. Third, It is showed that multiple imputation tends to perform better than analyzing complete data in the model fit index, and it is indicated to be relatively accurate in estimating the relationship between constructs. However, It was inaccurate in terms of estimating factor loadings when multiple imputation was applied. Based on the results, It has been discussed about more efficient treatments how to deal with the survey data after detecting IER.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"26 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Korean Society for Educational Evaluation","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.31158/jeev.2022.35.3.489","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Since insufficient effort responding(IER) in survey data caused by a variety factors threaten the validity of the data and lead to inaccurate research results, it is necessary to detect and treat IER before conducting the main data analysis is a necessary in order to produce more reliable research results. Nevertheless, it has been insufficient to discuss about treatments how to deal with the data after detecting IER. Accordingly, this purpose of this study is to provide methodological implications about more feasible treatments after detecting IER by comparing complete data analysis, casewise- deletion, and multiple imputation which are applicable after detecting IER through simulation in the context of analyzing categorical confirmatory factor analysis. The main results of this study are as follows. First, It is showed that the casewise deletion tends to perform better than other treatments in terms of goodness-of-fit index and the accuracy of parameter estimation. Second, complete data analysis tends to perform poorly in the goodness-of-fit index and showed inaccurate results in estimating the relationship between constructs. Third, It is showed that multiple imputation tends to perform better than analyzing complete data in the model fit index, and it is indicated to be relatively accurate in estimating the relationship between constructs. However, It was inaccurate in terms of estimating factor loadings when multiple imputation was applied. Based on the results, It has been discussed about more efficient treatments how to deal with the survey data after detecting IER.
通过仿真研究调查数据中发现努力响应不足后的处理方法比较
由于各种因素导致的调查数据的努力响应不足(IER)威胁到数据的有效性,导致研究结果不准确,因此在进行主数据分析之前,有必要对IER进行检测和处理,以产生更可靠的研究结果。然而,关于如何处理检测到IER后的数据的讨论还不够充分。因此,本研究的目的是在分析分类验证性因子分析的背景下,通过比较模拟检测IER后适用的完整数据分析、个案删除和多重imputation,为检测IER后更可行的治疗方法提供方法学意义。本研究的主要结果如下:首先,在拟合优度指标和参数估计精度方面,案例删除往往优于其他处理。其次,完整的数据分析往往在拟合优度指标上表现不佳,并且在估计构造之间的关系时显示不准确的结果。第三,在模型拟合指标上,多元拟合往往优于分析完整数据,并且在估计结构之间的关系方面相对准确。然而,当应用多重插值时,在估计因子负荷方面是不准确的。在此基础上,探讨了在检测到IER后如何对调查数据进行有效处理。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信