{"title":"调查模式重要吗?中国数据质量的实验评估","authors":"Shihan Feng, Feng Huang","doi":"10.1016/j.chieco.2024.102271","DOIUrl":null,"url":null,"abstract":"<div><p>This study employs experimental data from the Labor Force Survey (LFS) to compare the data quality of computer-assisted web interviewing (CAWI) and computer-assisted personal interviewing (CAPI). The experiment was conducted in 2023 as part of the LFS, an ongoing longitudinal face-to-face survey of Chinese adults aged 16 and above in a mega city. Using the identical questionnaire, respondents were randomly assigned to either the control group (CAPI mode only) or the treatment group (optional CAPI and CAWI modes). The characteristics of households and individuals obtained using mixed-mode design do not significantly differ from those obtained from single-mode design (CAPI), indicating no mode effect on data quality for mixed-mode surveys. Additionally, there are no significant differences in data quality between CAWI and CAPI. CAWI respondents tend to take more time to answer the questions compared to CAPI respondents. Our findings offer valuable insights into enhancing mode-specific targeting and improving the quality of survey data collection by leveraging both existing survey data and paradata.</p></div>","PeriodicalId":48285,"journal":{"name":"中国经济评论","volume":"88 ","pages":"Article 102271"},"PeriodicalIF":5.2000,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Does survey mode matter? An experimental evaluation of data quality in China\",\"authors\":\"Shihan Feng, Feng Huang\",\"doi\":\"10.1016/j.chieco.2024.102271\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>This study employs experimental data from the Labor Force Survey (LFS) to compare the data quality of computer-assisted web interviewing (CAWI) and computer-assisted personal interviewing (CAPI). The experiment was conducted in 2023 as part of the LFS, an ongoing longitudinal face-to-face survey of Chinese adults aged 16 and above in a mega city. Using the identical questionnaire, respondents were randomly assigned to either the control group (CAPI mode only) or the treatment group (optional CAPI and CAWI modes). The characteristics of households and individuals obtained using mixed-mode design do not significantly differ from those obtained from single-mode design (CAPI), indicating no mode effect on data quality for mixed-mode surveys. Additionally, there are no significant differences in data quality between CAWI and CAPI. CAWI respondents tend to take more time to answer the questions compared to CAPI respondents. Our findings offer valuable insights into enhancing mode-specific targeting and improving the quality of survey data collection by leveraging both existing survey data and paradata.</p></div>\",\"PeriodicalId\":48285,\"journal\":{\"name\":\"中国经济评论\",\"volume\":\"88 \",\"pages\":\"Article 102271\"},\"PeriodicalIF\":5.2000,\"publicationDate\":\"2024-09-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"中国经济评论\",\"FirstCategoryId\":\"96\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1043951X24001603\",\"RegionNum\":1,\"RegionCategory\":\"经济学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ECONOMICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"中国经济评论","FirstCategoryId":"96","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1043951X24001603","RegionNum":1,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ECONOMICS","Score":null,"Total":0}
Does survey mode matter? An experimental evaluation of data quality in China
This study employs experimental data from the Labor Force Survey (LFS) to compare the data quality of computer-assisted web interviewing (CAWI) and computer-assisted personal interviewing (CAPI). The experiment was conducted in 2023 as part of the LFS, an ongoing longitudinal face-to-face survey of Chinese adults aged 16 and above in a mega city. Using the identical questionnaire, respondents were randomly assigned to either the control group (CAPI mode only) or the treatment group (optional CAPI and CAWI modes). The characteristics of households and individuals obtained using mixed-mode design do not significantly differ from those obtained from single-mode design (CAPI), indicating no mode effect on data quality for mixed-mode surveys. Additionally, there are no significant differences in data quality between CAWI and CAPI. CAWI respondents tend to take more time to answer the questions compared to CAPI respondents. Our findings offer valuable insights into enhancing mode-specific targeting and improving the quality of survey data collection by leveraging both existing survey data and paradata.
期刊介绍:
The China Economic Review publishes original works of scholarship which add to the knowledge of the economy of China and to economies as a discipline. We seek, in particular, papers dealing with policy, performance and institutional change. Empirical papers normally use a formal model, a data set, and standard statistical techniques. Submissions are subjected to double-blind peer review.