Journal of Official Statistics最新文献_第5页

The Effects of Response Burden – Collecting Life History Data in a Self-Administered Mixed-Device Survey 反应负担的影响——在自行管理的混合设备调查中收集生活史数据

IF 1.1 4区数学

Journal of Official Statistics Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0046

J. Carstensen, Sebastian Lang, Fine Cordua

{"title":"The Effects of Response Burden – Collecting Life History Data in a Self-Administered Mixed-Device Survey","authors":"J. Carstensen, Sebastian Lang, Fine Cordua","doi":"10.2478/jos-2022-0046","DOIUrl":"https://doi.org/10.2478/jos-2022-0046","url":null,"abstract":"Abstract Collecting life history data is highly demanding and therefore prone to error since respondents must retrieve and provide extensive complex information. Research has shown that response burden is an important factor influencing data quality. We examine whether increases in different measures of response burden in a (mixed-device) online survey lead to adverse effects on the data quality and whether these effects vary by the type of device used (mobile versus non-mobile). We conducted an experimental study in an online mixed-device survey, for which we developed a questionnaire on the educational and occupational trajectories of secondary-school graduates, undergraduates, and university graduates. To address our research question, we randomly assigned different levels of response burden to the participants and compared different measures on the data quality and response. We found mixed evidence for unfavourable effects of response burden on the examined outcomes. While some of our results were expected, they were not consistent across all subgroups. Most interestingly, the effects of response burden on outcomes seemed to differ based on the device used. Hence, we conclude that further research is needed to optimise the collection of complex data from different groups of participants.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"1069 - 1095"},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43542065","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Testing a Planned Missing Design to Reduce Respondent Burden in Web and SMS Administrations of the CAHPS Clinician and Group Survey (CG-CAHPS) 测试计划缺失设计以减轻CAHPS临床和群体调查(CG-CAHPS)网络和短信管理中的被调查者负担

IF 1.1 4区数学

Journal of Official Statistics Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0042

P. Brenner, J. Hargraves, Carol Cosenza

{"title":"Testing a Planned Missing Design to Reduce Respondent Burden in Web and SMS Administrations of the CAHPS Clinician and Group Survey (CG-CAHPS)","authors":"P. Brenner, J. Hargraves, Carol Cosenza","doi":"10.2478/jos-2022-0042","DOIUrl":"https://doi.org/10.2478/jos-2022-0042","url":null,"abstract":"Abstract We test a planned missing design to reduce respondent burden in Web and SMS administrations of the CAHPS Clinician and Group Survey (CG-CAHPS), a survey of patient experiences widely used by health care providers. Members of an online nonprobability panel were randomly assigned to one of three invitation and data collection mode protocols: email invitation to a Web survey, SMS invitation to a Web survey, or SMS invitation to an SMS survey. Within these three mode protocols, respondents were randomly assigned to a planned missing design, which shortened the survey by about 40%, or to a control group that received the survey in its entirety. We compare survey duration, breakoff and completion rates, and five key patient experience measures across conditions to assess the effect of the planned missing design across the three modes. We found that a planned missing design worked well with our Web survey, reducing survey duration and breakoff without changing estimates relative to the full-survey control condition. However, mixed findings in the SMS survey suggest that even shortened, 15-item surveys may be too long to substantially reduce respondent burden. We conclude with recommendations for future research.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"963 - 986"},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48352579","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The Effect of Burdensome Survey Questions on Data Quality in an Omnibus Survey 综合调查中繁琐的调查问题对数据质量的影响

IF 1.1 4区数学

Journal of Official Statistics Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0044

A. Phillips, Rachel Stenger

{"title":"The Effect of Burdensome Survey Questions on Data Quality in an Omnibus Survey","authors":"A. Phillips, Rachel Stenger","doi":"10.2478/jos-2022-0044","DOIUrl":"https://doi.org/10.2478/jos-2022-0044","url":null,"abstract":"Abstract In interviewer-administered omnibus surveys, burdensome questions asked early in a survey may result in lower quality responses to questions asked later in a survey. Two examples of these burdensome questions are social network questions, wherein respondents are asked about members of their personal network, and knowledge questions, wherein respondents are asked to provide a factually correct response to a question. In this study, we explore how the presence of potentially burdensome questions are associated with item nonresponse and acquiescence rates on subsequent survey questions, and whether this effect differs by respondent age and education. We use data from the 2010 General Social Survey (AAPOR RR5 ¼ 70.3%, AAPOR 2016), which experimentally varied the location of a social network module and the presence of a knowledge question module. Those who received knowledge questions had higher item nonresponse rates on subsequent questions than those who did not receive knowledge questions, but the quality of responses did not differ by the presence of social network questions. Further, respondents with different characteristics were not differentially burdened by the knowledge questions or the social network questions. We conclude that knowledge questions may be better asked near the end of omnibus surveys to preserve the response quality for subsequent questions.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"1019 - 1050"},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48539376","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Modeling the Relationship between Proxy Measures of Respondent Burden and Survey Response Rates in a Household Panel Survey. 家庭小组调查中受访者负担的代理指标与调查响应率之间的关系建模

IF 1.1 4区数学

Journal of Official Statistics Pub Date : 2022-12-01 DOI: 10.2478/jos-2022-0049

Morgan Earp, Robin Kaplan, Daniell Toth

{"title":"Modeling the Relationship between Proxy Measures of Respondent Burden and Survey Response Rates in a Household Panel Survey.","authors":"Morgan Earp, Robin Kaplan, Daniell Toth","doi":"10.2478/jos-2022-0049","DOIUrl":"10.2478/jos-2022-0049","url":null,"abstract":"Respondent burden has important implications for survey outcomes, including response rates and attrition in panel surveys. Despite this, respondent burden remains an understudied topic in the field of survey methodology, with few researchers systematically measuring objective and subjective burden factors in surveys used to produce official statistics. This research was designed to assess the impact of proxy measures of respondent burden, drawing on both objective (survey length and frequency), and subjective (effort, saliency, and sensitivity) burden measures on response rates over time in the Current Population Survey (CPS). Exploratory Factor Analysis confirmed the burden proxy measures were interrelated and formed five distinct factors. Regression tree models further indicated that both objective and subjective proxy burden factors were predictive of future CPS response rates. Additionally, respondent characteristics, including employment and marital status, interacted with these burden factors to further help predict response rates over time. We discuss the implications of these findings, including the importance of measuring both objective and subjective burden factors in production surveys. Our findings support a growing body of research suggesting that subjective burden and individual respondent characteristics should be incorporated into conceptual definitions of respondent burden and have implications for adaptive design.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"1145-1175"},"PeriodicalIF":1.1,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11130710/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42805259","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Economic Nowcasting with Long Short-Term Memory Artificial Neural Networks (LSTM) 长短期记忆人工神经网络(LSTM)经济临近预测

IF 1.1 4区数学

Journal of Official Statistics Pub Date : 2022-09-13 DOI: 10.2478/jos-2022-0037

Daniel Hopp

引用次数: 0

Identifying Data Quality Challenges in Online Opt-In Panels Using Cognitive Interviews in English and Spanish 使用英语和西班牙语的认知访谈识别在线选择小组中的数据质量挑战

IF 1.1 4区数学

Journal of Official Statistics Pub Date : 2022-09-01 DOI: 10.2478/jos-2022-0035

Y. G. Trejo, Mikelyn Meyers, Mandi Martinez, Angie O’Brien, Patricia L. Goerman, Betsarí Otero Class

{"title":"Identifying Data Quality Challenges in Online Opt-In Panels Using Cognitive Interviews in English and Spanish","authors":"Y. G. Trejo, Mikelyn Meyers, Mandi Martinez, Angie O’Brien, Patricia L. Goerman, Betsarí Otero Class","doi":"10.2478/jos-2022-0035","DOIUrl":"https://doi.org/10.2478/jos-2022-0035","url":null,"abstract":"Abstract In this article, we evaluate how the analysis of open-ended probes in an online cognitive interview can serve as a metric to identify cases that should be excluded due to disingenuous responses by ineligible respondents. We analyze data collected in 2019 via an online opt-in panel in English and Spanish to pretest a public opinion questionnaire (n = 265 in English and 199 in Spanish). We find that analyzing open-ended probes allowed us to flag cases completed by respondents who demonstrated problematic behaviors (e.g., answering many probes with repetitive textual patterns, by typing random characters, etc.), as well as to identify cases completed by ineligible respondents posing as eligible respondents (i.e., non-Spanish-speakers posing as Spanish-speakers). These findings indicate that data collected for multilingual pretesting research using online opt-in panels likely require additional evaluations of data quality. We find that open-ended probes can help determine which cases should be replaced when conducting pretesting using opt-in panels. We argue that open-ended probes in online cognitive interviews, while more time consuming and expensive to analyze than close-ended questions, serve as a valuable method of verifying response quality and respondent eligibility, particularly for researchers conducting multilingual surveys with online opt-in panels.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"793 - 822"},"PeriodicalIF":1.1,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48743538","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Measuring and Mapping Micro Level Earning Inequality towards Addressing the Sustainable Development Goals – A Multivariate Small Area Modelling Approach 测量和绘制微观层面的收入不平等以实现可持续发展目标——一种多变量小区域建模方法

IF 1.1 4区数学

Journal of Official Statistics Pub Date : 2022-09-01 DOI: 10.2478/jos-2022-0036

Saurav Guha, Hukum Chandra

{"title":"Measuring and Mapping Micro Level Earning Inequality towards Addressing the Sustainable Development Goals – A Multivariate Small Area Modelling Approach","authors":"Saurav Guha, Hukum Chandra","doi":"10.2478/jos-2022-0036","DOIUrl":"https://doi.org/10.2478/jos-2022-0036","url":null,"abstract":"Abstract The earning inequality in India has unfavorably obstructed underprivileged in accessing elementary needs like health and education. Periodic labour force survey conducted by National Statistical Office of India generates estimates on earning status at national and state level for both rural and urban sectors separately. However, due to small sample size problem, these surveys cannot generate reliable estimates at micro-level viz. district or block. Thus, owing to unavailability of district-level estimates, analysis of earning inequality is restricted to the national and the state level. Therefore, the existing variability in disaggregate-level earning distribution often goes unnoticed. This article describes multivariate small area estimation method to generate precise and representative district-wise estimate of earning distribution in rural and urban areas of the Indian State of Bihar by linking Periodic labour force survey data of 2018–2019 and 2011 Population Census data of India. These disaggregate-level estimates and spatial mapping of earning distribution are essential for measuring and monitoring the goal of reduced inequalities related to the sustainable development of 2030 agenda. They expected to offer insightful information to decision-makers and policy experts for identifying the areas demanding more attention.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"823 - 845"},"PeriodicalIF":1.1,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47252025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Variable inclusion strategies through directed acyclic graphs to adjust health surveys subject to selection bias for producing national estimates. 变量包含策略通过有向无环图调整健康调查受选择偏差产生的国家估计。

IF 1.1 4区数学

Journal of Official Statistics Pub Date : 2022-09-01 DOI: 10.2478/jos-2022-0038

Yan Li, Katherine E Irimata, Yulei He, Jennifer Parker

{"title":"Variable inclusion strategies through directed acyclic graphs to adjust health surveys subject to selection bias for producing national estimates.","authors":"Yan Li, Katherine E Irimata, Yulei He, Jennifer Parker","doi":"10.2478/jos-2022-0038","DOIUrl":"https://doi.org/10.2478/jos-2022-0038","url":null,"abstract":"Along with the rapid emergence of web surveys to address time-sensitive priority topics, various propensity score (PS)-based adjustment methods have been developed to improve population representativeness for nonprobability- or probability-sampled web surveys subject to selection bias. Conventional PS-based methods construct pseudo-weights for web samples using a higher-quality reference probability sample. The bias reduction, however, depends on the outcome and variables collected in both web and reference samples. A central issue is identifying variables for inclusion in PS-adjustment. In this paper, directed acyclic graph (DAG), a common graphical tool for causal studies but largely under-utilized in survey research, is used to examine and elucidate how different types of variables in the causal pathways impact the performance of PS-adjustment. While past literature generally recommends including all variables, our research demonstrates that only certain types of variables are needed in PS-adjustment. Our research is illustrated by NCHS' Research and Development Survey, a probability-sampled web survey with potential selection bias, PS-adjusted to the National Health Interview Survey, to estimate U.S. asthma prevalence. Findings in this paper can be used by National Statistics Offices to design questionnaires with variables that improve web-samples' population representativeness and to release more timely and accurate estimates for priority topics.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 3","pages":"875-900"},"PeriodicalIF":1.1,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9490791/pdf/nihms-1807439.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10132956","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

Construction of Databases for Small Area Estimation 小面积估算数据库的构建

IF 1.1 4区数学

Journal of Official Statistics Pub Date : 2022-09-01 DOI: 10.2478/jos-2022-0031

Emily J. Berg

{"title":"Construction of Databases for Small Area Estimation","authors":"Emily J. Berg","doi":"10.2478/jos-2022-0031","DOIUrl":"https://doi.org/10.2478/jos-2022-0031","url":null,"abstract":"Abstract The demand for small area estimates can conflict with the objective of producing a multi-purpose data set. We use donor imputation to construct a database that supports small area estimation. Appropriately weighted sums of observed and imputed values produce model-based small area estimates. We develop imputation procedures for both unit-level and area-level models. For area-level models, we restrict to linear models. We assume a single vector of covariates is used for a possibly multivariate response. Each record in the imputed data set has complete data, an estimation weight, and a set of replicate weights for mean square error (MSE) estimation. We compare imputation procedures based on area-level models to those based on unit-level models through simulation. We apply the methods to the Iowa Seat-Belt Use Survey, a survey designed to produce state-level estimates of the proportions of vehicle occupants who wear a seat-belt. We develop a bivariate unit-level model for prediction of county-level proportions of belted drivers and total occupants. We impute values for the proportions of belted drivers and vehicle occupants onto the full population of road segments in the sampling frame. The resulting imputed data set returns approximations for the county-level predictors based on the bivariate model.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":"38 1","pages":"673 - 708"},"PeriodicalIF":1.1,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45891496","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Timely Estimates of the Monthly Mexican Economic Activity 墨西哥每月经济活动的及时估计

IF 1.1 4区数学

Journal of Official Statistics Pub Date : 2022-09-01 DOI: 10.2478/jos-2022-0033

F. Corona, G. González-Farías, J. López-Pérez

引用次数: 0