Journal of Survey Statistics and Methodology最新文献_第7页

Empirical Best Prediction of Small Area Means Based on a Unit-Level Gamma-Poisson Model 基于单位水平Gamma-Pisson模型的小区域均值经验最佳预测

IF 2.1 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2022-10-07 DOI: 10.1093/jssam/smac026

Emily J. Berg

引用次数: 0

Automated Classification for Open-Ended Questions with BERT 用BERT实现开放式问题的自动分类

IF 2.1 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2022-09-13 DOI: 10.1093/jssam/smad015

Hyukjun Gweon, Matthias Schonlau

{"title":"Automated Classification for Open-Ended Questions with BERT","authors":"Hyukjun Gweon, Matthias Schonlau","doi":"10.1093/jssam/smad015","DOIUrl":"https://doi.org/10.1093/jssam/smad015","url":null,"abstract":"\u0000 Manual coding of text data from open-ended questions into different categories is time consuming and expensive. Automated coding uses statistical/machine learning to train on a small subset of manually-coded text answers. Recently, pretraining a general language model on vast amounts of unrelated data and then adapting the model to the specific application has proven effective in natural language processing. Using two data sets, we empirically investigate whether BERT, the currently dominant pretrained language model, is more effective at automated coding of answers to open-ended questions than other non-pretrained statistical learning approaches. We found fine-tuning the pretrained BERT parameters is essential as otherwise BERT is not competitive. Second, we found fine-tuned BERT barely beats the non-pretrained statistical learning approaches in terms of classification accuracy when trained on 100 manually coded observations. However, BERT’s relative advantage increases rapidly when more manually coded observations (e.g., 200–400) are available for training. We conclude that for automatically coding answers to open-ended questions BERT is preferable to non-pretrained models such as support vector machines and boosting.","PeriodicalId":17146,"journal":{"name":"Journal of Survey Statistics and Methodology","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2022-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46968013","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

Modeling Group-Specific Interviewer Effects on Survey Participation Using Separate Coding for Random Slopes in Multilevel Models 基于分层随机斜率独立编码的访谈者群体调查参与效应建模

IF 2.1 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2022-09-02 DOI: 10.1093/jssam/smac025

J. Herzing, A. Blom, B. Meuleman

引用次数: 0

An Experimental Evaluation of Two Approaches for Improving Response to Household Screening Efforts in National Mail/Web Surveys. 在全国邮寄/网络调查中，对提高家庭筛查工作响应度的两种方法进行实验性评估。

IF 1.9 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2022-07-12 eCollection Date: 2023-02-01 DOI: 10.1093/jssam/smac024

James Wagner, Brady T West, Mick P Couper, Shiyu Zhang, Rebecca Gatward, Raphael Nishimura, Htay-Wah Saw

{"title":"An Experimental Evaluation of Two Approaches for Improving Response to Household Screening Efforts in National Mail/Web Surveys.","authors":"James Wagner, Brady T West, Mick P Couper, Shiyu Zhang, Rebecca Gatward, Raphael Nishimura, Htay-Wah Saw","doi":"10.1093/jssam/smac024","DOIUrl":"10.1093/jssam/smac024","url":null,"abstract":"Survey researchers have carefully modified their data collection operations for various reasons, including the rising costs of data collection and the ongoing Coronavirus disease (COVID-19) pandemic, both of which have made in-person interviewing difficult. For large national surveys that require household (HH) screening to determine survey eligibility, cost-efficient screening methods that do not include in-person visits need additional evaluation and testing. A new study, known as the American Family Health Study (AFHS), recently initiated data collection with a national probability sample, using a sequential mixed-mode mail/web protocol for push-to-web US HH screening (targeting persons aged 18-49 years). To better understand optimal approaches for this type of national screening effort, we embedded two randomized experiments in the AFHS data collection. The first tested the use of bilingual respondent materials where mailed invitations to the screener were sent in both English and Spanish to 50 percent of addresses with a high predicted likelihood of having a Spanish speaker and 10 percent of all other addresses. We found that the bilingual approach did not increase the response rate of high-likelihood Spanish-speaking addresses, but consistent with prior work, it increased the proportion of eligible Hispanic respondents identified among completed screeners, especially among addresses predicted to have a high likelihood of having Spanish speakers. The second tested a form of nonresponse follow-up, where a subsample of active sampled HHs that had not yet responded to the screening invitations was sent a priority mailing with a $5 incentive, adding to the $2 incentive provided for all sampled HHs in the initial screening invitation. We found this approach to be quite valuable for increasing the screening survey response rate.","PeriodicalId":17146,"journal":{"name":"Journal of Survey Statistics and Methodology","volume":"11 1","pages":"124-140"},"PeriodicalIF":1.9,"publicationDate":"2022-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9875245/pdf/smac024.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9169546","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A SEMIPARAMETRIC MULTIPLE IMPUTATION APPROACH TO FULLY SYNTHETIC DATA FOR COMPLEX SURVEYS. 针对复杂调查的全合成数据的半参数多重估算方法。

IF 2.1 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2022-06-01 Epub Date: 2022-05-25 DOI: 10.1093/jssam/smac016

Mandi Yu, Yulei He, Trivellore E Raghunathan

{"title":"A SEMIPARAMETRIC MULTIPLE IMPUTATION APPROACH TO FULLY SYNTHETIC DATA FOR COMPLEX SURVEYS.","authors":"Mandi Yu, Yulei He, Trivellore E Raghunathan","doi":"10.1093/jssam/smac016","DOIUrl":"10.1093/jssam/smac016","url":null,"abstract":"Data synthesis is an effective statistical approach for reducing data disclosure risk. Generating fully synthetic data might minimize such risk, but its modeling and application can be difficult for data from large, complex surveys. This article extended the two-stage imputation to simultaneously impute item missing values and generate fully synthetic data. A new combining rule for making inferences using data generated in this manner was developed. Two semiparametric missing data imputation models were adapted to generate fully synthetic data for skewed continuous variable and sparse binary variable, respectively. The proposed approach was evaluated using simulated data and real longitudinal data from the Health and Retirement Study. The proposed approach was also compared with two existing synthesis approaches: (1) parametric regressions models as implemented in IVEware; and (2) nonparametric Classification and Regression Trees as implemented in synthpop package for R using real data. The results show that high data utility is maintained for a wide variety of descriptive and model-based statistics using the proposed strategy. The proposed strategy also performs better than existing methods for sophisticated analyses such as factor analysis.","PeriodicalId":17146,"journal":{"name":"Journal of Survey Statistics and Methodology","volume":"1 1","pages":"618-641"},"PeriodicalIF":2.1,"publicationDate":"2022-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11044899/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"61006847","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

INTERVIEWER EFFECTS IN LIVE VIDEO AND PRERECORDED VIDEO INTERVIEWING. 面试官在现场视频和预先录制的视频面试中的效果。

IF 1.9 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2022-04-01 Epub Date: 2021-12-03 DOI: 10.1093/jssam/smab040

Brady T West, Ai Rene Ong, Frederick G Conrad, Michael F Schober, Kallan M Larsen, Andrew L Hupp

{"title":"INTERVIEWER EFFECTS IN LIVE VIDEO AND PRERECORDED VIDEO INTERVIEWING.","authors":"Brady T West, Ai Rene Ong, Frederick G Conrad, Michael F Schober, Kallan M Larsen, Andrew L Hupp","doi":"10.1093/jssam/smab040","DOIUrl":"10.1093/jssam/smab040","url":null,"abstract":"Live video (LV) communication tools (e.g., Zoom) have the potential to provide survey researchers with many of the benefits of in-person interviewing, while also greatly reducing data collection costs, given that interviewers do not need to travel and make in-person visits to sampled households. The COVID-19 pandemic has exposed the vulnerability of in-person data collection to public health crises, forcing survey researchers to explore remote data collection modes-such as LV interviewing-that seem likely to yield high-quality data without in-person interaction. Given the potential benefits of these technologies, the operational and methodological aspects of video interviewing have started to receive research attention from survey methodologists. Although it is remote, video interviewing still involves respondent-interviewer interaction that introduces the possibility of interviewer effects. No research to date has evaluated this potential threat to the quality of the data collected in video interviews. This research note presents an evaluation of interviewer effects in a recent experimental study of alternative approaches to video interviewing including both LV interviewing and the use of prerecorded videos of the same interviewers asking questions embedded in a web survey (\"prerecorded video\" interviewing). We find little evidence of significant interviewer effects when using these two approaches, which is a promising result. We also find that when interviewer effects were present, they tended to be slightly larger in the LV approach as would be expected in light of its being an interactive approach. We conclude with a discussion of the implications of these findings for future research using video interviewing.","PeriodicalId":17146,"journal":{"name":"Journal of Survey Statistics and Methodology","volume":"10 2","pages":"317-336"},"PeriodicalIF":1.9,"publicationDate":"2022-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8690284/pdf/smab040.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9793318","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

On The Robustness Of Respondent-Driven Sampling Estimators To Measurement Error. 调查对象驱动抽样估计器对测量误差的鲁棒性研究。

IF 2.1 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2022-04-01 DOI: 10.1093/jssam/smab056

Ian E Fellows

引用次数: 2

On The Robustness Of Respondent-Driven Sampling Estimators To Measurement Error. 论被调查者驱动的抽样估计对测量误差的稳健性。

IF 2.1 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2022-03-11 DOI: 10.1093/jssam/smac004

Ian E. Fellows

引用次数: 2

Panel Conditioning in a German Probability-Based Longitudinal Study: A Comparison of Respondents with Different Levels of Survey Experience 德国基于概率的纵向研究中的面板调节:不同调查经验水平的受访者的比较

IF 2.1 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2022-02-22 DOI: 10.31235/osf.io/vd5xp

Fabienne Kraemer, Henning Silber, Bella Struminskaya, M. Bošnjak, J. Kossmann, Bernd Weiss

{"title":"Panel Conditioning in a German Probability-Based Longitudinal Study: A Comparison of Respondents with Different Levels of Survey Experience","authors":"Fabienne Kraemer, Henning Silber, Bella Struminskaya, M. Bošnjak, J. Kossmann, Bernd Weiss","doi":"10.31235/osf.io/vd5xp","DOIUrl":"https://doi.org/10.31235/osf.io/vd5xp","url":null,"abstract":"Learning effects due to repeated interviewing, which are referred to as panel conditioning, are a major threat to response quality in later waves of a panel study. Up to date, research has not provided a clear picture regarding the circumstances, mechanisms, and dimensions of potential panel conditioning effects. Especially the effects of conditioning frequency, that is, different levels of experience within a panel, on response quality are underexplored. Against this background, we investigated the effects of panel conditioning by using data from the GESIS Panel, a German mixed-mode probability-based panel study. Using two refreshment samples, we compared three panel cohorts with differing levels of experience with respect to several response quality indicators related to the mechanisms of reflection, satisficing, and social desirability. Overall, we find evidence for both negative (i.e., disadvantageous for response quality) as well as positive (i.e., advantageous for response quality) panel conditioning. Highly experienced respondents were more likely to satisfice by selecting mid-point responses or by speeding through the questionnaire. They also had a higher probability of refusing to answer sensitive questions than less experienced panel members. However, more experienced respondents were also more likely to optimize the response processes by needing less time compared to panelists with lower experience levels (when controlling for speeding). In contrast, we did not find significant differences with respect to the number of “don’t know” responses, non-differentiation, the selection of first response categories, and the number of non-triggered filter questions. Of the observed differences, speeding showed the highest magnitude with an average increase of 5.9 percentage points for highly experienced panel members compared to low experienced panelists.","PeriodicalId":17146,"journal":{"name":"Journal of Survey Statistics and Methodology","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2022-02-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44830407","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Inference from Nonrandom Samples Using Bayesian Machine Learning. 使用贝叶斯机器学习从非随机样本推断。

IF 1.6 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2022-01-20 eCollection Date: 2023-04-01 DOI: 10.1093/jssam/smab049

Yutao Liu, Andrew Gelman, Qixuan Chen

引用次数: 0