Journal of Survey Statistics and Methodology最新文献_第10页

Lack of Replication or Generalization? Cultural Values Explain a Question Wording Effect 缺乏复制还是泛化?文化价值观解释问题措辞效应

IF 2.1 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2021-08-20 DOI: 10.1093/jssam/smab007

Henning Silber, E. Tvinnereim, T. Stark, A. Blom, J. Krosnick, M. Bošnjak, S. Clement, Anne Cornilleau, Anne-Sophie Cousteaux, M. John, G. Jónsdóttir, K. Lawson, Peter Lynn, Johan Martinsson, Ditte Shamshiri-Petersen, Su-Hao Tu

{"title":"Lack of Replication or Generalization? Cultural Values Explain a Question Wording Effect","authors":"Henning Silber, E. Tvinnereim, T. Stark, A. Blom, J. Krosnick, M. Bošnjak, S. Clement, Anne Cornilleau, Anne-Sophie Cousteaux, M. John, G. Jónsdóttir, K. Lawson, Peter Lynn, Johan Martinsson, Ditte Shamshiri-Petersen, Su-Hao Tu","doi":"10.1093/jssam/smab007","DOIUrl":"https://doi.org/10.1093/jssam/smab007","url":null,"abstract":"\u0000 In the context of the current “replication crisis” across the sciences, failures to reproduce a finding are often viewed as discrediting it. This paper shows how such a conclusion can be incorrect. In 1981, Schuman and Presser showed that including the word “freedom” in a survey question significantly increased approval of allowing a speech against religion in the USA. New experiments in probability sample surveys (n = 23,370) in the USA and 10 other countries showed that the wording effect replicated in the USA and appeared in four other countries (Canada, Germany, Taiwan, and the Netherlands) but not in the remaining countries. The effect appeared only in countries in which the value of freedom is especially salient and endorsed. Thus, public support for a proposition was enhanced by portraying it as embodying a salient principle of a nation’s culture. Instead of questioning initial findings, inconsistent results across countries signal limits on generalizability and identify an important moderator.","PeriodicalId":17146,"journal":{"name":"Journal of Survey Statistics and Methodology","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2021-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45204446","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

An Experimental Comparison of Three Strategies for Converting Mail Respondents in a Probability-Based Mixed-Mode Panel to Internet Respondents 基于概率的混合模式面板中邮件回答者转换为互联网回答者三种策略的实验比较

IF 2.1 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2021-08-17 DOI: 10.1093/jssam/smab002

David Bretschi, Ines Schaurer, D. Dillman

{"title":"An Experimental Comparison of Three Strategies for Converting Mail Respondents in a Probability-Based Mixed-Mode Panel to Internet Respondents","authors":"David Bretschi, Ines Schaurer, D. Dillman","doi":"10.1093/jssam/smab002","DOIUrl":"https://doi.org/10.1093/jssam/smab002","url":null,"abstract":"\u0000 In recent years, web-push strategies have been developed in cross-sectional mixed-mode surveys to improve response rates and reduce the costs of data collection. However, pushing respondents into the more cost-efficient web mode has rarely been examined in the context of panel surveys. This study evaluates how a web-push intervention affects the willingness of panel members to switch survey modes from mail to web. We tested three web-push strategies in a German probability-based mixed-mode panel by randomly assigning 1,895 panelists of the mail mode to one of three conditions: (1) the web option was offered to panelists concurrently with the paper questionnaire including a promised €10 incentive for completing the survey on the web, (2) the web option was presented sequentially two weeks before sending the paper questionnaire and respondents were also promised an incentive of €10, or (3) same sequential web-first approach as for condition 2, but with a prepaid €10 incentive instead of a promised incentive. The study found that a sequential presentation of the web option significantly increases the web response in a single survey but may not motivate more panelists to switch to the web mode permanently. Contrary to our expectation, offering prepaid incentives neither improves the web response nor the proportion of mode switchers. Overall, all three web-push strategies show the potential to effectively reduce survey costs without causing differences in panel attrition after five consecutive waves. Condition 2, the sequential web-first design combined with a promised incentive was most effective in pushing respondents to switch to the web mode and in reducing costs.","PeriodicalId":17146,"journal":{"name":"Journal of Survey Statistics and Methodology","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2021-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44504804","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

Capture–Recapture Estimation of Characteristics of U.S. Local Food Farms Using a Web-Scraped List Frame 使用网络列表框架对美国当地食品农场特征进行捕获-再捕获评估

IF 2.1 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2021-08-16 DOI: 10.1093/jssam/smab008

Michael Hyman, L. Sartore, L. Young

{"title":"Capture–Recapture Estimation of Characteristics of U.S. Local Food Farms Using a Web-Scraped List Frame","authors":"Michael Hyman, L. Sartore, L. Young","doi":"10.1093/jssam/smab008","DOIUrl":"https://doi.org/10.1093/jssam/smab008","url":null,"abstract":"\u0000 The emerging sectors of agriculture, such as organics, urban, and local food, tend to be dominated by farms that are smaller, more transient, more diverse, and more dispersed than the traditional farms in the rural areas of the United States. As a consequence, a list frame of all farms within one of these sectors is difficult to construct and, even with the best of efforts, is incomplete. The United States Department of Agriculture’s (USDA’s) National Agricultural Statistics Service (NASS) maintains a list frame of all known and potential U.S. farms and uses this list frame as the sampling frame for most of its surveys. Traditionally, NASS has used its area frame to assess undercoverage. However, getting a good measure of the incompleteness of the NASS list frame using an area frame is cost prohibitive for farms in these emerging sectors that tend to be located within and near urban areas. In 2016, NASS conducted the Local Food Marketing Practices (LFMP) survey. Independent samples were drawn from (1) the NASS list frame and (2) a web-scraped list of local food farms. Using these two samples and capture–recapture methods, the total number and sales of local food operations at the United States, regional, and state levels were estimated. To our knowledge, the LFMP survey is the first survey in which a web-scraped list frame has been used to assess undercoverage in a capture–recapture setting to produce official statistics. In this article, the methods are presented, and the challenges encountered are reviewed. Best practices and open research questions for conducting surveys using web-scraped list frames and capture–recapture methods are discussed.","PeriodicalId":17146,"journal":{"name":"Journal of Survey Statistics and Methodology","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2021-08-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46183458","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

Bootstrap Estimation of the Conditional Bias for Measuring Influence in Complex Surveys 复杂调查中测量影响的条件偏差的Bootstrap估计

IF 2.1 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2021-08-16 DOI: 10.1093/jssam/smab029

J. Beaumont, Cynthia Bocci, Michel St-Louis

{"title":"Bootstrap Estimation of the Conditional Bias for Measuring Influence in Complex Surveys","authors":"J. Beaumont, Cynthia Bocci, Michel St-Louis","doi":"10.1093/jssam/smab029","DOIUrl":"https://doi.org/10.1093/jssam/smab029","url":null,"abstract":"\u0000 In sample surveys that collect information on skewed variables, it is often desirable to assess the influence of sample units on the sampling error of survey-weighted estimators of finite population parameters. The conditional bias is an attractive measure of influence that accounts for the sampling design and the estimation method. It is defined as the design expectation of the sampling error conditional on a given unit being selected in the sample. The estimation of the conditional bias is relatively straightforward for simple sampling designs and estimators. However, for complex designs or complex estimators, it may be tedious to derive an explicit expression for the conditional bias. In those complex surveys, variance estimation is often achieved through replication methods such as the bootstrap. Bootstrap methods of variance estimation are typically implemented by producing a set of bootstrap weights that is provided to users along with the survey data. In this article, we show how to use these bootstrap weights to obtain an estimator of the conditional bias. Our bootstrap estimator is evaluated in a simulation study and illustrated using data from the Canadian Survey of Household Spending.","PeriodicalId":17146,"journal":{"name":"Journal of Survey Statistics and Methodology","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2021-08-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46294511","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Rank-Based Inference for Survey Sampling Data 基于秩的调查抽样数据推理

IF 2.1 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2021-08-09 DOI: 10.1093/jssam/smab019

A. Adekpedjou, H. Bindele

引用次数: 0

A Model-Assisted Approach for Finding Coding Errors in Manual Coding of Open-Ended Questions 开放式问题手工编码中编码错误的模型辅助发现方法

IF 2.1 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2021-08-03 DOI: 10.1093/jssam/smab022

Zhoushanyue He, Matthias Schonlau

引用次数: 4

DETERMINED BY MODE? REPRESENTATION AND MEASUREMENT EFFECTS IN A DUAL-MODE STATEWIDE SURVEY 由模式决定?双模全州调查的表征与测量效应

IF 2.1 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2021-06-18 DOI: 10.1093/jssam/smab012

Enrijeta Shino, Michael D. Martinez, Michael Binder

引用次数: 4

QUESTIONNAIRE COMPLEXITY, REST PERIOD, AND RESPONSE LIKELIHOOD IN ESTABLISHMENT SURVEYS 企业调查问卷的复杂性、休息时间与回应可能性

IF 2.1 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2021-06-15 DOI: 10.1093/JSSAM/SMAB017

J. Rodhouse, T. Wilson, Heather E Ridolfo

{"title":"QUESTIONNAIRE COMPLEXITY, REST PERIOD, AND RESPONSE LIKELIHOOD IN ESTABLISHMENT SURVEYS","authors":"J. Rodhouse, T. Wilson, Heather E Ridolfo","doi":"10.1093/JSSAM/SMAB017","DOIUrl":"https://doi.org/10.1093/JSSAM/SMAB017","url":null,"abstract":"\u0000 Response burden has been a concern in survey research for some time. One area of concern is the negative impact that response burden can have on response rates. In an effort to mitigate negative impacts on response rates, survey research organizations try to minimize the burden respondents are exposed to and maximize the likelihood of response. Many organizations also try to be mindful of the role burden may play in respondents’ likelihood to participate in future surveys by implementing rest periods or survey holidays. Recently, new evidence from a study of cross-sectional household surveys provided an interesting lens to examine burden. The evidence demonstrated that those sampled in two independent surveys are more likely to respond to the second survey if the first survey was more difficult to complete, and that this effect was not significantly influenced by the rest period in between the two surveys. These findings are compelling, and since the mechanisms influencing response in household and establishment surveys differ in important ways, a similar examination in an establishment survey context is warranted. To accomplish this, data are used from the National Agricultural Statistics Service. Overall, our research finds that prior survey features such as questionnaire complexity (or burden), prior response disposition and rest period are significantly associated with response to subsequent surveys. We also find that sample units first receiving a more complex questionnaire have significantly higher probabilities of response to a subsequent survey than do those receiving a simpler questionnaire first. The findings in this paper have implications for nonresponse adjustments and identification of subgroups for adaptive design data collection.","PeriodicalId":17146,"journal":{"name":"Journal of Survey Statistics and Methodology","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2021-06-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41839493","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

PERCEIVED BURDEN, FOCUS OF ATTENTION, AND THE URGE TO JUSTIFY: THE IMPACT OF THE NUMBER OF SCREENS AND PROBE ORDER ON THE RESPONSE BEHAVIOR OF PROBING QUESTIONS 感知负担、注意焦点和证明的冲动:屏幕数量和探究顺序对探究性问题反应行为的影响

IF 2.1 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2021-06-12 DOI: 10.1093/JSSAM/SMAA043

Katharina Meitinger, A. Toroslu, Klara Raiber, Michael Braun

{"title":"PERCEIVED BURDEN, FOCUS OF ATTENTION, AND THE URGE TO JUSTIFY: THE IMPACT OF THE NUMBER OF SCREENS AND PROBE ORDER ON THE RESPONSE BEHAVIOR OF PROBING QUESTIONS","authors":"Katharina Meitinger, A. Toroslu, Klara Raiber, Michael Braun","doi":"10.1093/JSSAM/SMAA043","DOIUrl":"https://doi.org/10.1093/JSSAM/SMAA043","url":null,"abstract":"\u0000 Web probing is a valuable tool to assess the validity and comparability of survey items. It uses different probe types—such as category-selection probes and specific probes—to inquire about different aspects of an item. Previous web probing studies often asked one probe type per item, but research situations exist where it might be preferable to test potentially problematic items with multiple probes. However, the response behavior might be affected by two factors: question order and the visual presentation of probes on one screen versus multiple screens as well as their interaction. In this study, we report evidence from a web experiment that was conducted with 532 respondents from Germany in September 2013. Experimental groups varied by screen number (1 versus 2) and probe order (category-selection probe first versus specific probe first). We assessed the impact of these manipulations on several indicators of response quality, probe answer content, and the respondents’ motivation with logistic regressions and two-way ANOVAs. We reveal that multiple mechanisms push response behavior in this context: perceived response burden, the focus of attention, the need for justification, and verbal context effects. We find that response behavior in the condition with two screens and category-selection probe first outperforms all other experimental conditions. We recommend this implementation in all but one scenario: if the goal is to test an item that includes a key term with a potentially too large lexical scope, we recommend starting with a specific probe but on the same screen as the category-selection probe.","PeriodicalId":17146,"journal":{"name":"Journal of Survey Statistics and Methodology","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2021-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45424242","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

A DYNAMIC SURVIVAL MODELING APPROACH TO THE PREDICTION OF WEB SURVEY BREAKOFF 网络调查断裂预测的动态生存建模方法

IF 2.1 4区数学

Journal of Survey Statistics and Methodology Pub Date : 2021-06-12 DOI: 10.1093/JSSAM/SMAB015

Felicitas Mittereder, B. West

引用次数: 7