Survey practice最新文献_第10页

Impacts of Implementing an Automatic Advancement Feature in Mobile and Web Surveys 在移动和Web调查中实现自动升级功能的影响

Survey practice Pub Date : 2019-02-25 DOI: 10.29115/SP-2018-0034

S. Giroux, K. Tharp, Derek C. Wietelman

{"title":"Impacts of Implementing an Automatic Advancement Feature in Mobile and Web Surveys","authors":"S. Giroux, K. Tharp, Derek C. Wietelman","doi":"10.29115/SP-2018-0034","DOIUrl":"https://doi.org/10.29115/SP-2018-0034","url":null,"abstract":"As more surveys are administered online and taken on mobile devices, researchers need to continue to work toward defining best practices. A relatively new technical feature is an automatic advancement feature, which automatically scrolls the screen to the next item on a page of a survey instrument once a respondent selects an answer to the current question. This and other related forms of automatic advancement methods, such as the horizontal scrolling matrix, have so far produced mixed effects in terms of their impact on data quality, break off rates, and other survey measures. We present findings from an experiment conducted in 2017 using a survey of law school students in which we randomly assigned an automatic advancement feature to half of the respondents in a sample of nearly 40,000 students in the United States and Canada. We do not find significant differences in survey duration time, straight-lining, breakoff rates, or item nonresponse (for mobile users) between the two experimental groups, but desktop users without the automatic advancement feature had higher item nonresponse. More significantly, we find that respondents receiving the automatic advancement treatment on average changed about 50% fewer answers across the survey instrument than those who did not receive the automatic advancement design. We incorporate qualitative data to help us understand why this might have happened. Finally, respondents rated the automatic advancement feature as being easier to use and having a better visual design. This research extends the limited amount of work on automatic advancement features for surveys, helps move the field closer to best practices for survey design for mobile devices, and provides context and understanding about a particular respondent behavior related to data quality.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-02-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46894353","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Two-Year Follow-up of a Sequential Mixed-Mode Experiment in the U.S. National Monitoring the Future Study. 美国国家监测未来研究中连续混合模式实验的两年随访。

Survey practice Pub Date : 2019-01-01 Epub Date: 2019-06-24 DOI: 10.29115/SP-2019-0003

Megan E Patrick, Mick P Couper, Bohyun Joy Jang, Virginia Laetz, John E Schulenberg, Lloyd D Johnston, Jerald Bachman, Patrick M O'Malley

{"title":"Two-Year Follow-up of a Sequential Mixed-Mode Experiment in the U.S. National Monitoring the Future Study.","authors":"Megan E Patrick, Mick P Couper, Bohyun Joy Jang, Virginia Laetz, John E Schulenberg, Lloyd D Johnston, Jerald Bachman, Patrick M O'Malley","doi":"10.29115/SP-2019-0003","DOIUrl":"https://doi.org/10.29115/SP-2019-0003","url":null,"abstract":"This study examines the two-year follow up (data collected in 2016 at modal age 21/22) of an original mixed-mode longitudinal survey experiment (data collected at modal age 19/20 in 2014). The study compares participant retention in the experimental conditions to retention in the standard Monitoring the Future (MTF) control condition (participants who completed an in-school baseline survey in 12th grade in 2012 or 2013 and were selected to participate in the first follow-up survey by mail in 2014, N=2,451). A supplementary sample who completed the 12th grade baseline survey in 2012 or 2013 but were not selected to participate in the main MTF follow-up (N=4,950) were recruited and randomly assigned to one of three experimental conditions: 1: Mail Push, 2: Web Push, 3: Web Push + Email in 2014 and again in 2016. Results from the first experiment indicated that Condition 3 (Web Push + Email) was promising based on similar response rates and lower costs (Patrick et al. 2018). The current study examines how experimental condition and type of 2014 response were associated with response in 2016, the extent to which response mode and device type changed from 2014 to 2016, and cumulative cost comparisons across conditions. Results indicated that responding via web in 2014 was associated with greater odds of participation again in 2016 regardless of condition; respondents tended to respond in the same mode although the \"push\" condition did move respondents toward web over paper; device type varied between waves; and the cumulative cost savings of Web Push + Email grew larger compared to the MTF Control. The web push strategy is therefore promising for maintaining respondent engagement while reducing cost.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"12 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6924618/pdf/nihms-1060109.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"37483060","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

Sample and Respondent Provided County Comparisons Among Cellular Respondents Using Rate Center Assignments. 使用费率中心分配的手机受访者中的样本和受访者提供的县比较。

Survey practice Pub Date : 2019-01-01 Epub Date: 2019-07-01 DOI: 10.29115/sp-2019-0004

Carol Pierannunzi, Ashley Hyon, Jeff Bareham, Machell Town

{"title":"Sample and Respondent Provided County Comparisons Among Cellular Respondents Using Rate Center Assignments.","authors":"Carol Pierannunzi, Ashley Hyon, Jeff Bareham, Machell Town","doi":"10.29115/sp-2019-0004","DOIUrl":"10.29115/sp-2019-0004","url":null,"abstract":"The percentage of cell phones in telephone survey samples continues to grow in proportion to the percentage of potential respondents who rely on cell phones for personal communication. One problem with cell phone samples is that persons who move or who purchase cell phones in locations not close to their residence, may not be eligible for surveys with geographic parameters. This affects researchers' ability to sample and analyze from specific geographic jurisdictions. Because cell phone numbers do not accurately indicate respondent locations, rate centers have been used to ascertain respondent locations in recent years. The Behavioral Risk Factor Surveillance System (BRFSS) is a state-based telephone survey administered to over 400,000 respondents annually. Approximately half of the sample is drawn from cell phone numbers. This research examines the county-level accuracy of the 2016 BRFSS sample. Results indicate that cell phone samples are accurate at the state and county level 58% of the time and at just the state level 93% of the time. However, accuracy rates vary by state, region, metropolitan status as well as by demographic characteristics and survey items. Specific examples of when county-level accuracy vary are provided.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"12 1","pages":"1-8"},"PeriodicalIF":0.0,"publicationDate":"2019-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8040621/pdf/nihms-1680309.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"25589237","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Probability-Based Samples on Twitter: Methodology and Application 基于概率的Twitter样本:方法和应用

Survey practice Pub Date : 2018-12-09 DOI: 10.29115/SP-2018-0033

M. Berzofsky, Tasseli E. McKay, Y. Hsieh, A. C. Smith

引用次数: 6

Within-Household Selection and Dual-Frame Telephone Surveys: A Comparative Experiment of Eleven Different Selection Methods 户内选择与双框架电话调查:十一种不同选择方法的比较实验

Survey practice Pub Date : 2018-11-12 DOI: 10.29115/SP-2018-0031

Jenny Marlar, M. Chattopadhyay, Jeff Jones, Stephanie Marken, F. Kreuter

{"title":"Within-Household Selection and Dual-Frame Telephone Surveys: A Comparative Experiment of Eleven Different Selection Methods","authors":"Jenny Marlar, M. Chattopadhyay, Jeff Jones, Stephanie Marken, F. Kreuter","doi":"10.29115/SP-2018-0031","DOIUrl":"https://doi.org/10.29115/SP-2018-0031","url":null,"abstract":"Numerous within-household selection methods have been tested in general population surveys since the advent of telephone interviewing. However, very few selection studies, if any, have been conducted with a dual frame (landline and cell phone) sample. Landline and cell phone frames are known to represent demographically different groups of respondents, and selection methods that may result in more representative demographics in a landline frame may actually skew the results when combined with the cell phone frame. This study tested 11 different within-household selection methods with approximately 11,000 landline respondents. A parallel cell phone sample was also collected with 1,000 respondents, and the frames were combined for analysis. The selection methods tested included one probability-based method, four quasi-probability methods and six nonprobability methods. The methods were evaluated on four criteria: response rates, accuracy, demographic representation and substantive results. The demographic representativeness of each method was examined for the landline frame only and for the dual (landline and cell phone) frame combination. The probability method had the lowest response rate, while the nonprobability at-home methods had the highest. Accuracy rates were lowest for the quasi-probability birthday methods. There were few demographic differences between selection methods, and no substantive differences, when combined with the cell phone sample.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2018-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44859594","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Comparing Response Rates, Costs, and Tobacco-Related Outcomes Across Phone, Mail, and Online Surveys 比较电话、邮件和在线调查的回复率、成本和烟草相关结果

Survey practice Pub Date : 2018-10-28 DOI: 10.29115/SP-2018-0029

Elizabeth M. Brown, Lindsay T Olson, M. Farrelly, J. Nonnemaker, H. Battles, J. Hampton

{"title":"Comparing Response Rates, Costs, and Tobacco-Related Outcomes Across Phone, Mail, and Online Surveys","authors":"Elizabeth M. Brown, Lindsay T Olson, M. Farrelly, J. Nonnemaker, H. Battles, J. Hampton","doi":"10.29115/SP-2018-0029","DOIUrl":"https://doi.org/10.29115/SP-2018-0029","url":null,"abstract":"Tobacco control evaluation relies on surveillance documenting attitudes and behaviors. Practitioners and evaluators seek the most efficient, high-quality surveillance methodology. This paper explores the feasibility of mail and online survey data collection protocols using address-based sampling (ABS) to complement landline and cell phone surveys as part of a comprehensive tobacco control program evaluation. We used a comparative study of response rates, costs, and key outcomes across phone, mail, and online survey protocols. In 2015, we supplemented the phone-administered NY Adult Tobacco Survey with an ABS for paper and online data collection. For each survey protocol, we calculated response rates; compared unweighted demographic characteristics; and compared weighted outcome data for smoking prevalence, quit attempts, and tobacco control policy support. We assessed relative cost-per-complete per protocol. Response rates were highest for paper surveys (38.9%), followed by online (28.6%), landline (22.2%), and cell phone (14.7%) surveys. Respondent demographics differed across protocols; landline, mail, and online respondents were more likely than cell phone respondents to be older, female, white, and higher educated. Smoking prevalence varied by protocol, but quit attempts and tobacco control policy support were similar across protocols. Cost-per-complete estimates were lowest for paper surveys. Programs rely on efficient and representative methodologies, and paper and online surveys with ABS show promise for supplementing phone surveillance to improve response rates and lower costs per completed survey.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2018-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43951794","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

Taking Another Look at Counterarguments: When do Survey Respondents Switch their Answers? 重新审视反驳：调查对象何时转换答案？

Survey practice Pub Date : 2018-10-22 DOI: 10.29115/SP-2018-0027

T. Marshall

引用次数: 0

Ask the Expert: Polling the 2018 Elections 问专家：2018年大选投票

Survey practice Pub Date : 2018-10-15 DOI: 10.29115/SP-2018-0032

S. Keeter

引用次数: 0

Protecting Human Subjects in the Digital Age: Issues and Best Practices of Data Protection 数字时代保护人类主体：数据保护的问题和最佳实践

Survey practice Pub Date : 2018-09-24 DOI: 10.29115/SP-2018-0028

T. Jamieson, Güez Salinas