Survey practicePub Date : 2021-12-16DOI: 10.29115/sp-2021-0013
Callegaro Mario
{"title":"Recent Books and Journals Articles in Public Opinion, Survey Methods, Survey Statistics, Big Data, Data Science, and User Experience Research. 2019 Update","authors":"Callegaro Mario","doi":"10.29115/sp-2021-0013","DOIUrl":"https://doi.org/10.29115/sp-2021-0013","url":null,"abstract":"Welcome to the 12th edition of this column on recent books and journal articles in the field of public opinion, survey methods, survey statistics, Big Data, data science and user experience research. After a hiatus due to the pandemic which affected my productivity, I am publishing this 2019 update, and shortly, I will publish the 2020 update. Special issues of journals have a space in this article because, in my view, they are like edited books. I also added review papers from the journal series of Annual Reviews because these papers are seminal state of the art writeups, a mini book, if you wish on a specific subject.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46490870","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2021-12-16DOI: 10.29115/sp-2021-0014
C. Ario
{"title":"Recent Books and Journals Articles in Public Opinion, Survey Methods, Survey Statistics, Big Data, Data Science, and User Experience Research. 2020 Update","authors":"C. Ario","doi":"10.29115/sp-2021-0014","DOIUrl":"https://doi.org/10.29115/sp-2021-0014","url":null,"abstract":"Welcome to the 13th edition of this column on recent books and journal articles in the field of public opinion, survey methods, survey statistics, Big Data, data science and user experience research. After a hiatus due to the pandemic which affected my productivity, I am publishing this 2020 update. Special issues of journals have a space in this article because, in my view, they are like edited books. I also added review papers from the journal series of Annual Reviews because these papers are seminal state of the art writeups, a mini book, if you wish on a specific subject.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41833970","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2021-10-28DOI: 10.29115/sp-2021-0011
Murphy Alexandra K., Gould-Werth Alix, Griffin Jamie
{"title":"Validating the Sixteen-Item Transportation Security Index in a Nationally Representative Sample: A Confirmatory Factor Analysis","authors":"Murphy Alexandra K., Gould-Werth Alix, Griffin Jamie","doi":"10.29115/sp-2021-0011","DOIUrl":"https://doi.org/10.29115/sp-2021-0011","url":null,"abstract":"Scholars, policymakers, and planners lack a single, valid measure of transportation insecurity. This has hindered the development of evidence on the relationship between transportation insecurity and poverty. To address this, in previous work, we developed a preliminary Transportation Security Index (TSI): a 16-item measure that captures the experience of transportation insecurity at the individual level, regardless of geography or mode of transit. In this paper, drawing on an original survey of a nationally representative sample (n=1,999) from GfK’s KnowledgePanel®, we use confirmatory factor analysis to replicate and validate the 16-item TSI. Our results show that a slightly modified TSI16 is an effective tool that can be used to uncover transportation insecurity across different samples. They also suggest that, counter to the results of our previous study, transportation insecurity is a unidimensional condition that is experienced both materially and relationally. Together, these findings represent a significant advancement in the study and measurement of transportation insecurity.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49012923","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2021-09-24DOI: 10.29115/sp-2021-0007
René Bautista
{"title":"Conducting the General Social Survey (GSS) during a Pandemic—Interview with René Bautista","authors":"René Bautista","doi":"10.29115/sp-2021-0007","DOIUrl":"https://doi.org/10.29115/sp-2021-0007","url":null,"abstract":"Panel data from the 2020 General Social Survey (GSS), one of most valuable social science resources in the country, were recently made available to the public. The GSS team at NORC was able to meet the challenges presented by the COVID-19 pandemic—e.g., to protect the health and safety of both the interviewers and survey participants—by adapting their data collection methods away from in-person interviews to web-based and telephone surveys. Persevering by adapting innovative methodological techniques, in 2020, NORC conducted the GSS as two studies— a panel study (reinterviewing GSS participants from 2016 and 2018) and a cross-sectional study (with a newly selected representative sample from 2020). The second survey (cross-sectional study) will be available later this year. In this edition of “Ask the Expert,” *Survey Practice* Editor, Emily Geisen, talks with Rene Bautista at NORC to learn more about the methodological changes made to the GSS during the 2020 COVID-19 pandemic.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49279282","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2021-09-09DOI: 10.29115/sp-2021-0009
D. Garbarski, K. Navarrete, D. Doherty
{"title":"Polling on police use of body cameras: The effect of response option order on distribution and concurrent validity","authors":"D. Garbarski, K. Navarrete, D. Doherty","doi":"10.29115/sp-2021-0009","DOIUrl":"https://doi.org/10.29115/sp-2021-0009","url":null,"abstract":"Debates on key features of policing are far from settled and are highly politicized. However, a majority of the public favors the use of body cameras when asked whether they favor or oppose their use. Knowing that “favoring” overall might encompass several perspectives, we sought to document how frequently the public thought police should use body cameras: all the time with no exceptions, all the time with minimal exceptions, some of the time, or never. We were then confronted with a perennial survey design issue—how to order these response options in our web survey? We randomly assigned respondents to receive one of two response option orderings: from “never” to “all the time with no exceptions” and the reverse. Because we asked respondents about their support for or attitudes about items related to policing, we had the opportunity to examine the concurrent validity of each of the two versions of the item by examining their correlation with the related items. Overall, the results suggest when polling about police use of body cameras in terms of relative frequencies, the response options should be ordered starting with “never” or the lowest frequency.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48234765","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2021-08-26DOI: 10.29115/sp-2021-0010
J. Ziegenfuss, C. Easterday, Jennifer M. Dinh, M. JaKa, T. Kottke, M. Canterbury
{"title":"Impact of demographic survey questions on response rate and measurement: A randomized experiment","authors":"J. Ziegenfuss, C. Easterday, Jennifer M. Dinh, M. JaKa, T. Kottke, M. Canterbury","doi":"10.29115/sp-2021-0010","DOIUrl":"https://doi.org/10.29115/sp-2021-0010","url":null,"abstract":"Demographic survey questions are important to describe the population of survey responders, illuminate potential disparities, and ultimately advance equity. Little is known about their impact on survey response rate or measurement. \u0000\u0000# Methods \u0000\u0000A total of 4,448 individuals were randomly assigned to one of three conditions in a mailed paper questionnaire where demographic questions were (1) not asked, (2) integrated at the end of the survey, or (3) included as standalone questions on a separate piece of paper. Response rates to the main survey and demographic questions, as well as item nonresponse and correlation of responses to administrative records, are compared. \u0000\u0000# Results \u0000\u0000Overall, 33.4% of individuals who were mailed the survey responded. There were no substantive or statistical differences in survey response rate when demographic questions were not asked (34.2%), were integrated into the survey (33.1%), or were standalone (33.0%; p = 0.762). Sampled individuals responded to the demographic questions at a significantly higher rate when they were integrated into the main survey (32.7%) compared to when they were standalone (28.3%). Respondents, when asked about income, declined to answer at a significantly higher rate when demographics were integrated (16.5%) compared to standalone (10.5%). Discordance between administrative and self-reported race and ethnicity data ranged from 0.6% to 1.0% and were not statistically different across arms (p = 0.64 and p = 0.88, respectively). \u0000\u0000# Discussion \u0000\u0000While these findings are limited to the context of the experiment, our results suggest that embedding demographic questions in a survey (as opposed to on a separate page) may result in more usable demographic data. Future work could explore the differential impact of post-survey missing data adjustments on estimates of demographic characteristics and correlation with other survey content. Overall, there was little measurement error in reporting of race/ethnicity in both conditions. \u0000\u0000# Conclusion \u0000\u0000For collection of demographic data from the largest portion of individuals via a mailed survey without negative impact on response rate or measurement error, demographic questions are best integrated into surveys rather than included as standalone items on a separate piece of paper.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49354666","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2021-08-12DOI: 10.29115/sp-2021-0008
Jessie Rouder, Olivia Saucier, Rachel Kinder, Matt E. Jans
{"title":"What to Do With All Those Open-Ended Responses? Data Visualization Techniques for Survey Researchers","authors":"Jessie Rouder, Olivia Saucier, Rachel Kinder, Matt E. Jans","doi":"10.29115/sp-2021-0008","DOIUrl":"https://doi.org/10.29115/sp-2021-0008","url":null,"abstract":"Open-ended survey responses, where respondents provide responses in an unstructured, open-text format instead of defined response categories, are often a successful way to solicit authentic and unexpected feedback, highlight the diversity of responses or nuances in opinions, and capture the “why” that complements quantitative survey data. However, there are many challenges to analyzing and reporting open-ended data. This article draws on visual design best practices, such as Gestalt principles and the authors’ combined experience to demonstrate several visualization strategies that are relatively simple to implement with open-ended data. The application of visualization best practices to open-ended data can increase recall and effective decision-making and can transform findings into a dynamic data story.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44571718","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2021-06-21DOI: 10.29115/sp-2021-0006
K. Seil, Shengchao Yu, R. Brackbill, Lennon Turner
{"title":"Web and paper survey mode patterns and preferences, Health & Employment Survey, World Trade Center Health Registry","authors":"K. Seil, Shengchao Yu, R. Brackbill, Lennon Turner","doi":"10.29115/sp-2021-0006","DOIUrl":"https://doi.org/10.29115/sp-2021-0006","url":null,"abstract":"This study described patterns of response versus nonresponse, earlier versus later response, and paper versus web response to the 2017–2018 Health & Employment Survey (HES). We predicted odds of responding to the survey based on demographic factors and examined impact of multiple email reminders on response volume. The overall completion rate was 65%. The likelihood of responding to HES was more than doubled when the web survey was an option. Most web surveys were received during the first two months of data collection compared with less than one-third of paper surveys. Multiple email reminders resulted in increased responses. To offer mode options to all, more efforts should be made on collecting valid email addresses.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69694201","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2021-04-29DOI: 10.29115/SP-2021-0005
V. Toepoel, A. Luiten, Robbert Zandvliet
{"title":"Response, Willingness, and Data Donation in a Study on Accelerometer Possession in the General Population","authors":"V. Toepoel, A. Luiten, Robbert Zandvliet","doi":"10.29115/SP-2021-0005","DOIUrl":"https://doi.org/10.29115/SP-2021-0005","url":null,"abstract":"In this study, we investigate prevalence of smartwatches; activity trackers (e.g., Fitbits); and apps to track personal activity on smartphones in the Dutch general population. In addition, we ask for respondents’ willingness to participate in a follow-up accelerometer study and wear a professional loaned activity tracker for a week. About half of the sample owns a personal device to track physical activity; 58.0% of those respondents are willing to copy personal data from the device into a questionnaire; 40.6% are willing to upload a spreadsheet from their personal device to a research portal. About half of the respondents of the entire sample express willingness to participate in a follow-up study and wear a professional accelerometer for a week. However, once invited, only 60.0% actually consent to participation. Respondents who own a personal device to monitor physical activity are more inclined to participate in the follow-up accelerometer study than respondents who do not own a personal device. This study shows that respondents with personal activity trackers show higher levels of physical activity compared to respondents without a personal device. In addition, participants in the follow-up study show higher levels of physical activity. Hence, estimating physical activity from personal activity trackers or professional activity trackers will likely result in biased results. We do not find significant differences between respondents with a personal device versus respondents without—nor people who participate in the accelerometer follow-up study—in sitting, standing, and lying time, however. Estimating sedentary behavior from personal or professional activity trackers is likely to result in unbiased results.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45013621","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2021-03-24DOI: 10.29115/SP-2021-0004
D. Greenberg, Ian Huff, N. Jackson, Diana M. Orcés
{"title":"Using Randomization to Learn About Framing Effects on LGBTQ Rights Questions","authors":"D. Greenberg, Ian Huff, N. Jackson, Diana M. Orcés","doi":"10.29115/SP-2021-0004","DOIUrl":"https://doi.org/10.29115/SP-2021-0004","url":null,"abstract":"In a survey that included the same question about refusing service to gay and lesbian people due to religious beliefs in two different batteries, some respondents offered different answers. We probe the framing issues inherent in each question battery and find that support for refusing service to gay and lesbian people declines when the question is in the context of other group service refusals that could be considered civil rights issues. Additionally, inconsistent responses are also related to question order. We posit that randomization can lead to what appear to be fluctuations in attitudes but may, in fact, also be capturing framing effects. This has implications for both the survey design process and substantive findings.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-03-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44396964","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}