Survey practicePub Date : 2022-09-29DOI: 10.29115/sp-2022-0008
H. Miles, Christian Els, Cholpon Ramizova
{"title":"The role of interviewer ethnicity on survey responses: A case study in refugee camps in Bangladesh","authors":"H. Miles, Christian Els, Cholpon Ramizova","doi":"10.29115/sp-2022-0008","DOIUrl":"https://doi.org/10.29115/sp-2022-0008","url":null,"abstract":"In this paper, we report results of a study conducted in one of the world’s largest refugee camps, the Kutupalong–Balukhali expansion site in Cox’s Bazar, Bangladesh, in early 2021. We compare quantitative results of a survey on Rohingya refugees’ perceptions of humanitarian aid conducted by Bangladeshi and Rohingya interviewers. For 36 out of 40 perception questions, we found a significant difference between the interviewer groups. Rohingya respondents, when interviewed by a member of their own ethnicity, express much lower levels of satisfaction with aid services than those interviewed by Bangladeshi interviewers, are more likely to report rude or abusive behavior, and are less likely to admit to behaviors deemed socially undesirable. Existing literature on ethnicity-of-interviewer effects in public opinion research focuses mainly on the United States and ethnic minorities in Europe, and thus, this study provides new insight into interviewer effects in humanitarian settings. The findings from this study call into question the validity and comparability of surveys conducted in humanitarian settings around the world. For Bangladesh, our findings show the importance of recruiting interviewers from the same ethnic group as respondents in order to elicit honest opinions concerning issues that may be socially sensitive or seen as critical of the aid efforts undertaken on their behalf.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42104401","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2022-09-15DOI: 10.29115/sp-2022-0009
Michael Soszynski, Ryan Bliss
{"title":"Does survey administration mode relate to non-substantive responses? A comparison of email versus phone administration of a residential utility-sponsored energy efficiency program survey","authors":"Michael Soszynski, Ryan Bliss","doi":"10.29115/sp-2022-0009","DOIUrl":"https://doi.org/10.29115/sp-2022-0009","url":null,"abstract":"Program evaluation research often relies heavily on surveys and increasingly self-administered online tools. Often, however, a portion of program participants or customers do not have or do not provide email addresses. This study investigates if the type of contact information that members of a population provide relates to non-substantive responses (choosing \"don’t know or “prefer not to answer”). We found evidence that survey administration mode relates to non-substantive responses, even while controlling for demographic factors.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47193787","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2022-09-01DOI: 10.29115/sp-2022-0007
Lisa Lee, Justine A. Bulgar-Medina, K. Neishi, Angela Houghton, Manal Sidi
{"title":"Strategies for Increasing Asian American, Native Hawaiian, and Pacific Islander Representation in Survey Research","authors":"Lisa Lee, Justine A. Bulgar-Medina, K. Neishi, Angela Houghton, Manal Sidi","doi":"10.29115/sp-2022-0007","DOIUrl":"https://doi.org/10.29115/sp-2022-0007","url":null,"abstract":"The Asian American, Native Hawaiian, and Pacific Islander (AANHPI) population in the United States is growing rapidly and is geographically dispersed and culturally diverse. Yet, national estimates produced for this population are often limited to a subset, typically those who are English proficient. Meaningful representation of AANHPI communities in survey research requires strategies that account for their diverse linguistic and cultural characteristics. However, translation alone will not suffice to increase representation. More culturally responsive approaches are needed as well. In a joint project, AARP and NORC at the University of Chicago reviewed the literature and conducted semistructured interviews with experts in AANHPI representation in research to examine barriers to AANHPI survey participation and strategies for overcoming these barriers. This article presents findings and recommendations from this research. We discuss three key challenges to AANHPI representation in surveys: Lack of familiarity with surveys and their importance, lack of trust in those conducting surveys, and issues of language and translation. We then present strategies for increasing AANHPI survey participation: Involving trusted leaders of the AANHPI community, at the local or national level as appropriate for the study; focusing on messaging about the survey that is culturally appropriate and tailored to the population; and providing culturally appropriate translations.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48636011","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2022-08-18DOI: 10.29115/sp-2022-0005
Alda G. Rivas, Christopher Antoun, Shelley Feuer, Thomas Mathew, E. Nichols, E. Olmsted-Hawala, Lin Wang
{"title":"Comparison of Three Navigation Button Designs in Mobile Survey for Older Adults","authors":"Alda G. Rivas, Christopher Antoun, Shelley Feuer, Thomas Mathew, E. Nichols, E. Olmsted-Hawala, Lin Wang","doi":"10.29115/sp-2022-0005","DOIUrl":"https://doi.org/10.29115/sp-2022-0005","url":null,"abstract":"Given the cognitive and physical changes that accompany healthy aging (e.g., reduced vision, reduced motor control), it is crucial to design mobile surveys that enable older adults to overcome the challenges that may be present during survey completion on a smartphone. The present study compared three designs of navigation button placement in terms of older adults’ performance of completing a mobile survey. The three designs included (1) navigation buttons below web page content (Below-content), (2) navigation buttons ever-present at the bottom of screen (Fixed-bottom), and (3) navigation buttons ever-present at the top of screen (Fixed-top). Sixty-two older adults completed three different surveys, each under one of the experimental conditions. The results indicated that participants completed a mobile survey faster under the fixed-bottom design than in the below-content design and that participants were more likely to select a visible response choice in either the fixed-bottom or fixed-top condition than in the below-content condition. We also found that participants perceived the fixed-top condition as more difficult to complete than the below-content condition and that most participants selected the below-content condition as their preferred format of navigation buttons in a mobile survey. The findings of this study indicate that the below-content condition promoted higher data quality and participant satisfaction than either of the fixed buttons conditions. Given these findings, we recommend that mobile surveys include navigation buttons at the bottom of the content.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42774752","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2022-06-09DOI: 10.29115/sp-2022-0004
Michael T Jackson, Arifah Hasanbasri, C. McPhee, J. Peugh
{"title":"The Utility of a Random Forest Propensity Adjustment in Recurring Hybrid Probability-Nonprobability Samples: Evidence from a Tracking Poll","authors":"Michael T Jackson, Arifah Hasanbasri, C. McPhee, J. Peugh","doi":"10.29115/sp-2022-0004","DOIUrl":"https://doi.org/10.29115/sp-2022-0004","url":null,"abstract":"","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-06-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48195380","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2022-03-24DOI: 10.29115/sp-2022-0002
Matthew DeBell
{"title":"Experimental Effects of Advance Postcards, Survey Title, Questionnaire Length, and Questionnaire Content on Response Rates and Incentive Costs in a Mail Non-Response Follow-Up Survey","authors":"Matthew DeBell","doi":"10.29115/sp-2022-0002","DOIUrl":"https://doi.org/10.29115/sp-2022-0002","url":null,"abstract":"A non-response follow-up study by mail in a national sample of U.S. households had five embedded experiments to test the effects of an advance mailing, alternate survey titles, 1- or 2-page questionnaire length, the inclusion or exclusion of political questions on the 1-page questionnaire, and the position of political content on the first or second page of the 2-page questionnaire. None of these design elements affected the payout of escalated postpaid incentives. Advance mailings had no effect on response rate. A short title (National Survey of Households) had a slightly higher response rate than a longer, more descriptive one (National Survey of Households, Families, and Covid-19). Political question content, whether by inclusion, exclusion, or position, had no discernable effect on response, even among prior-study non-respondents. Questionnaire length was inversely related to response: the 2-page questionnaire depressed the overall response rate by 3.7 points (58.5 compared to 54.8 percent, weighted) and depressed response for the critical sample group of prior non-respondents by 6.9 points (36.9 compared to 29.9).","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-03-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46040006","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2022-01-06DOI: 10.29115/sp-2021-0012
Neman Tiffany S., Dykema Jennifer, Garbarski Dana, J. Cameron, Schaeffer Nora Cate, Farrar-Edwards Dorothy
{"title":"urvey Monetary Incentives: Digital Payments as an Alternative to Direct Mail","authors":"Neman Tiffany S., Dykema Jennifer, Garbarski Dana, J. Cameron, Schaeffer Nora Cate, Farrar-Edwards Dorothy","doi":"10.29115/sp-2021-0012","DOIUrl":"https://doi.org/10.29115/sp-2021-0012","url":null,"abstract":"","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45439606","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}