Survey practice最新文献

Survey Practice in Non-Survey-Literate Populations: Lessons Learned from a Cognitive Interview Study in Brazil. 非调查文化人群的调查实践：从巴西认知访谈研究中获得的经验教训。

Survey practice Pub Date : 2025-03-01 Epub Date: 2025-03-02 DOI: 10.29115/SP-2024-0035

Meredith Massey

{"title":"Survey Practice in Non-Survey-Literate Populations: Lessons Learned from a Cognitive Interview Study in Brazil.","authors":"Meredith Massey","doi":"10.29115/SP-2024-0035","DOIUrl":"10.29115/SP-2024-0035","url":null,"abstract":"<p><p>Survey research relies on cooperation and coordination between researchers and respondents. Survey-literate respondents possess a level of understanding of the survey process that facilitates their participation. Non-survey-literate respondents, on the other hand, are less equipped to provide accurate responses, which can lead to increased survey error. In this article, we present findings from a cognitive interview project conducted in Brazil to illustrate potential barriers to respondent participation and demonstrate how these barriers contribute to response error. To test questions on inclusive education, researchers from the Collaborating Center for Questionnaire Design and Evaluation Research at the National Center for Health Statistics facilitated the collection of data through 80 cognitive interviews conducted in various neighborhoods in Rio de Janeiro, Brazil. Recruitment targeted caregivers of children with and without disabilities, and respondents were predominantly female with low literacy levels. The results indicated that respondents with limited familiarity with the survey process (non-survey-literate) struggled to orient themselves to the survey task. They faced challenges in choosing response options, understanding scale relationships, and interpreting vocabulary. Additionally, many respondents expressed a need to share salient details of their lives, which the survey was not designed to capture. Understanding these barriers to participation and identifying ways to mitigate them can help reduce survey error, particularly in vulnerable populations.</p>","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"19 SI","pages":""},"PeriodicalIF":0.0,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11987661/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144043737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Examining the Link between the ‘Middle Means Typical’ Heuristic and Answer Behavior 研究 "中间即典型 "启发式与回答行为之间的联系

Survey practice Pub Date : 2024-07-17 DOI: 10.29115/sp-2024-0009

Ádám Stefkovics, Jan Karem Höhne

{"title":"Examining the Link between the ‘Middle Means Typical’ Heuristic and Answer Behavior","authors":"Ádám Stefkovics, Jan Karem Höhne","doi":"10.29115/sp-2024-0009","DOIUrl":"https://doi.org/10.29115/sp-2024-0009","url":null,"abstract":"Question interpretation in web surveys may not only depend on the textual content but also on visual design aspects. Research has shown that respondents seem to make use of interpretative heuristics when answering questions potentially influencing their answer behavior. In this study, we investigate the implications of the ‘middle means typical’ (MMT) heuristic, which suggests that respondents perceive the middle option of a scale as the most typical one. For this purpose, we use data from a survey experiment embedded in the probability-based German Internet Panel (N = 4,679) varying the inclusion of a non-substantive “Don’t know” option (with or without separation from the substantive options) and scale polarity (unipolar or bipolar). The four questions under investigation were adopted from the Big5 inventory dealing with agreeableness and openness. The results suggest that the MMT heuristic has a minor impact on answer behavior, as the separation of non-substantive options did not affect answer distributions and response times (as a measure of response effort). However, scale polarity influenced answer behavior and response times. Similar to what has been observed in previous studies, unipolar scales elicited more middle answers and bipolar scales elicited more positive answers. Bipolar scales also resulted in longer response times. Although design violations against the MMT heuristic do not seem to impact answer behavior, we still recommend exercising caution when designing scales with non-substantive options. We also highlight the necessity of testing scales differing with respect to polarity.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"172 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141828599","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Best Practices for Measuring Skin Color in Surveys 在调查中测量肤色的最佳做法

Survey practice Pub Date : 2024-05-23 DOI: 10.29115/sp-2024-0005

Rachel A. Gordon, Amelia R. Branigan, M. Khan, Johanna G. Nunez

{"title":"Best Practices for Measuring Skin Color in Surveys","authors":"Rachel A. Gordon, Amelia R. Branigan, M. Khan, Johanna G. Nunez","doi":"10.29115/sp-2024-0005","DOIUrl":"https://doi.org/10.29115/sp-2024-0005","url":null,"abstract":"Surveys that assess skin color support evidence building about colorism and related systemic inequalities that affect health and wellbeing. Methodologists have increasing choices for such assessments, including a growing array of digital images for rating scales and increasingly cost-effective handheld mechanical devices based on color science. Guidance is needed for choosing among these growing options. We used data from a diverse sample of 102 college students to produce new empirical evidence and practical guidance about various options. We compared three handheld devices that ranged in price, considering variations in their reliabilities and how their results differed by where on the body and with what device settings readings were taken. We also offered evidence regarding how reliably interviewers and participants could choose from a large array of color swatches offering variation in skin undertone (redness, yellowness) in addition to skin shade (lightness-to-darkness). Overall, the results were promising, demonstrating that modern handheld devices and rating scales could be feasibly and reliably used. For instance, results demonstrated that just one or two device readings were needed at any given location, and, the device readings and rating scale scores similarly captured the relative darkness of skin. In other cases, recommendations were less certain. For instance, skin undertones of redness and yellowness were more sensitive to device choices and body locations. We encourage future studies that pursue why such variability exists and for which substantive questions it matters most.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"38 50","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141103729","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Applying Machine Learning to Survey Question Assessment 将机器学习应用于调查问题评估

Survey practice Pub Date : 2024-05-09 DOI: 10.29115/sp-2024-0006

Ting Yan, Hanyu Sun, Anil Battalahalli

引用次数: 0

Processes and Challenges Associated with Conducting Survey Research in Conflict Zones 在冲突地区开展调查研究的相关流程和挑战

Survey practice Pub Date : 2024-04-10 DOI: 10.29115/sp-2023-0032

William L. Rosenberg

{"title":"Processes and Challenges Associated with Conducting Survey Research in Conflict Zones","authors":"William L. Rosenberg","doi":"10.29115/sp-2023-0032","DOIUrl":"https://doi.org/10.29115/sp-2023-0032","url":null,"abstract":"A wide variety of organizations domestically and internationally conduct surveys in conflict zones. Their timely findings are essential for policy makers. Survey research in conflict zones is an essential tool for policy makers in government, humanitarian, private sector, and non-governmental organizations to develop and evaluate programs, services, and policies. Such research is often even more challenging in less developed areas of the world due to issues related to access, technology, and staffing. Other challenges include population movements, lack of societal data structures such as a recent census, communication systems such as telephones, as well as issues related to sampling, design, and the omnipresent issue of security for the researchers and respondents. Often, researchers must make trade-offs regarding internal and external validity which are tempered by issues related to cost, speed, and accuracy. Policy makers need to feel comfortable in the reliability and the generalizability of the findings they receive or develop. The data collected in conflict zones must strive to use appropriate techniques to quantify the data and evaluate the results. Furthermore, flexibility and adaptability are important concepts to consider when conducting research in conflict zones.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"15 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140717797","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Recruiting non-respondents for a conversation about reasons for non-response: A description and evaluation 招募未回复者，就未回复原因进行对话：说明和评估

Survey practice Pub Date : 2024-03-14 DOI: 10.29115/sp-2024-0001

M. Haan, Vera Toepoel, Y. Ongena, Björn Janssen

{"title":"Recruiting non-respondents for a conversation about reasons for non-response: A description and evaluation","authors":"M. Haan, Vera Toepoel, Y. Ongena, Björn Janssen","doi":"10.29115/sp-2024-0001","DOIUrl":"https://doi.org/10.29115/sp-2024-0001","url":null,"abstract":"The decline in survey response rates has become a significant concern in survey research. To address this issue and gain a deeper understanding of non-participation, a research approach was pursued involving semi-structured interviews with non-respondents, guided by survey theories and practical experiences from Statistics Netherlands (SN). Experienced SN interviewers visited 2763 addresses of individuals who initially did not respond to a survey request from one out of six different SN surveys. Non-responding individuals were given another opportunity to participate in a SN survey immediately at their doorstep or by scheduling an appointment. In case of refusal, interviewers presented the option to engage in a qualitative interview study led by the University of Groningen (UG). However, despite concerted efforts by interviewers, none could successfully convince non-respondents to participate in the UG interview study about survey experiences. The inclusion of personal information on a form, particularly those requiring a signature, led to increased refusals and privacy concerns. An evaluation during an expert meeting with SN interviewers suggested three potential strategies for future recruitment efforts: exploring a collaborative approach between SN interviewers and UG researchers, considering incentives, and developing a tailored fact sheet for the UG study to enhance its relevance to potential respondents.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"22 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140242161","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Keep the noise down: On the performance of automatic speech recognition of voice-recordings in web surveys 降低噪音论网络调查中语音录音的自动语音识别性能

Survey practice Pub Date : 2024-02-29 DOI: 10.29115/sp-2023-0022

Katharina Meitinger, Sabien van der Sluis, Matthias Schonlau

引用次数: 0

Testing Theoretical Communication Strategies on Survey Email Outreach to South Carolina Manufacturing Firms 测试针对南卡罗来纳州制造业企业的调查电子邮件推广的理论交流策略

Survey practice Pub Date : 2024-02-15 DOI: 10.29115/sp-2023-0031

Jason Kosakow

引用次数: 0

Large sampling errors when using the Unmatched Count Technique to estimate prevalence: A simulation study 使用非匹配计数技术估计流行率时存在较大的抽样误差：模拟研究

Survey practice Pub Date : 2024-02-01 DOI: 10.29115/sp-2024-0002

Zachary Neal