Field MethodsPub Date : 2023-08-09DOI: 10.1177/1525822x231194515
Anthony Distefano, Joshua S. Yang
{"title":"Sample Size and Saturation: A Three-phase Method for Ethnographic Research with Multiple Qualitative Data Sources","authors":"Anthony Distefano, Joshua S. Yang","doi":"10.1177/1525822x231194515","DOIUrl":"https://doi.org/10.1177/1525822x231194515","url":null,"abstract":"Despite recent methodological advances in saturation, guidelines for its estimation in more complex research designs—such as ethnographic studies—have been lacking. We present an accessible, step-by-step approach to empirical assessment of data saturation, tested on a moderately sized ethnographic study with 109 combined direct observations and interviews. The three-phase method includes a priori sample size prediction, provisional saturation estimation during data collection, and post hoc confirmation. Post hoc analysis indicated we reached key thresholds of data saturation before ending fieldwork. We achieved 80% saturation at our 69th data collection event (63% of the full sample) and 90% saturation at our 91st data collection event (83% of the full sample). The method is designed to account for on-the-ground realities confronted in contemporary ethnographic research, including time constraints during fieldwork, and can accommodate studies with medium to large scopes, broad foci, heterogeneous populations, and analysis of multiple qualitative data sources.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48348844","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2023-07-16DOI: 10.1177/1525822x231188593
H. Einarsson, A. Cernat, N. Shlomo
{"title":"The Effects of Framing the Survey Request and Using Targeted Appeals on Participation in Cross-sectional Surveys","authors":"H. Einarsson, A. Cernat, N. Shlomo","doi":"10.1177/1525822x231188593","DOIUrl":"https://doi.org/10.1177/1525822x231188593","url":null,"abstract":"The presentation of survey requests represents an easily modifiable feature of survey communications that can in some contexts affect response propensities. Here, we examine how two features: the framing of the participation request (informed by prospect theory) and the inclusion of targeted appeals based on demographic background (age or electoral district), affect participation rates in the 2021 Icelandic National Election Study, a mixed-mode cross-sectional survey. We find that these features generally fail to affect response propensities and sample composition. However, framed requests produced marginally higher response rates for a subset of the sample that was invited to complete the survey online. This suggests that modifying the presentation of the survey request may be less effective in cross-sectional surveys than in longitudinal ones, where more information is available to inform the content of targeted messages.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45783304","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2023-05-30DOI: 10.1177/1525822x231176167
Tamara Holmes
{"title":"Learning Circles, Underpinned by Dadirri","authors":"Tamara Holmes","doi":"10.1177/1525822x231176167","DOIUrl":"https://doi.org/10.1177/1525822x231176167","url":null,"abstract":"This short take presents the process of a learning circle, underpinned by Dadirri (Ungunmeer-Baumann 1988). This method was used for the purposes of critical reflective practice and data collection activity with non-Indigenous participants. Dadirri is a First Nations (Australian) term for “deep listening.” The learning circle research occurred with social and welfare workers in a regional health service. We found, through privileging Indigenous knowledges in the activity, that this method can enable a generation of learnings and critical reflection and assist workers to apply theory to practice. This method can also be used as a data collection tool to evaluate these aims.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"129 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135642601","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2023-05-25DOI: 10.1177/1525822x231176693
Laura Kawerau, A. Birkenberg, T. Daum, Cosmas Alfred Butele, R. Birner
{"title":"Entering the Digital Research Age: Investigating the Effectiveness of Visual Digital Tools in Agricultural Research","authors":"Laura Kawerau, A. Birkenberg, T. Daum, Cosmas Alfred Butele, R. Birner","doi":"10.1177/1525822x231176693","DOIUrl":"https://doi.org/10.1177/1525822x231176693","url":null,"abstract":"Agricultural studies mainly rely on quantitative research approaches. Despite growing interest in and uptake of qualitative, participatory, and visual methods due to their perceived advantages in gathering in-depth information and empowering participants, visual–digital research methods have yet to be largely applied. In our study on adaptation strategies to climate change among smallholder farmers in Uganda we compared different data collection methods, including: semi-structured interviews with manual note-taking, participatory impact diagrams, and adapted photovoice and cellphilm methodologies.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-05-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48032868","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2023-05-24DOI: 10.1177/1525822x231173805
D. Garbarski, Jennifer Dykema, Cameron P. Jones, Tiffany S. Neman, N. C. Schaeffer, Dorothy Farrar Edwards
{"title":"Questioning Identity: How a Diverse Set of Respondents Answer Standard Questions About Ethnicity and Race","authors":"D. Garbarski, Jennifer Dykema, Cameron P. Jones, Tiffany S. Neman, N. C. Schaeffer, Dorothy Farrar Edwards","doi":"10.1177/1525822x231173805","DOIUrl":"https://doi.org/10.1177/1525822x231173805","url":null,"abstract":"Ethnoracial identity refers to the racial and ethnic categories that people use to classify themselves and others. How it is measured in surveys has implications for understanding inequalities. Yet how people self-identify may not conform to the categories standardized survey questions use to measure ethnicity and race, leading to potential measurement error. In interviewer-administered surveys, answers to survey questions are achieved through interviewer–respondent interaction. An analysis of interviewer–respondent interaction can illuminate whether, when, how, and why respondents experience problems with questions. In this study, we examine how indicators of interviewer–respondent interactional problems vary across ethnoracial groups when respondents answer questions about ethnicity and race. Further, we explore how interviewers respond in the presence of these interactional problems. Data are provided by the 2013–2014 Voices Heard Survey, a computer-assisted telephone survey designed to measure perceptions of participating in medical research among an ethnoracially diverse sample of respondents.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43692613","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2023-05-21DOI: 10.1177/1525822x231173815
Kali Defever, Becky Reimer, Michael Trierweiler, Elise Comperchio
{"title":"Improving Self-reported Prescription Medicine Data Quality with a Commercial Database Lookup Tool and Claims Matching","authors":"Kali Defever, Becky Reimer, Michael Trierweiler, Elise Comperchio","doi":"10.1177/1525822x231173815","DOIUrl":"https://doi.org/10.1177/1525822x231173815","url":null,"abstract":"Estimating prescription medicine use is challenging due to recall bias associated with surveys and coverage bias in administrative data. This study assesses how making operational improvements and combining both survey and administrative data sources can increase data quality on filled prescriptions. We use data from the Medicare Current Beneficiary Survey (MCBS) and administrative data from the Centers for Medicare and Medicaid Services (CMS). First, we investigate improvements from a prescription medicine lookup (PMLU) tool integrating a commercial medicine database into the MCBS. We then examine impacts of matching survey-reported medicines to Part D claims. We find that the PMLU improves accuracy and reduces measurement bias. Claims matching identifies additional medicines, especially for beneficiaries with more chronic conditions and medicines. This study shows that integrating a commercial database and supplementing with administrative data improves data quality and reduces sources of error.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44191762","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2023-05-03DOI: 10.1177/1525822x231158888
L. S. Liebst, Lasse Baggesen, K. L. Dausel, Virginia Pallante, M. R. Lindegaard
{"title":"Human Observers Are Accurate in Judging Personal Relationships in Real-life Settings: A Methodological Tool for Human Observational Research","authors":"L. S. Liebst, Lasse Baggesen, K. L. Dausel, Virginia Pallante, M. R. Lindegaard","doi":"10.1177/1525822x231158888","DOIUrl":"https://doi.org/10.1177/1525822x231158888","url":null,"abstract":"One limitation of the naturalistic observation method is that it is understudied how accurately personal relationships may be judged by observers in real-life settings. To assess this judgment accuracy, we observed 285 dyads of individuals in public places and then asked whether they were affiliated or strangers. We found that human observers were very accurate in judging peoples’ actual personal relationships. Moreover, several nonverbal cues, including direct interaction and age similarities, were identified as correlates of affiliation. We conclude that researchers may accurately judge personal relationships from nonverbal observational data and recommend that this should be utilized as a methodological tool in naturalistic observational studies.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46326854","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2023-05-01Epub Date: 2022-05-20DOI: 10.1177/1525822x221100904
Stefan Schneider, Haomiao Jin, Bart Orriens, Doerte U Junghaenel, Arie Kapteyn, Erik Meijer, Arthur A Stone
{"title":"Using Attributes of Survey Items to Predict Response Times May Benefit Survey Research.","authors":"Stefan Schneider, Haomiao Jin, Bart Orriens, Doerte U Junghaenel, Arie Kapteyn, Erik Meijer, Arthur A Stone","doi":"10.1177/1525822x221100904","DOIUrl":"10.1177/1525822x221100904","url":null,"abstract":"<p><p>Researchers have become increasingly interested in response times to survey items as a measure of cognitive effort. We used machine learning to develop a prediction model of response times based on 41 attributes of survey items (e.g., question length, response format, linguistic features) collected in a large, general population sample. The developed algorithm can be used to derive reference values for expected response times for most commonly used survey items.</p>","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"35 2","pages":"87-99"},"PeriodicalIF":1.7,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10553081/pdf/nihms-1886246.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41153012","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2023-03-17DOI: 10.1177/1525822x231163668
Teresa M. Powell, Toni Rose Geronimo-Hara, Laura E. Tobin, Carrie J Donoho, Beverly D. Sheppard, Jennifer L. Walstrom, Rudolph P. Rull, D. Faix
{"title":"Pre-incentive Efficacy in Survey Response Rates in a Large Prospective Military Cohort","authors":"Teresa M. Powell, Toni Rose Geronimo-Hara, Laura E. Tobin, Carrie J Donoho, Beverly D. Sheppard, Jennifer L. Walstrom, Rudolph P. Rull, D. Faix","doi":"10.1177/1525822x231163668","DOIUrl":"https://doi.org/10.1177/1525822x231163668","url":null,"abstract":"Declining survey response rates concern researchers aiming to ensure study validity. This article tested the effectiveness of multiple pre-incentives on increasing survey response to the Millennium Cohort Study. Participants consisted of U.S. military service members and veterans, and were randomly assigned to receive a $2 bill, $5 gift card, magnet, Apple iPad® lottery entry, or no pre-incentive. Participants who received the gift card or cash pre-incentive had the highest response rates and were significantly more likely to respond to the survey than those who did not receive a pre-incentive. There was no significant difference in survey response among the magnet or lottery entry groups compared to the no pre-incentive group. This study found that giving participants a monetary pre-incentive was an effective way to increase response rates, and thereby participant retention, in a hard-to-reach, highly mobile population, and re-engage participants who did not respond to a previous follow-up survey.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49024669","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2023-03-16DOI: 10.1177/1525822x231159462
A. Dușa, A. Marx
{"title":"Comment to: “Case-to-Factor Ratios and Model Specification in Qualitative Comparative Analysis (QCA)”","authors":"A. Dușa, A. Marx","doi":"10.1177/1525822x231159462","DOIUrl":"https://doi.org/10.1177/1525822x231159462","url":null,"abstract":"The article by Thiem and Mkrtchyan appears in a context of rising interest about the number of cases needed to perform a QCA analysis. They question the benchmark tables proposed by Marx and Dușa (2011) and conclude the ratios from those tables are “misplaced.” We believe this conclusion deviates from the scientific method and focus on two essential aspects: (1) their approach to the case to factor ratios and (2) omitted variable bias. We conclude our tables hold until a better alternative is proposed and encourage QCA researchers to continue using them.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2023-03-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46024377","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}