Field MethodsPub Date : 2024-09-14DOI: 10.1177/1525822x241280574
Francisco Olivos, Minhui Liu
{"title":"ChatGPTest: Opportunities and Cautionary Tales of Utilizing AI for Questionnaire Pretesting","authors":"Francisco Olivos, Minhui Liu","doi":"10.1177/1525822x241280574","DOIUrl":"https://doi.org/10.1177/1525822x241280574","url":null,"abstract":"The rapid advancements in generative artificial intelligence have opened new avenues for enhancing various aspects of research, including the design and evaluation of survey questionnaires. However, the recent pioneering applications have not considered questionnaire pretesting. This article explores the use of GPT models as a useful tool for pretesting survey questionnaires, particularly in the early stages of survey design. Illustrated with two applications, the article suggests incorporating GPT feedback as an additional stage before human pretesting, potentially reducing successive iterations. The article also emphasizes the indispensable role of researchers’ judgment in interpreting and implementing AI-generated feedback.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"15 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142252672","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2024-07-26DOI: 10.1177/1525822x241267171
David L. Morgan
{"title":"Invited Review: Collecting Data through Dyadic Interviews: A Systematic Review","authors":"David L. Morgan","doi":"10.1177/1525822x241267171","DOIUrl":"https://doi.org/10.1177/1525822x241267171","url":null,"abstract":"This article reports on a systematic review of journal articles that used dyadic interviews, also known as paired or joint interviews. The two basic formats for these interviews involve either interviewing participants separately or together, plus the additional possibility of using both formats in the same study. A search using the Social Science Citations Index yielded 471 articles that reported on such interviews. Of these articles, 38% reported interviewing the dyad members separately, 55% reported interviewing them together, and 7% used both formats. Over 40% reported on interviews of married couples or equivalents, and an additional 30% of the interviews involved other pairs of family members. Less common pairings involved coworkers, patients and providers, or friends. These results indicate an almost unanimous use of dyadic interviews based on pre-existing relationships and family members in particular, with only limited use as a broader interviewing method.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"4 1 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141782658","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2024-07-20DOI: 10.1177/1525822x241263508
Hafsteinn Einarsson
{"title":"Offering Web Response as a Refusal Conversion Technique in a Mixed-mode Survey","authors":"Hafsteinn Einarsson","doi":"10.1177/1525822x241263508","DOIUrl":"https://doi.org/10.1177/1525822x241263508","url":null,"abstract":"Survey organizations aiming to improve response rates in the later stages of fieldwork often attempt refusal conversions. However, reestablishing contact with units that have refused participation at prior stages of fieldwork may prove costly and time consuming. In this article, the potential of using a refusal conversion procedure in a single contact is investigated. In a mixed-mode survey of young adults in Iceland, individuals who were contacted by telephone and refused participation were instantly offered the option of self-completing the survey on the web at their time of choice. Results indicate that this procedure can meaningfully improve response rates in a survey of young adults in Iceland. The additional respondents gathered using this procedure were mostly similar to those who responded by using other modes when considering demographic background and responses to survey items.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"9 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141738905","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2024-07-20DOI: 10.1177/1525822x241262678
Mireia Bolíbar, Julia Martínez-Ariño, Maria Schiller
{"title":"Network of Categories: A Method to Aggregate Egocentric Network Survey Data into a Whole Network Structure","authors":"Mireia Bolíbar, Julia Martínez-Ariño, Maria Schiller","doi":"10.1177/1525822x241262678","DOIUrl":"https://doi.org/10.1177/1525822x241262678","url":null,"abstract":"We propose a new method for analyzing and visualizing information on a large collection of personal networks to uncover the socio-centric structure of relationships among aggregated actors that we clustered into categories. The network of categories identifies the links between groups of sampled ego actors sharing a given attribute (e.g., “being immigrant organizations”) and abstract attribute-based groups or types of alters (e.g., “any immigrant organization”). This method takes advantage of both whole networks and ego-centered networks analytical approaches since it gains insights into the context’s whole network structure while generalizing the results to a wider population. The method can be applied to data obtained through modified versions of instruments such as position or resource generators, which are easy to collect within standard large- N representative surveys. We present a concrete application of the method to the analysis of immigrant organizations' position in local governance networks in 40 French and German cities.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"21 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141738906","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2024-06-24DOI: 10.1177/1525822x241260994
Christopher Antoun, Xin (Rosalynn) Yang, Brady T. West, Ai Rene Ong
{"title":"Developing a Modular Survey App Using Co-design Principles","authors":"Christopher Antoun, Xin (Rosalynn) Yang, Brady T. West, Ai Rene Ong","doi":"10.1177/1525822x241260994","DOIUrl":"https://doi.org/10.1177/1525822x241260994","url":null,"abstract":"The objective of our project was to develop a smartphone app for administering shorter (“modular”) surveys. Given the paucity of research on this topic, we decided to use “co-design” techniques to generate design solutions. To implement these techniques, we recruited respondents in the survey target population to work in small groups and provide design ideas for the app. In this article, we present their input and examine whether we were successful in engaging them to contribute useful ideas. Although participation levels were uneven across the different groups, we found no evidence that group engagement was low overall or declined over the course of the sessions. In addition, the groups generated a diverse set of ideas, some of which informed the final app design. These findings underscore the feasibility of applying co-design principles to survey research, though further investigation is needed with different samples and design topics.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"38 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141532494","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2024-05-28DOI: 10.1177/1525822x241252220
Michael C. Robbins, Zhuping (Zoe) Li
{"title":"The Nolan Index: An R Program for Calculating List Resemblances","authors":"Michael C. Robbins, Zhuping (Zoe) Li","doi":"10.1177/1525822x241252220","DOIUrl":"https://doi.org/10.1177/1525822x241252220","url":null,"abstract":"The Nolan Index (NI) is a normed, quantitative measure for comparing the degree of resemblance (similarity or dissimilarity) between free listings with an Excel program for calculating it. This article enhances that effort with the addition of an R program and additional applications. Free-list resemblance measures have been used to investigate and compare historical and cultural connections, ecological relationships, cultural item utilities, practices, knowledge, and values both within and between various groups. Their utility for cultural domain analysis and the theory of cognitive cultural models is also considered.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"11 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141169857","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2024-05-11DOI: 10.1177/1525822x241247444
H. Cigdem Bulut, Okan Bulut, Ashley Clelland
{"title":"A Psychometric Network Analysis Approach for Detecting Item Wording Effects in Self-report Measures across Subgroups","authors":"H. Cigdem Bulut, Okan Bulut, Ashley Clelland","doi":"10.1177/1525822x241247444","DOIUrl":"https://doi.org/10.1177/1525822x241247444","url":null,"abstract":"In this study, we explored psychometric network analysis (PNA) as an alternative method for identifying item wording effects in self-report instruments. We examined the functioning of negatively worded items in the network structures of two math-related scales from the 2019 Trends in International Mathematics and Science Study (TIMSS); Students Like Learning in Mathematics (SLLM); and Students Confident in Mathematics (SCM). We also explored how the negatively worded items functioned in network structures across demographic subgroups. Data were drawn from eight countries that represented diverse levels of math performance and cultural attitudes toward school ( n = 75,972). We found that negatively worded items were distinct from the positively worded items in the SLLM and SCM item networks, and that this effect was consistent across all age- and country-level subgroups. Based on these findings, we recommend PNA as a data-driven approach for detecting wording effects effectively.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"75 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140925066","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2024-05-11DOI: 10.1177/1525822x241248906
Orsola Torrisi, Jethro Banda, Georges Reniers, Stéphane Helleringer
{"title":"Revisiting the Recommended Duration of Interviews Conducted by Mobile Phone in Low- and Middle-income Countries: A Randomized Trial in Malawi","authors":"Orsola Torrisi, Jethro Banda, Georges Reniers, Stéphane Helleringer","doi":"10.1177/1525822x241248906","DOIUrl":"https://doi.org/10.1177/1525822x241248906","url":null,"abstract":"Guidelines for conducting surveys by mobile phone calls in low- and middle-income countries suggest keeping interviews short (<20 minutes). The evidence supporting this recommendation is scant, even though limiting interview duration might reduce the amount of data generated by such surveys. We recruited nearly 2,500 mobile phone users in Malawi and randomly allocated them to 10-, 20-, or 30-minute phone interviews, all ending with questions on parental survival. Cooperation was high in all groups, and differences in completion rates were minimal. The extent of item nonresponse, age heaping, and temporal displacement of deaths in data on parental survival generally did not vary between study groups, but reports of maternal age at death were more reliable in longer interviews. Recommendations about the duration of mobile phone interviews might be too restrictive. They should not preclude additional modules, including ones on mortality, in mobile phone surveys conducted in LMICs.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"38 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140925065","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2024-02-23DOI: 10.1177/1525822x241231479
Judith Glaesser
{"title":"Case-to-Condition Ratios in Qualitative Comparative Analysis: Adding Cases Instead of Removing Conditions","authors":"Judith Glaesser","doi":"10.1177/1525822x241231479","DOIUrl":"https://doi.org/10.1177/1525822x241231479","url":null,"abstract":"In qualitative comparative analysis, as with all methods, there is a question about how many cases are needed to make an analysis robust. In deciding on the number of cases, a key consideration is the number of conditions to be analyzed. I suggest that adding cases is preferable to dropping conditions if there are too many conditions relative to the number of cases. I first consider the relationship of low n and limited diversity, followed by an exploration of two scenarios: (1) cases in the study are the universe; (2) more cases could exist. I suggest that a simple rule or benchmark on how many cases to include in relation to the number of conditions is unlikely to be helpful since this depends at least in part on the goals and circumstances of the research. Finally, this issue is not confined to QCA but affects all types of research.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"65 1","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-02-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139955672","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Field MethodsPub Date : 2024-01-08DOI: 10.1177/1525822x231218192
Jennifer C. Davidson, D. Karadzhov, Graham Wilson
{"title":"Short Take: Designing a Multinational Smartphone App Survey during COVID-19: Rewards, Risks, and Recommendations","authors":"Jennifer C. Davidson, D. Karadzhov, Graham Wilson","doi":"10.1177/1525822x231218192","DOIUrl":"https://doi.org/10.1177/1525822x231218192","url":null,"abstract":"Cost-effective and user-friendly, mobile phone-assisted methods have remained underutilized in qualitative social science research. The scarce methodological guidance, together with recruitment and ethical challenges, has arguably stifled advancements in this area. COVID-19 exposed the need to better equip researchers with the expertise and tools to conduct remote research effectively. In 2020, we designed and launched a smartphone survey application to collect real-time data from children’s sector professionals across the globe regarding best practices in, and challenges to, responding to the pandemic. In this short article, we reflect on the efficiency, quality, and acceptability afforded by the smartphone app survey, and outline recommendations for enhancing rigor and feasibility. We also present data snippets illustrating the positive impact of participation on respondents—a seldom-documented aspect of app-based research. Altogether, we advocate a flexible, pragmatic, and user-centered study and app design that aligns with respondents’ specific, situational needs, and preferences.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"16 5","pages":""},"PeriodicalIF":1.7,"publicationDate":"2024-01-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139445728","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}