发布求助
文献互助 智能选刊 最新文献

Field Methods最新文献

筛选
英文 中文
Comparing Readability Measures and Computer‐assisted Question Evaluation Tools for Self‐administered Survey Questions 自我管理调查问题的可读性测量和计算机辅助问题评估工具的比较
IF 1.7 3区 社会学
Field Methods Pub Date : 2022-10-14 DOI: 10.1177/1525822x221124469
Rachel Stenger, Kristen Olson, Jolene D Smyth
{"title":"Comparing Readability Measures and Computer‐assisted Question Evaluation Tools for Self‐administered Survey Questions","authors":"Rachel Stenger, Kristen Olson, Jolene D Smyth","doi":"10.1177/1525822x221124469","DOIUrl":"https://doi.org/10.1177/1525822x221124469","url":null,"abstract":"Questionnaire designers use readability measures to ensure that questions can be understood by the target population. The most common measure is the Flesch-Kincaid Grade level, but other formulas exist. This article compares six different readability measures across 150 questions in a self-administered questionnaire, finding notable variation in calculated readability across measures. Some question formats, including those that are part of a battery, require important decisions that have large effects on the estimated readability of survey items. Other question evaluation tools, such as the Question Understanding Aid (QUAID) and the Survey Quality Predictor (SQP), may identify similar problems in questions, making readability measures less useful. We find little overlap between QUAID, SQP, and the readability measures, and little differentiation in the tools’ prediction of item nonresponse rates. Questionnaire designers are encouraged to use multiple question evaluation tools and develop readability measures specifically for survey questions.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":" ","pages":""},"PeriodicalIF":1.7,"publicationDate":"2022-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42385232","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Can Recall Data Be Trusted? Evaluating Reliability of Interview Data on Traditional Multilingualism in Highland Daghestan 召回数据是否可信？达赫斯坦高原传统多语采访数据的可靠性评价
IF 1.7 3区 社会学
Field Methods Pub Date : 2022-10-01 DOI: 10.1177/1525822X221115844
Michael Daniel, Alexey Koshevoy, I. Schurov, N. Dobrushina
{"title":"Can Recall Data Be Trusted? Evaluating Reliability of Interview Data on Traditional Multilingualism in Highland Daghestan","authors":"Michael Daniel, Alexey Koshevoy, I. Schurov, N. Dobrushina","doi":"10.1177/1525822X221115844","DOIUrl":"https://doi.org/10.1177/1525822X221115844","url":null,"abstract":"In this article, we address the issue of reliability of quantitative data on multilingualism of the past obtained as recall data. More specifically, we investigate whether the interviewees’ assessments of the language repertoires of their late relatives (indirect data) provide results that are quantitatively similar to those obtained from the people of the same age range themselves (direct data). The empirical data we use come from an ongoing field study of traditional multilingualism in Daghestan (Russia). We trained machine learning models to see whether they can detect differences in indirect and direct data. We conclude that our indirect quantitative data on L2 other than Russian are essentially similar to direct data, while there may be a small but systematic underestimation when reporting others’ knowledge of Russian.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"34 1","pages":"288 - 302"},"PeriodicalIF":1.7,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48799728","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
The Issue of Noncompliance in Attention Check Questions: False Positives in Instructed Response Items 注意检查问题的不服从问题:指示反应项目的误报
IF 1.7 3区 社会学
Field Methods Pub Date : 2022-09-30 DOI: 10.1177/1525822X221115830
Henning Silber, Joss Roßmann, Tobias Gummer
{"title":"The Issue of Noncompliance in Attention Check Questions: False Positives in Instructed Response Items","authors":"Henning Silber, Joss Roßmann, Tobias Gummer","doi":"10.1177/1525822X221115830","DOIUrl":"https://doi.org/10.1177/1525822X221115830","url":null,"abstract":"Attention checks detect inattentiveness by instructing respondents to perform a specific task. However, while respondents may correctly process the task, they may choose to not comply with the instructions. We investigated the issue of noncompliance in attention checks in two web surveys. In Study 1, we measured respondents’ attitudes toward attention checks and their self-reported compliance. In Study 2, we experimentally varied the reasons given to respondents for conducting the attention check. Our results showed that while most respondents understand why attention checks are conducted, a nonnegligible proportion of respondents evaluated them as controlling or annoying. Most respondents passed the attention check; however, among those who failed the test, 61% seem to have failed the task deliberately. These findings reinforce that noncompliance is a serious concern with attention check instruments. The results of our experiment showed that more respondents passed the attention check if a comprehensible reason was given.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"34 1","pages":"346 - 360"},"PeriodicalIF":1.7,"publicationDate":"2022-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47430637","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
A Comparison of Three Designs for List-style Open-ended Questions in Web Surveys 三种网络调查问卷开放式问题设计的比较
IF 1.7 3区 社会学
Field Methods Pub Date : 2022-09-29 DOI: 10.1177/1525822X221115831
Tanja Kunz, Katharina Meitinger
{"title":"A Comparison of Three Designs for List-style Open-ended Questions in Web Surveys","authors":"Tanja Kunz, Katharina Meitinger","doi":"10.1177/1525822X221115831","DOIUrl":"https://doi.org/10.1177/1525822X221115831","url":null,"abstract":"Although list-style open-ended questions generally help us gain deeper insights into respondents’ thoughts, opinions, and behaviors, the quality of responses is often compromised. We tested a dynamic and a follow-up design to motivate respondents to give higher quality responses than with a static design, but without overburdening them. Our results showed that a follow-up design achieved longer responses with more themes and theme areas than a static design. In contrast, the dynamic design produced the shortest answers with the fewest themes and theme areas. No differences in item nonresponse and only minor differences in additional response burden were found among the three list-style designs. Our study shows that design features and timing are crucial to clarify the desired response format and motivate respondents to give high-quality answers to list-style open-ended questions.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"34 1","pages":"303 - 317"},"PeriodicalIF":1.7,"publicationDate":"2022-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41497024","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Conditional Pop-up Reminders Reduce Incidence of Rounding in Web Surveys 有条件的弹出提醒减少了网络调查中舍入的发生率
IF 1.7 3区 社会学
Field Methods Pub Date : 2022-09-29 DOI: 10.1177/1525822X221115829
Rainer Schnell, Sarah Redlich, A. Göritz
{"title":"Conditional Pop-up Reminders Reduce Incidence of Rounding in Web Surveys","authors":"Rainer Schnell, Sarah Redlich, A. Göritz","doi":"10.1177/1525822X221115829","DOIUrl":"https://doi.org/10.1177/1525822X221115829","url":null,"abstract":"Frequency of behaviors or amounts of variables of interest are essential topics in many surveys. The use of heuristics might cause rounded answers, resulting in the increased occurrence of end-digits (called heaping or digit-preference). For web surveys (or CASI), we propose using a conditional prompt as input validation if digits indicating heaping are entered. We report an experiment, where respondents in an online access panel (n = 2,590) were randomly assigned to one of three groups: (1) no input validation; (2) conditional input validation if rounding was presumed; and (3) input validation every time a numerical value was entered. Conditional input validation reduces heaping for variables with high proportions of heaped values. Unconditional input validation seems to be less effective.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"34 1","pages":"334 - 345"},"PeriodicalIF":1.7,"publicationDate":"2022-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48387016","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Critical Approach to Interviewing Academic Elites: Access, Trust, and Power 采访学术精英的关键方法:接触、信任和权力
IF 1.7 3区 社会学
Field Methods Pub Date : 2022-09-27 DOI: 10.1177/1525822X221114226
Yali Liu, L. Buckingham
{"title":"A Critical Approach to Interviewing Academic Elites: Access, Trust, and Power","authors":"Yali Liu, L. Buckingham","doi":"10.1177/1525822X221114226","DOIUrl":"https://doi.org/10.1177/1525822X221114226","url":null,"abstract":"To date, research on elite interviews has primarily focused on political or business settings in European and Anglo-American contexts. In this study, we examine the procedures involved in conducting elite interviews in academic settings, drawing on fieldwork with 53 senior scholars at 10 universities across five regions of northern China. We provide a detailed, critically reflective account of strategies to gain access, develop trust, and manage the power imbalance. Our account reveals the importance of the researcher’s professional identity in gaining participants’ trust and determining adequate forms of reciprocity.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"35 1","pages":"236 - 252"},"PeriodicalIF":1.7,"publicationDate":"2022-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43521189","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Devil Is in the Details: A Randomized Experiment Assessing the Effect of Providing Examples in a Survey Question across Countries 细节决定成败:一项随机实验，评估在各国调查问题中提供例子的效果
IF 1.7 3区 社会学
Field Methods Pub Date : 2022-09-16 DOI: 10.1177/1525822X221115506
E. Aizpurua, Gianmaria Bottoni, R. Fitzgerald
{"title":"The Devil Is in the Details: A Randomized Experiment Assessing the Effect of Providing Examples in a Survey Question across Countries","authors":"E. Aizpurua, Gianmaria Bottoni, R. Fitzgerald","doi":"10.1177/1525822X221115506","DOIUrl":"https://doi.org/10.1177/1525822X221115506","url":null,"abstract":"Despite the widespread use of examples in survey questions, very few studies have examined their impact on survey responses, and the evidence is mainly based on data collected in the United States using questionnaires in English. This study builds on previous research by examining the effects of providing examples using data from a cross-national probability-based web panel implemented in Estonia (n = 730), Great Britain (n = 685), and Slovenia (n = 529) during Round 8 of the European Social Survey (2017/18). Respondents were randomly assigned a survey question measuring confidence in social media using Facebook and Twitter as examples, or another condition in which no examples were offered. The results show that confidence in social media was significantly lower in the example condition, although the effect size was small. Confidence in social media varied across countries, and the effect of providing examples was heterogeneous across countries and education levels. The implications of these findings are discussed.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"35 1","pages":"198 - 218"},"PeriodicalIF":1.7,"publicationDate":"2022-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46631737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improving Sampling Probability Definitions with Predictive Algorithms 用预测算法改进采样概率定义
IF 1.7 3区 社会学
Field Methods Pub Date : 2022-09-15 DOI: 10.1177/1525822X221113181
Matthew Jannetti, A. Carroll-Scott, Erikka Gilliam, Irene E. Headen, Maggie Beverly, F. Lê-Scherban
{"title":"Improving Sampling Probability Definitions with Predictive Algorithms","authors":"Matthew Jannetti, A. Carroll-Scott, Erikka Gilliam, Irene E. Headen, Maggie Beverly, F. Lê-Scherban","doi":"10.1177/1525822X221113181","DOIUrl":"https://doi.org/10.1177/1525822X221113181","url":null,"abstract":"Place-based initiatives often use resident surveys to inform and evaluate interventions. Sampling based on well-defined sampling frames is important but challenging for initiatives that target subpopulations. Databases that enumerate total population counts can produce overinclusive sampling frames, resulting in costly outreach to ineligible participants. Quantifying eligibility before sampling using machine learning algorithms can improve efficiency and reduce costs. We developed a model to improve sampling for the West Philly Promise Neighborhood’s biennial population-representative survey of households with children within a geographic footprint. This study proposes a method to estimate probability of study eligibility by building a well-calibrated predictive model using existing administrative data sources. Six machine-learning models were evaluated; logistic regression provided the best balance of accuracy and understandable probabilities. This approach can be a blueprint for other population-based studies whose sampling frames cannot be well defined using traditional sources.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"35 1","pages":"137 - 152"},"PeriodicalIF":1.7,"publicationDate":"2022-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47100891","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Effects of Question Characteristics on Item Nonresponse in Telephone and Web Survey Modes 电话和网络调查模式中问题特征对项目无应答的影响
IF 1.7 3区 社会学
Field Methods Pub Date : 2022-08-28 DOI: 10.1177/1525822X221115838
O. Lipps, Gian-Andrea Monsch
{"title":"Effects of Question Characteristics on Item Nonresponse in Telephone and Web Survey Modes","authors":"O. Lipps, Gian-Andrea Monsch","doi":"10.1177/1525822X221115838","DOIUrl":"https://doi.org/10.1177/1525822X221115838","url":null,"abstract":"Telephone surveys face more and more criticism because of decreasing coverage and increasing costs, and the risk of producing socially desirable answers. Consequently, survey administrators consider switching their surveys to the web mode, although the web mode is more susceptible to item nonresponse. Still, we do not know whether this is true for all question types. In this article, we analyze to what extent item nonresponse depends on question characteristics such as their form or difficulty in the telephone and the web mode. We use data from an experiment in which individuals randomly sampled from a population register are experimentally assigned to these two modes. Distinguishing effects on the frequency of don’t know responses, item refusals, and mid-scale responding, we find more don’t know responses and item refusals for the web mode generally, but no differences for mid-scale responding. However, this relationship depends on the characteristics of the question.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"34 1","pages":"318 - 333"},"PeriodicalIF":1.7,"publicationDate":"2022-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42100080","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Ethnographic Methods for Identifying Cultural Concepts of Distress: Developing Reliable and Valid Measures 识别遇险文化概念的民族志方法：制定可靠有效的措施
IF 1.7 3区 社会学
Field Methods Pub Date : 2022-08-04 DOI: 10.1177/1525822X221113178
Jeffrey G. Snodgrass, A. Brewis, H. Dengah, W. Dressler, B. Kaiser, B. Kohrt, Emily Mendenhall, Seth Sagstetter, L. Weaver, K. X. Zhao
{"title":"Ethnographic Methods for Identifying Cultural Concepts of Distress: Developing Reliable and Valid Measures","authors":"Jeffrey G. Snodgrass, A. Brewis, H. Dengah, W. Dressler, B. Kaiser, B. Kohrt, Emily Mendenhall, Seth Sagstetter, L. Weaver, K. X. Zhao","doi":"10.1177/1525822X221113178","DOIUrl":"https://doi.org/10.1177/1525822X221113178","url":null,"abstract":"We review ethnographic methods that allow researchers to assess distress in a culturally sensitive manner. We begin with an overview of standardized biomedical and psychological approaches to assessing distress cross-culturally. We then focus on literature describing the development of reliable and valid culturally sensitive assessment tools that can serve as complements or alternatives to biomedical categories and diagnostic frameworks. The methods we describe are useful in identifying forms of suffering—expressed in culturally salient idioms of distress—that might be misidentified by biomedical classifications. We highlight the utility of a cognitive anthropological theoretical approach for developing measures that attend to local cultural categories of knowledge and experience. Attending to cultural insider perspectives is necessary because expressions of distress, thresholds of tolerance for distress, expectations about stress inherent in life, conceptions of the good life, symptom expression, and modes of help-seeking vary across cultures.","PeriodicalId":48060,"journal":{"name":"Field Methods","volume":"35 1","pages":"175 - 197"},"PeriodicalIF":1.7,"publicationDate":"2022-08-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45451889","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
首页 上一页 下一页 尾页
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整，为了账户安全，请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们：info@booksci.cn Book学术提供免费学术资源搜索服务，方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号：481959085
Book学术官方微信