The Essential Role of Language in Survey Research最新文献

Pretesting Methods in Cross-Cultural Research 跨文化研究中的预测试方法

The Essential Role of Language in Survey Research Pub Date : 2020-04-30 DOI: 10.3768/rtipress.bk.0023.2004.7

E. Aizpurua

{"title":"Pretesting Methods in Cross-Cultural Research","authors":"E. Aizpurua","doi":"10.3768/rtipress.bk.0023.2004.7","DOIUrl":"https://doi.org/10.3768/rtipress.bk.0023.2004.7","url":null,"abstract":"Introduction In recent years, substantial advances have been made in the field of multinational, multiregional, and multicultural research (commonly referred to as 3MC survey research; Johnson, Pennell, Stoop, & Dorer, 2018). This research magnifies challenges associated with monocultural studies and poses unique ones at both the organizational and methodological levels. Because cross-cultural surveys seek to make comparative estimates across populations, the data must be valid and reliable for each specific group, as well as comparable across them. Even when questionnaires are carefully translated and adapted, groups may systematically differ in the way they interpret certain questions or respond to them, posing a threat to the validity of the comparisons. In this context, pretesting becomes particularly beneficial to identify potential problems in survey questions and to assess comparability (Willis, 2015). This chapter introduces the concept and importance of pretesting in cross-cultural survey research. The most common methods used to pretest 3MC surveys are described, highlighting recent applications and developments, as well as current challenges. These methods include crosscultural cognitive interviewing, online probing, vignettes, and behavior coding. Next, reference is made to the combination of multiple pretesting methods to assess and improve cross-cultural surveys. In the last section of this chapter, the main challenges and opportunities of pretesting in comparative contexts are discussed.","PeriodicalId":424313,"journal":{"name":"The Essential Role of Language in Survey Research","volume":"95 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127242659","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

The Effect of Language of Survey Administration on the Response Formation Process 调查管理语言对回应形成过程的影响

The Essential Role of Language in Survey Research Pub Date : 2020-04-30 DOI: 10.3768/rtipress.bk.0023.2004.1

Emilia Peytcheva

{"title":"The Effect of Language of Survey Administration on the Response Formation Process","authors":"Emilia Peytcheva","doi":"10.3768/rtipress.bk.0023.2004.1","DOIUrl":"https://doi.org/10.3768/rtipress.bk.0023.2004.1","url":null,"abstract":"Introduction With the increasing number of people of multiple cultural backgrounds in modern societies, surveys of ethnic minorities and immigrants are becoming more common. One obvious source of measurement differences is the necessary use of different languages when intending to measure the same phenomena in multiple ethnocultural groups. Typically, surveys allow respondents to answer in the language of their choice, possibly introducing self-selection bias to the extent to which those who choose their mother tongue differ in background characteristics (e.g., level of acculturation, education), substantive answers, and response patterns (e.g., “don’t know” responses) from those who choose the mainstream language. However, although self-selection certainly plays a role in differences observed across the different language versions of a survey, it is premature to consider it the sole source of all observed differences. There is a known link between language and cognition (e.g., Whorf, 1956). To study language influences on the response formation process in surveys, we need to assert that the various language versions of a survey are free of translation problems and convey the same constructs. Thus, any observed differences between responses provided by the same respondent in different languages can be attributed to language priming a particular mind frame and influencing the thought processes. To examine the potential effects of language on survey responses, we focus on the response formation model (Sudman, Bradburn, & Schwarz, 1996; Tourangeau, Rips, & Rasinski, 2000). The right-hand side of Figure 1-1 presents the tasks that respondents perform to answer a survey question: attending to the question and response options (comprehension), retrieving the necessary information (retrieval and judgment), assessing the","PeriodicalId":424313,"journal":{"name":"The Essential Role of Language in Survey Research","volume":"73 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126148840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

Language Differences Between Interviewers and Respondents in African Surveys 非洲调查中采访者和被调查者的语言差异

The Essential Role of Language in Survey Research Pub Date : 2020-04-30 DOI: 10.3768/rtipress.bk.0023.2004.5

B. Piper, Luis Sevilla-Kreysa, S. Eckman, Charles Q. Lau

{"title":"Language Differences Between Interviewers and Respondents in African Surveys","authors":"B. Piper, Luis Sevilla-Kreysa, S. Eckman, Charles Q. Lau","doi":"10.3768/rtipress.bk.0023.2004.5","DOIUrl":"https://doi.org/10.3768/rtipress.bk.0023.2004.5","url":null,"abstract":"Introduction In face-to-face surveys, the survey language has important implications for data quality. Linguistic issues are particularly relevant in Africa because of its linguistic diversity and complexity. Combined, there are over 2,000 African languages, more than 30 percent of the world’s languages (Eberhard, Simons, & Fennig, 2019). Although there are some relatively linguistically homogeneous countries (e.g., predominantly Arabic-speaking countries in Northern Africa), most countries have a complex, multilingual structure. Many Africans are multilingual: 61 percent of Kenyan adults, for example, speak three or more languages (Logan, 2017). There are also different types of languages. People may grow up speaking the language of their tribe or local community but often learn languages of broader communication in school (for brevity, we refer to these languages as “local languages” and “broader languages”). These broader languages may be African (e.g., Swahili) or Western (e.g., English or French) and are often used in mass media, government communications, and workplaces (Bodomo, 1996). Although both local and broader languages are used to communicate, local languages tend to be used more for verbal communication, whereas broader languages are typically used for written communication. The linguistic diversity in Africa presents several challenges for face-to-face surveys. Survey language can lead to undercoverage if the survey is not offered in a language the respondents speak (Andreenkova, 2018). Language also can shape the respondents’ cultural and cognitive frames, affecting the response formation process (see Chapter 1). In this chapter, we focus on another challenge: problems that arise if respondents or data collectors are CHAPTER 5","PeriodicalId":424313,"journal":{"name":"The Essential Role of Language in Survey Research","volume":"67 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115946547","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Cross-Cultural Comparison of Focus Groups as a Research Method 焦点小组的跨文化比较研究方法

The Essential Role of Language in Survey Research Pub Date : 2020-04-30 DOI: 10.3768/rtipress.bk.0023.2004.8

Jennifer Kim, Hyunjoo Park, Yuling Pan, M. Sha

{"title":"Cross-Cultural Comparison of Focus Groups as a Research Method","authors":"Jennifer Kim, Hyunjoo Park, Yuling Pan, M. Sha","doi":"10.3768/rtipress.bk.0023.2004.8","DOIUrl":"https://doi.org/10.3768/rtipress.bk.0023.2004.8","url":null,"abstract":"Introduction The validity of inferences drawn from focus groups rests on the verbal interaction between the focus group moderator and participants. When the focus group method is applied to research studies conducted in languages other than English, researchers need to make cultural and linguistic adaptations appropriate for the target population to maximize the effectiveness of the focus groups. However, there is a scarcity of research literature examining how focus groups perform in non-English languages, especially in Asian languages. Prior studies on the use of focus groups in cross-cultural research have centered on cultural sensitivity issues, procedures, planning, practicalities, and logistics (e.g., Colucci, 2008). As Clarke (1999) pointed out, the assumption underpinning the focus group method is that individuals are valuable sources of information and can express their own feelings and behaviors. It follows that focus group participants must verbally express their thoughts and behaviors; thus, the use of language plays a central role in focus group discussions. Although the research includes extensive discussion of methodological issues related to applying focus groups in non-English speaking cultures (Halcomb, Gholizadeh, DiGiacomo, Phillips, & Davidson, 2007), it lacks a systematic investigation to compare how speakers of different languages express their views and opinions in focus groups using those languages. Because focus groups use guided group discussions to gain insight into a specific topic, it is critical to examine the extent to which focus group participants engage in the discussion through verbal expression.","PeriodicalId":424313,"journal":{"name":"The Essential Role of Language in Survey Research","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130808625","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0