{"title":"How to Reconstruct a Trend when Survey Questions Have Changed Over Time.","authors":"T. Jonge, Akiko Kamesaka, R. Veenhoven","doi":"10.18148/SRM/2021.V15I1.7725","DOIUrl":"https://doi.org/10.18148/SRM/2021.V15I1.7725","url":null,"abstract":"Many trend studies draw on survey data and compare responses to questions on the same topic that has been asked over time. A problem with such studies is that the questions often do not remain identical, due to changes in phrasing and response formats. We present ways to deal with this problem using trend data on life satisfaction in Japan as an illustrative case. Life satisfaction has been measured in the Life in Nation survey in Japan since 1958 and the question used has been changed several times. We looked at three methods published by scholars who tried to reconstruct a main trend in life satisfaction from these broken time-series, coming to different conclusions. In this paper we discuss their methods and present two new techniques for dealing with changes in survey questions on the same topic.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"15 1","pages":"101-113"},"PeriodicalIF":4.8,"publicationDate":"2021-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42254915","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Have You Ever Seen the Rain? It Looks Like It's Going to Rain!","authors":"R. Becker","doi":"10.18148/SRM/2021.V15I1.7782","DOIUrl":"https://doi.org/10.18148/SRM/2021.V15I1.7782","url":null,"abstract":"This empirical study examines, whether the weather situations during the different seasons in which panel surveys are carried out have an impact on the timing and extent of survey participation. Based on considerations regarding the panellists’ habits and their assessment of a participation's benefits and costs compared to alternative action, it is assumed that ‘pleasant’ weather diverts them from immediately completing the questionnaire while ‘unpleasant’ weather results in a higher degree of participation right after survey launch. The results of event history analysis based on longitudinal data from a multi-wave panel confirm these assumptions. Additionally, there seems to be an interaction between the season and the weather situation: ‘Pleasant’ weather in spring results in a lower participation rate compared to surveys in summer while, given the same weather situation, the participation rate is higher in autumn. Finally, it is evident that regardless of the season, heavy rainfall at the beginning of the field period is most beneficial for conducting an online survey in terms of both rapid response and high participation rates.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"15 1","pages":"27-41"},"PeriodicalIF":4.8,"publicationDate":"2021-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48920501","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Recent Methodological Advances in Panel Data Collection, Analysis, and Application:","authors":"Tobias Wolbring, S. Zinn","doi":"10.18148/SRM/2021.V15I1.7902","DOIUrl":"https://doi.org/10.18148/SRM/2021.V15I1.7902","url":null,"abstract":"SRM wants to publish a Special Issue on \"Recent Methodological Advances in Panel Data Collection, Analysis, and Application\". This call for papers expands on the papers searched and the policies used.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"15 1","pages":""},"PeriodicalIF":4.8,"publicationDate":"2021-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43790428","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Comparability of Measures in the Ageism Module of the Fourth Round of the European Social Survey, 2008-2009","authors":"Daniel Seddig, D. Maskileyson, E. Davidov","doi":"10.18148/SRM/2020.V14I4.7369","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I4.7369","url":null,"abstract":"Age is an important dimension that is used by people to categorize others. Age-based discrimination is directed toward specific age groups (young and old). In spite of their importance, attitudes toward the elderly have hardly been studied from a cross-country perspective. The fourth round of the European Social Survey (ESS) from 2008-2009 offers, for the first time, the opportunity to study ageism and attitudes toward age groups from a cross-country perspective (European Social Survey Round 4 Data, 2008). However, this opportunity also bears the risk of drawing wrong conclusions, if the scales measuring ageism are not comparable across the countries under study. Such comparisons require measurement equivalence across countries. In the current study, utilizing ESS fourth round data from 29 European countries we examine the cross-country measurement equivalence properties of two concepts that are measured by multiple indicators in the module: (1) competence and warmth and (2) experience of age discrimination. We test for measurement equivalence using two analytical methods: multi-group confirmatory factor analysis (MGCFA) and the alignment optimization. Our findings suggest that cross-country comparisons of these measures are trustworthy. We briefly discuss cross-country differences in competence and warmth and experience of age discrimination. Finally, we underline the importance of testing the cross-group equivalence of measurement instruments before using them in different groups (such as countries) so that meaningful substantive conclusions can be drawn.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"351-364"},"PeriodicalIF":4.8,"publicationDate":"2020-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45117803","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Measurement Equivalence of Subjective Well-Being Scales under the Presence of Acquiescent Response Style for the Racially and Ethnically Diverse Older Population in the United States","authors":"Sunghee Lee, E. Vásquez, L. Ryan, Jacqui Smith","doi":"10.18148/SRM/2020.V14I4.7413","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I4.7413","url":null,"abstract":"Objectives. While valid assessment of subjective well-being (SWB) is at the forefront of ageing research, literature increasingly reports cross-cultural measurement invariance on scales designed to capture SWB. This study examines measurement properties of well-established SWB scales and their comparability between older Hispanics and Whites in the US. Methods. We examined measurement properties of the satisfaction with life (SWL), purpose in life (PIL)and positive affect (PAF) scales using multigroup confirmatory factor analysis (CFA) and multigroup hierarchical CFA on three subgroups in the Health and Retirement Study: non-Hispanic Whites, Hispanics interviewed in English and Hispanics interviewed in Spanish. We also examined acquiescence response style in measurement invariance testing. Results. SWL was the only scale that provided reasonable measurement invariance. However, it lacked comparability in its measurement validity, with much lower validity for Hispanics than Whites. Measurement invariance was observed lower across all models when fitted on the data restricted to respondents with a tendency to acquiesce than the counterpart. Discussion. Our analysis offers evidence that the traditional measurement invariance test is not effective under the presence of response style for measurement instruments that use the Likert-type response scales. Research into cross-cultural differences in conceptualization of SWB and methodology to measure SWB is likely to improve our ability to accurately understand SWB with the increasingly diverse population.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"417-437"},"PeriodicalIF":4.8,"publicationDate":"2020-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45428510","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Revisiting the Middleton Alienation Scale: In Search of a Cross-Culturally Valid Instrument","authors":"Ekaterina I. Lytkina","doi":"10.18148/SRM/2020.V14I4.7421","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I4.7421","url":null,"abstract":"The article contributes to the issue how to deal with measurement non-variance. I address a well-established scale by Middleton (1963) which was created to measure alienation. However, unlike commonly treated in literature, there is evidence that the scale is two-dimensional, and consists of the measures of anomie and alienation. I use the data from two datasets, where the scale was most recently applied, World Values Survey (2011), and Euromodule (1999-2002), for a set of diverse countries representing Western, post-communist, and Eastern societies. The datasets are analyzed separately. Results of confirmatory factor analysis followed by multigroup comparisons give evidence that for a set of countries the two-dimensional scale is applicable or preferable. Full measurement invariance is reached for Russia and Kazakhstan in the World Values Survey, and Slovenia, Switzerland, Germany, Austria, Turkey, and South Korea in the Euromodule. Approximate measurement invariance using Bayesian statistics enabled to reach approximate scalar invariance in Russia and Kazakhstan in the World Values Survey and in Slovenia, and Switzerland in the Euromodule dataset. Additionally, to be sure that the two dimensions are indeed distinct, I used a set of indicators to predict each of the factors.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"365-397"},"PeriodicalIF":4.8,"publicationDate":"2020-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45622289","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Investigating the Relative Impact of Different Sources of Measurement Non-Equivalence in Comparative Surveys. An Illustration with Scale Format, Data Collection Mode and Cross-National Variations","authors":"C. Roberts, Oriane Sarrasin, M. E. Staehli","doi":"10.18148/SRM/2020.V14I4.7416","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I4.7416","url":null,"abstract":"Different factors are known to affect the comparability of multinational, multicultural and multiregional (‘3MC’) survey data. These include factors relevant to the design of the questionnaire in different contexts (such as cultural differences in how a concept is understood, inaccurate or approximate translations of concepts, and variant adaptations to question formats). Others include factors relating to the survey design in general and how it is implemented across contexts (such as sample design, choice of mode(s), and contact strategies). Together, they contribute item, method and construct biases that can affect the invariance of composite measures. While research to date has looked at the effects of these factors on measurement invariance individually, there have been few attempts to compare them directly and assess their relative impact. To illustrate how this can be done, the present paper tests for measurement invariance in a subjective wellbeing measure across question formats, modes, languages, and countries, combining European Social Survey data from designed and natural experiments (resulting from the use of variant question formulations and translations) from Germany, Switzerland and France. Overall, we find translation errors, language and culture to be bigger sources of non-equivalence than question format and mode. The findings have implications for both survey designers making decisions about optimal resource allocation in the design of 3MC studies, as well as for comparative analysts interested in comparing countries with shared languages and interpreting cross-group differences.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"399-415"},"PeriodicalIF":4.8,"publicationDate":"2020-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43346034","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Valid vs. Invalid Straightlining: The Complex Relationship Between Straightlining and Data Quality","authors":"K. Reuning, E. Plutzer","doi":"10.18148/SRM/2020.V14I5.7641","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I5.7641","url":null,"abstract":"Straightlining – the tendency to give the same response to a series of grouped questions – can be the result of satisficing respondents. As a result, many survey practitioners use straightlining as one, and sometimes the only, indicator of data quality. Respondents identified as straightliners are often removed from the data set on the assumption that their answers are meaningless. In this paper we show that these practices are based on a logical fallacy and demonstrate that in many common survey formats, the incidence of straightlining can be increased by improving the validity and the reliability of survey questions. We take initial steps in investigating the complexities and challenges of data analysis by providing a formal definition of valid straightlining and leverage that definition in a series of Monte Carlo simulations to better understand the conditions that give rise to valid straightlining. Although it remains for future work to distinguish valid from invalid straightliners, our formal definition of the concept and our simulation methods augment the tools survey analysts employ in assessing the prevalence of low effort respondents in survey data sets. The paper thereby takes initial steps toward sounder methods of classifying straightliners as optimizers or satisficers.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"439-459"},"PeriodicalIF":4.8,"publicationDate":"2020-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47079818","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Caputo, M. Dańko, H. Brønnum-Hansen, A. Oksuzyan
{"title":"Helpful Reminders? Health Survey Participation and Doctor’s Visits among Aging Adults","authors":"J. Caputo, M. Dańko, H. Brønnum-Hansen, A. Oksuzyan","doi":"10.18148/SRM/2020.V14I5.7642","DOIUrl":"https://doi.org/10.18148/SRM/2020.V14I5.7642","url":null,"abstract":"Objectives: Longitudinal surveys are an important source of information about the health of aging populations. While there is growing concern about how participating in these studies affects participants, assessments of survey participation effects on objectively measured behaviors are scarce. \u0000Methods: We used register-linked data from the Danish component of the Survey of Health, Aging and Retirement in Europe, a rotating, biennial panel survey of adults aged 50+, to assess whether survey participation is associated with changes in self-reported and actual doctor’s visits. New respondents were added during the second wave, allowing us to compare doctor’s visits between groups who entered the survey at different times. \u0000Results: Age-related increases in neither self-reported nor register-recorded doctor’s visits significantly differed between the two rotating samples. \u0000Discussion: Our findings add to literature about survey participation effects, suggesting that they may not be present for either self-reported or objective measures of this important health behavior.","PeriodicalId":46454,"journal":{"name":"Survey Research Methods","volume":"14 1","pages":"487-497"},"PeriodicalIF":4.8,"publicationDate":"2020-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48614771","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}