{"title":"Attendance, Completion, and Heterogeneous Returns to College: A Causal Mediation Approach","authors":"Xiang Zhou","doi":"10.1177/00491241221113876","DOIUrl":"https://doi.org/10.1177/00491241221113876","url":null,"abstract":"A growing body of social science research investigates whether the economic payoff to a college education is heterogeneous — in particular, whether disadvantaged youth can benefit more from attending and completing college relative to their more advantaged peers. Scholars, however, have employed different analytical strategies and reported mixed findings. To shed light on this literature, I propose a causal mediation approach to conceptualizing, evaluating, and unpacking the causal effects of college on earnings. By decomposing the total effect of attending a four-year college into several direct and indirect components, this approach not only clarifies the mechanisms through which college attendance boosts earnings, but illuminates the ways in which the postsecondary system may be both an equalizer and a stratifier. The total effect of college attendance, its direct and indirect components, and their heterogeneity across different subpopulations are all identified under the assumption of sequential ignorability. I introduce a debiased machine learning (DML) method for estimating all quantities of interest, along with a set of bias formulas for sensitivity analysis. I illustrate the proposed framework and methodology using data from the National Longitudinal Survey of Youth, 1997 cohort.","PeriodicalId":286027,"journal":{"name":"Sociological Methods & Research","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125552892","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Assessing the Impact of the Great Recession on the Transition to Adulthood","authors":"Guanglei Hong, Ha-Joon Chung","doi":"10.1177/00491241221113871","DOIUrl":"https://doi.org/10.1177/00491241221113871","url":null,"abstract":"The impact of a major historical event on child and youth development has been of great interest in the study of the life course. This study is focused on assessing the causal effect of the Great Recession on youth disconnection from school and work. Building on the insights offered by the age-period-cohort research, econometric methods, and developmental psychology, we innovatively develop a causal inference strategy that takes advantage of the multiple successive birth cohorts in the National Longitudinal Study of Youth 1997. The causal effect of the Great Recession is defined in terms of counterfactual developmental trajectories and can be identified under the assumption of short-term stable differences between the birth cohorts in the absence of the Great Recession. A meta-analysis aggregates the estimated effects over six between-cohort comparisons. Furthermore, we conduct a sensitivity analysis to assess the potential consequences if the identification assumption is violated. The findings contribute new evidence on how precipitous and pervasive economic hardship may disrupt youth development by gender and class of origin.","PeriodicalId":286027,"journal":{"name":"Sociological Methods & Research","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129413591","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Additional Effects of Adaptive Survey Design Beyond Post-Survey Adjustment: An Experimental Evaluation","authors":"Shiyu Zhang, J. Wagner","doi":"10.1177/00491241221099550","DOIUrl":"https://doi.org/10.1177/00491241221099550","url":null,"abstract":"Adaptive survey design refers to using targeted procedures to recruit different sampled cases. This technique strives to reduce bias and variance of survey estimates by trying to recruit a larger and more balanced set of respondents. However, it is not well understood how adaptive design can improve data and survey estimates beyond the well-established post-survey adjustment. This paper reports the results of an experiment that evaluated the additional effect of adaptive design to post-survey adjustments. The experiment was conducted in the Detroit Metro Area Communities Study in 2021. We evaluated the adaptive design in five outcomes: 1) response rates, 2) demographic composition of respondents, 3) bias and variance of key survey estimates, 4) changes in significant results of regression models, and 5) costs. The most significant benefit of the adaptive design was its ability to generate more efficient survey estimates with smaller variances and smaller design effects.","PeriodicalId":286027,"journal":{"name":"Sociological Methods & Research","volume":"119 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116616610","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Do Quantitative and Qualitative Research Reflect two Distinct Cultures? An Empirical Analysis of 180 Articles Suggests “no”","authors":"D. Kuehn, I. Rohlfing","doi":"10.1177/00491241221082597","DOIUrl":"https://doi.org/10.1177/00491241221082597","url":null,"abstract":"The debate about the characteristics and advantages of quantitative and qualitative methods is decades old. In their seminal monograph, A Tale of Two Cultures (2012 , ATTC), Gary Goertz and James Mahoney argue that methods and research design practices for causal inference can be distinguished as two cultures that systematically differ from each other along 25 specific characteristics. ATTC’s stated goal is a description of empirical patterns in quantitative and qualitative research. Yet, it does not include a systematic empirical evaluation as to whether the 25 are relevant and valid descriptors of applied research. In this paper, we derive five observable implications from ATTC and test the implications against a stratified random sample of 90 qualitative and 90 quantitative articles published in six journals between 1990–2012. Our analysis provides little support for the two-cultures hypothesis. Quantitative methods are largely implemented as described in ATTC, whereas qualitative methods are much more diverse than ATTC suggests. While some practices do indeed conform to the qualitative culture, many others are implemented in a manner that ATTC characterizes as constitutive of the quantitative culture. We find very little evidence for ATTC's anchoring of qualitative research with set-theoretic approaches to empirical social science research. The set-theoretic template only applies to a fraction of the qualitative research that we reviewed, with the majority of qualitative work incorporating different method choices.","PeriodicalId":286027,"journal":{"name":"Sociological Methods & Research","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-03-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127178378","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Sequential On-Device Multitasking within Online Surveys: A Data Quality and Response Behavior Perspective","authors":"Jean Philippe Décieux","doi":"10.1177/00491241221082593","DOIUrl":"https://doi.org/10.1177/00491241221082593","url":null,"abstract":"The risk of multitasking is high in online surveys. However, knowledge on the effects of multitasking on answer quality is sparse and based on suboptimal approaches. Research reports inconclusive results concerning the consequences of multitasking on task performance. However, studies suggest that especially sequential-multitasking activities are expected to be critical. Therefore, this study focusses on sequential-on-device-multitasking activities (SODM) and its consequences for data quality. Based on probability-based data, this study aims to reveal the prevalence of SODM based on the javascript function OnBlur, to reflect the its determinants and to examine the consequences for data quality. Results show that SODM was detected for 25% of all respondents and that respondent attributes and the device used to answer the survey are related to SODM. Moreover, it becomes apparent that SODM is significantly correlated to data quality measures. Therefore, I propose SODM behavior as a new instrument for researching suboptimal response behavior.","PeriodicalId":286027,"journal":{"name":"Sociological Methods & Research","volume":"59 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-03-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129964727","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Iteration in Mixed-Methods Research Designs Combining Experiments and Fieldwork,","authors":"Verónica Pérez Bentancur, Lucía Tiscornia","doi":"10.1177/00491241221082595","DOIUrl":"https://doi.org/10.1177/00491241221082595","url":null,"abstract":"Experimental designs in the social sciences have received increasing attention due to their power to produce causal inferences. Nevertheless, experimental research faces limitations, including limited external validity and unrealistic treatments. We propose combining qualitative fieldwork and experimental design iteratively—moving back-and-forth between elements of a research design—to overcome these limitations. To properly evaluate the strength of experiments researchers need information about the context, data, and previous knowledge used to design the treatment. To support our argument, we analyze 338 pre-analysis plans submitted to the Evidence in Governance and Politics repository in 2019 and the design of a study on public opinion support for punitive policing practices in Montevideo, Uruguay. The paper provides insights about using qualitative fieldwork to enhance the external validity, transparency and replicability of experimental research, and a practical guide for researchers who want to incorporate iteration to their research designs.","PeriodicalId":286027,"journal":{"name":"Sociological Methods & Research","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-03-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122282041","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Social Encounters and the Worlds Beyond: Putting Situationalism to Work for Qualitative Interviews","authors":"Anders Vassenden, Marte Mangset","doi":"10.1177/00491241221082609","DOIUrl":"https://doi.org/10.1177/00491241221082609","url":null,"abstract":"In Goffman's terms, qualitative interviews are social encounters with their own realities. Hence, the ‘situational critique’ holds that interviews cannot produce knowledge about the world beyond these encounters, and that other methods, ethnography in particular, render lived life more accurately. The situational critique cannot be dismissed; yet interviewing remains an indispensable sociological tool. This paper demonstrates the value that situationalism holds for interviewing. We examine seemingly contradictory findings from interview studies of middle-class identity (cultural hierarchies and/or egalitarianism?). We then render these contradictions comprehensible by interpreting data excerpts through ‘methodological situationalism’: Goffman's theories of interaction order, ritual, and frontstage/backstage. In ‘situationalist interviewing,’ we suggest that sociologists be attentive to the ‘imagined audiences’ and ‘imagined communities’. These are key to identifying the situations, interaction orders, and cultural repertoires that lie beyond the interview encounter, but to which it refers. In sum, we argue for greater situational awareness among sociologists who must rely on interviews. We also discuss techniques and measures that can facilitate situational awareness. A promise of situational interviewing is that it helps us make sense of contradictions, ambiguities, and disagreements within and between interviews.","PeriodicalId":286027,"journal":{"name":"Sociological Methods & Research","volume":"144 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-03-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122917996","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Improving estimates accuracy of voter transitions. Two new algorithms for ecological inference based on linear programming","authors":"J. Pavía, Rafael Romero","doi":"10.31124/advance.14716638.v1","DOIUrl":"https://doi.org/10.31124/advance.14716638.v1","url":null,"abstract":"The\u0000estimation of RxC ecological inference contingency tables from aggregate data\u0000defines one of the most salient and challenging problems in the field of quantitative\u0000social sciences. From\u0000the mathematical programming framework, this paper suggests a new direction for\u0000tackling this problem. For the first time in the literature, a procedure based\u0000on linear programming is proposed to attain estimates of local contingency\u0000tables. Based on this and the homogeneity hypothesis, we suggest two new\u0000ecological inference algorithms. These two new algorithms represent an\u0000important step forward in the ecological inference mathematical programming\u0000literature. In addition to generating estimates for local ecological inference\u0000contingency tables and amending the tendency to produce extreme transfer\u0000probability estimates previously observed in other mathematical programming\u0000procedures, they prove to be quite competitive and more accurate than the current\u0000linear programming baseline algorithm. The new algorithms place the linear\u0000programming approach once again in a prominent position in the ecological\u0000inference toolkit. We use a unique dataset with almost 500 elections, where the\u0000real transfer matrices are known, to assess their accuracy. Interested readers\u0000can easily use these new algorithms with the aid of the R package lphom.","PeriodicalId":286027,"journal":{"name":"Sociological Methods & Research","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127063309","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Image Clustering: An Unsupervised Approach to Categorize Visual Data in Social Science Research","authors":"Han Zhang, Yilang Peng","doi":"10.31235/osf.io/mw57x","DOIUrl":"https://doi.org/10.31235/osf.io/mw57x","url":null,"abstract":"Automated image analysis has received increasing attention in social scientific research, yet existing scholarship has focused on the application of supervised machine learning to classify images into predefined categories. This study focuses on the task of unsupervised image clustering, which automatically finds categories from image data. First, we review the steps to perform image clustering, and then we focus on the key challenge of performing unsupervised image clustering---finding low-dimensional representations of images. We present several methods of extracting low-dimensional representations of images, including the traditional bag-of-visual-words model, self-supervised learning, and transfer learning. We compare these methods using two datasets containing images related to protests in China (from Sina Weibo, Chinese Twitter) and to climate change(from Instagram). Results show that transfer learning significantly outperforms other methods. The dataset used in the pretrained model critically determines what categories algorithms can discover.","PeriodicalId":286027,"journal":{"name":"Sociological Methods & Research","volume":"138 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114445350","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Measuring Class Hierarchies in Postindustrial Societies: A criterion and construct validation of EGP and ESEC across 31 countries","authors":"Oscar Smallenbroek, Forian R. Hertel, C. Barone","doi":"10.31235/osf.io/gwt8b","DOIUrl":"https://doi.org/10.31235/osf.io/gwt8b","url":null,"abstract":"In social stratification research, the most frequently used social class schema are based on employment relations (EGP and ESEC). These schemes have been propelled to paradigms for research on social mobility and educational inequalities and applied in cross-national research for both genders. Using the European Working Conditions Survey, we examine their criterion and construct validity across 31 countries and for both genders. We investigate whether classes are well-delineated by the theoretically assumed dimensions of employment relations and we assess how several measures of occupational advantage differ across classes. We find broad similarity in the criterion validity of EGP and ESEC across genders and countries as well as satisfactory levels of construct validity. However, the salariat classes are too heterogeneous and their boundaries with the intermediate classes are blurred. To improve the measurement of social class, we propose to differentiate managerial and professional occupations within the lower and higher salariat respectively. We show that implementing these distinctions in ESEC and EGP improves their criterion validity and allows to better identify privileged positions.","PeriodicalId":286027,"journal":{"name":"Sociological Methods & Research","volume":"66 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132044691","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}