Sociological Methods & Research最新文献

筛选
英文 中文
Machine Bias. How Do Generative Language Models Answer Opinion Polls? 机器的偏见。生成语言模型如何回答民意调查?
IF 6.3 2区 社会学
Sociological Methods & Research Pub Date : 2025-04-21 DOI: 10.1177/00491241251330582
Julien Boelaert, Samuel Coavoux, Étienne Ollion, Ivaylo Petev, Patrick Präg
{"title":"Machine Bias. How Do Generative Language Models Answer Opinion Polls?","authors":"Julien Boelaert, Samuel Coavoux, Étienne Ollion, Ivaylo Petev, Patrick Präg","doi":"10.1177/00491241251330582","DOIUrl":"https://doi.org/10.1177/00491241251330582","url":null,"abstract":"Generative artificial intelligence (AI) is increasingly presented as a potential substitute for humans, including as research subjects. However, there is no scientific consensus on how closely these in silico clones can emulate survey respondents. While some defend the use of these “synthetic users,” others point toward social biases in the responses provided by large language models (LLMs). In this article, we demonstrate that these critics are right to be wary of using generative AI to emulate respondents, but probably not for the right reasons. Our results show (i) that to date, models cannot replace research subjects for opinion or attitudinal research; (ii) that they display a strong bias and a low variance on each topic; and (iii) that this bias randomly varies from one topic to the next. We label this pattern “machine bias,” a concept we define, and whose consequences for LLM-based research we further explore.","PeriodicalId":21849,"journal":{"name":"Sociological Methods & Research","volume":"37 1","pages":""},"PeriodicalIF":6.3,"publicationDate":"2025-04-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143853640","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Insight-Inference Loop: Efficient Text Classification via Natural Language Inference and Threshold-Tuning 洞察-推理循环:基于自然语言推理和阈值调优的高效文本分类
IF 6.3 2区 社会学
Sociological Methods & Research Pub Date : 2025-04-19 DOI: 10.1177/00491241251326819
Sandrine Chausson, Marion Fourcade, David J. Harding, Björn Ross, Grégory Renard
{"title":"The Insight-Inference Loop: Efficient Text Classification via Natural Language Inference and Threshold-Tuning","authors":"Sandrine Chausson, Marion Fourcade, David J. Harding, Björn Ross, Grégory Renard","doi":"10.1177/00491241251326819","DOIUrl":"https://doi.org/10.1177/00491241251326819","url":null,"abstract":"Modern computational text classification methods have brought social scientists tantalizingly close to the goal of unlocking vast insights buried in text data—from centuries of historical documents to streams of social media posts. Yet three barriers still stand in the way: the tedious labor of manual text annotation, the technical complexity that keeps these tools out of reach for many researchers, and, perhaps most critically, the challenge of bridging the gap between sophisticated algorithms and the deep theoretical understanding social scientists have already developed about human interactions, social structures, and institutions. To counter these limitations, we propose an approach to large-scale text analysis that requires substantially less human-labeled data, and no machine learning expertise, and efficiently integrates the social scientist into critical steps in the workflow. This approach, which allows the detection of statements in text, relies on large language models pre-trained for natural language inference, and a “few-shot” threshold-tuning algorithm rooted in active learning principles. We describe and showcase our approach by analyzing tweets collected during the 2020 U.S. presidential election campaign, and benchmark it against various computational approaches across three datasets.","PeriodicalId":21849,"journal":{"name":"Sociological Methods & Research","volume":"1 1","pages":""},"PeriodicalIF":6.3,"publicationDate":"2025-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143851025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Locating Cultural Holes Brokers in Diffusion Dynamics Across Bright Symbolic Boundaries 在跨越明亮符号边界的扩散动力学中定位文化漏洞经纪人
IF 6.3 2区 社会学
Sociological Methods & Research Pub Date : 2025-03-19 DOI: 10.1177/00491241251322517
Diego F. Leal
{"title":"Locating Cultural Holes Brokers in Diffusion Dynamics Across Bright Symbolic Boundaries","authors":"Diego F. Leal","doi":"10.1177/00491241251322517","DOIUrl":"https://doi.org/10.1177/00491241251322517","url":null,"abstract":"Although the literature on cultural holes has expanded considerably in recent years, there is no concrete measure in that literature to locate cultural holes brokers. This article develops a conceptual framework grounded in social network theory and cultural sociology to propose a specific solution to fill this measurement gap. Agent-based computational experiments are leveraged to develop a theoretical test of the analytic purchase and distinctiveness of the proposed measure, termed potential for intercultural brokerage (PIB). Results demonstrate the effectiveness of PIB in locating early adopters that can achieve widespread levels of diffusion in societies segregated along bright symbolic boundaries. Findings also show the superiority of PIB when compared to classic alternative measures in the network literature that focus on locating early adopters based on structural holes (e.g., network constraint, effective size), geodesics (e.g., betweenness centrality), and degree (e.g., degree centrality), among other classic network measures. Broader implications of these findings for brokerage theory are discussed herein.","PeriodicalId":21849,"journal":{"name":"Sociological Methods & Research","volume":"19 1","pages":""},"PeriodicalIF":6.3,"publicationDate":"2025-03-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143661168","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep Learning With DAGs 利用 DAG 进行深度学习
IF 6.3 2区 社会学
Sociological Methods & Research Pub Date : 2025-03-12 DOI: 10.1177/00491241251319291
Sourabh Balgi, Adel Daoud, Jose M. Peña, Geoffrey T. Wodtke, Jesse Zhou
{"title":"Deep Learning With DAGs","authors":"Sourabh Balgi, Adel Daoud, Jose M. Peña, Geoffrey T. Wodtke, Jesse Zhou","doi":"10.1177/00491241251319291","DOIUrl":"https://doi.org/10.1177/00491241251319291","url":null,"abstract":"Social science theories often postulate systems of causal relationships among variables, which are commonly represented using directed acyclic graphs (DAGs). As non-parametric causal models, DAGs require no assumptions about the functional form of the hypothesized relationships. Nevertheless, to simplify empirical evaluation, researchers typically invoke such assumptions anyway, even though they are often arbitrary and do not reflect any theoretical content or prior knowledge. Moreover, functional form assumptions can engender bias, whenever they fail to accurately capture the true complexity of the system. In this article, we introduce causal-graphical normalizing flows (cGNFs), a novel approach to causal inference that leverages deep neural networks to empirically evaluate theories represented as DAGs. Unlike conventional methods, cGNFs model the full joint distribution of the data using a DAG specified by the analyst, without relying on stringent assumptions about functional form. This enables flexible, non-parametric estimation of any causal estimand identified from the DAG, including total effects, direct and indirect effects, and path-specific effects. We illustrate the method with a reanalysis of Blau and Duncan’s ( <jats:xref ref-type=\"bibr\">1967</jats:xref> ) model of status attainment and Zhou’s ( <jats:xref ref-type=\"bibr\">2019</jats:xref> ) model of controlled mobility. The article concludes with a discussion of current limitations and directions for future development.","PeriodicalId":21849,"journal":{"name":"Sociological Methods & Research","volume":"11 1","pages":""},"PeriodicalIF":6.3,"publicationDate":"2025-03-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143608045","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
When to Use Counterfactuals in Causal Historiography: Methods for Semantics and Inference 在因果史学中何时使用反事实:语义学和推理方法
IF 6.3 2区 社会学
Sociological Methods & Research Pub Date : 2025-02-03 DOI: 10.1177/00491241251314039
Tay Jeong
{"title":"When to Use Counterfactuals in Causal Historiography: Methods for Semantics and Inference","authors":"Tay Jeong","doi":"10.1177/00491241251314039","DOIUrl":"https://doi.org/10.1177/00491241251314039","url":null,"abstract":"According to the interventionist framework of actual causality, causal claims in history are ultimately claims about special types of functional dependencies between variables, which consist not only of actual events but also of corresponding counterfactual states of affairs. Instead of advocating the methodological use of counterfactuals tout court, we propose specific circumstances in historical writing where counterfactual reasoning comes in most handy. At the level of semantics, that is, the specification of the variables and their possible values, an explicit specification of the latent contrast classes becomes particularly useful in situations where one may be prompted to take an event that is pre-empted by the antecedent of interest as its proper causal contrast. At the level of inference, we argue that cases in which two or more antecedents appear to be playing a similar role tend to fumble our pretheoretical intuition about cause and propose a sequence of counterfactual tests based on actual examples from causal historiography.","PeriodicalId":21849,"journal":{"name":"Sociological Methods & Research","volume":"10 1","pages":""},"PeriodicalIF":6.3,"publicationDate":"2025-02-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143084171","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Integration of Bayesian Regression Analysis and Bayesian Process Tracing in Mixed-Methods Research 混合方法研究中贝叶斯回归分析与贝叶斯过程跟踪的集成
IF 6.3 2区 社会学
Sociological Methods & Research Pub Date : 2025-01-23 DOI: 10.1177/00491241241295336
Lion Behrens, Ingo Rohlfing
{"title":"The Integration of Bayesian Regression Analysis and Bayesian Process Tracing in Mixed-Methods Research","authors":"Lion Behrens, Ingo Rohlfing","doi":"10.1177/00491241241295336","DOIUrl":"https://doi.org/10.1177/00491241241295336","url":null,"abstract":"In this article, we develop a mixed-methods design that combines Bayesian regression with Bayesian process tracing. A fully Bayesian multimethod design allows one to include empirical knowledge at each stage of the analysis and to coherently transfer information from the quantitative to the qualitative analysis, and vice versa. We present a complete mixed-methods workflow explaining how this is accomplished and how to integrate both methods. It is demonstrated how to use the posterior highest density interval and the Bayes factor from the regression analysis to update the prior level of confidence about what mechanisms possibly connect the cause to the outcome. It is further shown how to choose cases for the qualitative analysis through posterior predictive sampling. We illustrate this approach with an empirical analysis of colonial development and compare it with alternative designs, including nested analysis and the Bayesian integration of qualitative and quantitative methods.","PeriodicalId":21849,"journal":{"name":"Sociological Methods & Research","volume":"12 1","pages":""},"PeriodicalIF":6.3,"publicationDate":"2025-01-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143026628","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improving Cross-Cultural Comparability of Measures on Gender and Age Stereotypes by Means of Piloting Methods 通过试点方法提高性别和年龄刻板印象测量的跨文化可比性
IF 6.3 2区 社会学
Sociological Methods & Research Pub Date : 2025-01-21 DOI: 10.1177/00491241241307600
Natalja Menold, Patricia Hadler, Cornelia Neuert
{"title":"Improving Cross-Cultural Comparability of Measures on Gender and Age Stereotypes by Means of Piloting Methods","authors":"Natalja Menold, Patricia Hadler, Cornelia Neuert","doi":"10.1177/00491241241307600","DOIUrl":"https://doi.org/10.1177/00491241241307600","url":null,"abstract":"The study addresses the effects of piloting methods on the cross-cultural comparability and reliability of the measurement of gender and age stereotypes. We conducted a summative evaluation of expert reviews, cognitive pretests and web probing. We first piloted a gender role, an ageism, and a children stereotypes instrument in German and American English. We then randomly assigned the original and piloted versions to respondents in Germany and the United States using an online survey experiment and quota samples. No configural invariance was shown by the original instruments and the reliability of the gender role instrument was insufficiently low. The results show that piloting methods increased reliability and improved measurement invariance, although the effects varied by topic. Cross-cultural expert reviews and web probing provided more consistent results than other methods. A combination of web probing and cross-cultural expert reviews can maximize both reliability and measurement invariance.","PeriodicalId":21849,"journal":{"name":"Sociological Methods & Research","volume":"105 1","pages":""},"PeriodicalIF":6.3,"publicationDate":"2025-01-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142991933","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Rise in Occupational Coding Mismatches and Occupational Mobility, 1991–2020 1991-2020 年职业编码错配和职业流动性的上升
IF 6.3 2区 社会学
Sociological Methods & Research Pub Date : 2025-01-16 DOI: 10.1177/00491241241303517
Andrew Taeho Kim, ChangHwan Kim
{"title":"The Rise in Occupational Coding Mismatches and Occupational Mobility, 1991–2020","authors":"Andrew Taeho Kim, ChangHwan Kim","doi":"10.1177/00491241241303517","DOIUrl":"https://doi.org/10.1177/00491241241303517","url":null,"abstract":"Occupation is a construct prone to classification mismatches by coders and description inconsistency by respondents. We explore whether mismatches in occupational coding have recently increased, what factors are associated with the rise in mismatches, and how the rise affects estimates of intragenerational occupational mobility. Utilizing the 1991–2020 Annual Social and Economic Supplement of the Current Population Survey, which collects information on respondents’ current occupation and the previous year’s main occupation, we identify coding mismatches and compare the probabilities of occupational mobility based on four combinations of two variables. Our results show that not only do the estimates of occupational mobility between two adjacent years vary substantially across measures, but also that the magnitudes of intragenerational occupational mobility across measures become increasingly decoupled over time. We demonstrate that the likely cause of this divergence is the rise in coding mismatches between coders. We discuss the implications of our findings.","PeriodicalId":21849,"journal":{"name":"Sociological Methods & Research","volume":"30 1","pages":""},"PeriodicalIF":6.3,"publicationDate":"2025-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142986720","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using Google Maps to Generate Organizational Sampling Frames 使用谷歌地图生成组织采样帧
IF 6.3 2区 社会学
Sociological Methods & Research Pub Date : 2025-01-16 DOI: 10.1177/00491241241305095
Brad R Fulton, David P King
{"title":"Using Google Maps to Generate Organizational Sampling Frames","authors":"Brad R Fulton, David P King","doi":"10.1177/00491241241305095","DOIUrl":"https://doi.org/10.1177/00491241241305095","url":null,"abstract":"Organizational researchers use a variety of methods to obtain sampling frames. The utility of these methods, however, is constrained by access restrictions, limited coverage, prohibitive costs, and cumbersome formats. This article presents a new method for generating organizational sampling frames that is cost-effective, uses publicly available data, and can produce sampling frames for many geographic areas in the U.S. The Python-based program we developed systematically scans the Google Maps platform to identify organizations of interest and retrieve their contact information. We demonstrate the program's viability and utility by generating a sampling frame of religious congregations in the U.S. To assess Google Maps’ coverage and representativeness of such congregations, we examined two nationally representative samples of congregations and censuses of congregations in a small, medium, and large city. We found that Google Maps contains approximately 98% of those congregations––extensive coverage that ensures a high degree of representativeness. This study provides evidence that using Google Maps to generate sampling frames can improve the process for obtaining representative samples for organizational studies by reducing costs, increasing efficiency, and providing greater coverage and representativeness.","PeriodicalId":21849,"journal":{"name":"Sociological Methods & Research","volume":"38 1","pages":""},"PeriodicalIF":6.3,"publicationDate":"2025-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142986727","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Examining Variation in Survey Costs Across Surveys 检查不同调查中调查成本的差异
IF 6.3 2区 社会学
Sociological Methods & Research Pub Date : 2024-12-05 DOI: 10.1177/00491241241298914
Kristen Olson, John Stevenson, Nadia Assad, Lindsey Witt-Swanson, Cameron P.E. Jones, Amanda Ganshert, Jennifer Dykema
{"title":"Examining Variation in Survey Costs Across Surveys","authors":"Kristen Olson, John Stevenson, Nadia Assad, Lindsey Witt-Swanson, Cameron P.E. Jones, Amanda Ganshert, Jennifer Dykema","doi":"10.1177/00491241241298914","DOIUrl":"https://doi.org/10.1177/00491241241298914","url":null,"abstract":"Self-administered surveys may be administered with a single mode or mixed data collection modes. How mixing modes of data collection affects survey costs is not well understood. We examine whether cost structures differ for mail-only versus web+mail mixed-mode surveys, what design features are associated with costs, and whether survey costs are associated with response rates. Using administrative survey cost data from two academic survey centers, we find that survey costs per sampled unit and per complete vary substantially across individual surveys. The average cost per sampled unit is surprisingly similar across mail-only and web+mail surveys. How the budget is allocated across printing, postage, incentive, and staff time varies across these designs: printing and postage costs are higher in mail-only surveys, and more of the budget is allocated to incentive costs and project management costs in web+mail surveys. Furthermore, higher cost surveys are associated with higher response rates, particularly for incentive costs.","PeriodicalId":21849,"journal":{"name":"Sociological Methods & Research","volume":"1 1","pages":""},"PeriodicalIF":6.3,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142789908","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书