Leah von der Heyde, Anna-Carolina Haensch, Alexander Wenz
{"title":"Vox Populi, Vox AI? Using Large Language Models to Estimate German Vote Choice","authors":"Leah von der Heyde, Anna-Carolina Haensch, Alexander Wenz","doi":"10.1177/08944393251337014","DOIUrl":"https://doi.org/10.1177/08944393251337014","url":null,"abstract":"“Synthetic samples” generated by large language models (LLMs) have been argued to complement or replace traditional surveys, assuming their training data is grounded in human-generated data that potentially reflects attitudes and behaviors prevalent in the population. Initial US-based studies that have prompted LLMs to mimic survey respondents found that the responses match survey data. However, the relationship between the respective target population and LLM training data might affect the generalizability of such findings. In this paper, we critically evaluate the use of LLMs for public opinion research in a different context, by investigating whether LLMs can estimate vote choice in Germany. We generate a synthetic sample matching the 2017 German Longitudinal Election Study respondents and ask the LLM GPT-3.5 to predict each respondent’s vote choice. Comparing these predictions to the survey-based estimates on the aggregate and subgroup levels, we find that GPT-3.5 exhibits a bias towards the Green and Left parties. While the LLM predictions capture the tendencies of “typical” voters, they miss more complex factors of vote choice. By examining the LLM-based prediction of voting behavior in a non-English speaking context, our study contributes to research on the extent to which LLMs can be leveraged for studying public opinion. The findings point to disparities in opinion representation in LLMs and underscore the limitations in applying them for public opinion estimation.","PeriodicalId":49509,"journal":{"name":"Social Science Computer Review","volume":"26 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2025-04-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143878112","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lingnuo Wang, Guicheng Shi, Jon D. Elhai, Song Zhou, Yiqing Zeng, Lei Zheng
{"title":"Problematic use of short-video apps among elderly adults: An extension of the TAM","authors":"Lingnuo Wang, Guicheng Shi, Jon D. Elhai, Song Zhou, Yiqing Zeng, Lei Zheng","doi":"10.1177/08944393251338400","DOIUrl":"https://doi.org/10.1177/08944393251338400","url":null,"abstract":"Short-form videos have become a dominant form of social media globally. While short-video apps are popular among adolescents, their ease-of-use has also attracted a growing number of elderly users. However, this accessibility can lead to problematic use, resulting in physical and mental health issues for this demographic. Therefore, our research employed the technology acceptance model (TAM) to understand the problematic use of short-video apps (PUSVA) among elderly adults. 281 elderly adults completed a three-wave survey with a 1-month interval between waves. Results showed that both perceived utilitarian-usefulness and perceived hedonic-usefulness mediated the relationship between perceived ease-of-use and PUSVA, suggesting a double-edged sword effect of ease-to-use short-video apps. Moreover, perceived susceptibility moderated the relationship between perceived ease-of-use and perceived utilitarian-usefulness, but not between perceived ease-of-use and perceived hedonic-usefulness, suggesting a moderated mediation effect of perceived susceptibility on PUSVA. Specifically, elderly adults with low perceived susceptibility tended to report higher perceived utilitarian-usefulness for easy-to-use applications, while no relationship between perceived ease-of-use and perceived utilitarian-usefulness was observed among those with high perceived susceptibility. Our findings highlight the double-edged sword effect of user-friendly short-video apps and offer valuable insights for developing interventions to mitigate problematic use among elderly adults.","PeriodicalId":49509,"journal":{"name":"Social Science Computer Review","volume":"9 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2025-04-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143875878","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Social Media Made Me Do It: Perceptions of Social Media Influence, Risky Behaviors, and Mental Health Among Adolescents","authors":"Robert S. Weisskirch","doi":"10.1177/08944393251337016","DOIUrl":"https://doi.org/10.1177/08944393251337016","url":null,"abstract":"Adolescents may perceive that social media exert influence on their beliefs, attitudes, and behaviors. Past research has found that frequent social media use and fear of missing out have related to risk behavior and poor mental health outcomes. Little research has been conducted on the perception of influence of social media by adolescents on mental health outcomes and risky behavior engagement. In this study, 304 adolescents (female = 210 and male = 94) completed an online questionnaire about their use of social media, perceptions of social media influence, fear of missing out, engagement in risky behavior, and depressive and anxiety symptoms. Age, perceptions of social media influence, and fear of missing out were significant predictors of engaging in risky behaviors. Age, being female, perceptions of social media influence, and fear of missing out predicted anxiety symptoms. Being female, perceptions of social media influence, and fear of missing out predicted depressive symptoms. For adolescents, the influence of social media on mental health outcomes and risky behaviors may be based on their perception of influence of social media and fear of missing out rather than just frequency of use.","PeriodicalId":49509,"journal":{"name":"Social Science Computer Review","volume":"4 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2025-04-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143875823","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Timilehin Durotoye, Manuel Goyanes, Rosa Berganza, Homero Gil de Zúñiga
{"title":"Online and Social Media Political Participation: Political Discussion Network Ties and Differential Social Media Platform Effects Over Time","authors":"Timilehin Durotoye, Manuel Goyanes, Rosa Berganza, Homero Gil de Zúñiga","doi":"10.1177/08944393251332640","DOIUrl":"https://doi.org/10.1177/08944393251332640","url":null,"abstract":"Prior research has largely documented the overall mobilizing effects of social media news consumption and political discussion linked to citizens’ political participatory behaviors. However, limited empirical research has considered the informational and communicative effects to be contingent upon different social media platforms. Therefore, this study advances distinct theoretical affordances and effects of social media news use on online (by using online versions of legacy media outlets, blogs, and news apps) and social media political participation. Taking advantage of US comparative panel data, ordinary least squares (OLS) causal autoregressive regressions and panel autoregressive structural equation model tests cast a much-needed light on the diverse effects of Facebook, X, Snapchat, WhatsApp, Instagram, YouTube, and Reddit use for news over both political discussions with weak and strong ties, and political participation online and in social media. Moreover, results from two-step algorithmic cluster analysis clarify how these social media platforms generate different information and political behavior clusters of citizens, which also provide a comparative view of how social media platforms differently contribute to people’s public and political life in US democracy.","PeriodicalId":49509,"journal":{"name":"Social Science Computer Review","volume":"37 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2025-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143849603","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Minority-Owned, Claimed Status, and Profile Attributes of Businesses on Google Maps: COVID-19 Pandemic Survival","authors":"Gi Woong Yun, Sung-Yeon Park","doi":"10.1177/08944393251333365","DOIUrl":"https://doi.org/10.1177/08944393251333365","url":null,"abstract":"Theoretical frameworks Resource-Based View (RBV) and competitive advantages have served as conceptual foundations for investigating the role of Google Maps in business success. This research has two key findings: First, an analysis of a dataset obtained by scraping local business information from Google Maps ( <jats:italic>N</jats:italic> = 9,445) shows that minority-owned businesses were less likely to be claimed on Google Maps and received fewer consumer review comments compared to their non-minority counterparts. Second, a comparison of Google Maps data collected before the outbreak of the COVID-19 pandemic in 2019 and follow-up data gathered in 2022 reveals higher survival rates among businesses that were claimed, utilized business attributes, or had more reviews. Together, these findings suggest that a stronger presence on Google Maps contributed to competitive advantages and business survival during the pandemic. This underscores the importance of Google Maps presence for the survival of businesses during a crisis.","PeriodicalId":49509,"journal":{"name":"Social Science Computer Review","volume":"122 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2025-04-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143832266","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Mar Castillo-Campos, David Becerra-Alonso, Hajo G. Boomgaarden
{"title":"Automated Detection of Media Bias Using Artificial Intelligence and Natural Language Processing: A Systematic Review","authors":"Mar Castillo-Campos, David Becerra-Alonso, Hajo G. Boomgaarden","doi":"10.1177/08944393251331510","DOIUrl":"https://doi.org/10.1177/08944393251331510","url":null,"abstract":"Media bias has long been a subject of scholarly interest due to its potential to shape public perceptions and behaviors. This systematic review leverages advances in natural language processing (NLP) to explore automated methods to detect media bias, addressing five core questions: it examines the definitions and operationalization of media bias, explores the NLP tasks addressed for its detection, the technologies used, and their respective outcomes and applied findings. This review also examines the practical applications of these methodologies and assesses the patterns, implications, and limitations associated with using artificial intelligence for media bias detection. Analyzing peer-reviewed articles from 2019 to 2023, the review initially identified 519 articles, which ultimately included 28 relevant ones. Significant heterogeneity is observed in bias definitions, affecting the analysis and detection approaches. The review highlights the predominant use of some methods and identifies challenges such as inconsistencies in problem definition, outcome measurement, and comparative method evaluation. Regardless of the conceptualizations of bias and the methods used, studies consistently identify bias in media outlets. Thus, studying media bias remains necessary for raising awareness and detection, and NLP methods are significant allies in this endeavor. This research aims to consolidate the foundations of recent advances in NLP for bias detection, encouraging researchers to focus on developing transparent, task-specific tools and work toward a consensus on a technical definition of bias and standardized metrics for its evaluation.","PeriodicalId":49509,"journal":{"name":"Social Science Computer Review","volume":"38 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2025-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143782658","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Electoral Forecasting in Volatile Party System Settings: Assessing and Improving Pre-Election Poll Predictions in Italy","authors":"Kenneth Bunker","doi":"10.1177/08944393251328309","DOIUrl":"https://doi.org/10.1177/08944393251328309","url":null,"abstract":"This study examines electoral forecasting in volatile party systems, focusing on factors contributing to deviations between poll predictions and actual election outcomes. Using Italy as a case study, it identifies biases in polling data and proposes a method to enhance estimator accuracy in a context of stable institutions and volatile electoral dynamics. Data from three Italian general elections are analyzed to evaluate discrepancies between pre-electoral polls and results, assessing key factors such as timing of data collection, survey methodology, sample size, and party system fragmentation. Employing a Bayesian inference process via a Markov chain Monte Carlo (MCMC) adaptive Metropolis-Hastings (MH) algorithm, the study demonstrates that pre-electoral estimates can be significantly improved using the Two-Stage Model (TSM). By consistently outperforming traditional poll predictions, the TSM offers a robust framework for addressing polling biases. These findings advance political forecasting by improving accuracy in both consolidated democracies and volatile electoral contexts, while emphasizing the need for future research on dynamic polling methods and fundamentals-based models.","PeriodicalId":49509,"journal":{"name":"Social Science Computer Review","volume":"183 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2025-03-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143695280","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Steve Randerson, Thomas Graydon-Guy, En-Yi Lin, Sally Casswell
{"title":"Exploring the Use of a Large Language Model for Inductive Content Analysis in a Discourse Network Analysis Study","authors":"Steve Randerson, Thomas Graydon-Guy, En-Yi Lin, Sally Casswell","doi":"10.1177/08944393251326175","DOIUrl":"https://doi.org/10.1177/08944393251326175","url":null,"abstract":"Large language models show promising capability in some qualitative content analysis tasks; however, research reporting their performance in identifying initial codes that underpin subsequent analysis is scarce. This paper explores the suitability of GPT-4 to assist in building a codebook for a discourse network analysis (DNA) of a recent alcohol policy reform. DNA is a codebook-driven approach to identifying groupings of actors who use similar policy framings. The paper uses GPT-4 to identify initial codes (‘concepts’) and related quotes in 108 news articles and interviews. The results produced by GPT-4 are compared to a codebook prepared by researchers. GPT-4 identified over two-thirds of the concepts found by the researchers, and it was highly accurate in screening out a large volume of irrelevant media items. However, GPT-4 also provided many irrelevant concepts that required researcher review and removal. The discussion reflects on the implications for using GPT-4 in codebook preparation for DNA and other situations, including the need for human involvement and sample testing to understand its strengths and limitations, which may limit efficiency gains.","PeriodicalId":49509,"journal":{"name":"Social Science Computer Review","volume":"56 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2025-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143627418","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Response Times and Self-Reporting: Response Patterns Across Countries and World Regions Using Data From a Large Scale Computer-Based Assessment","authors":"Hana Vonkova, Ondrej Papajoanu, Martin Bosko","doi":"10.1177/08944393251322160","DOIUrl":"https://doi.org/10.1177/08944393251322160","url":null,"abstract":"Understanding reporting behavior in questionnaires is a key issue in enhancing cross-national data comparability and policy decisions. Computers help improve the analysis of careless or insufficient effort (C/IE) responding by logging response times and other response behavior, ensuring data quality. We introduce a response-time based approach, built on an analysis of the relationship between a survey item and a related external variable, to cross-national research. Using PISA 2015 data from 58 countries/economies, we analyze patterns of correlations between the enjoyment of science and science test scores across response time. We focus on C/IE responding towards the beginning of the response time spectrum. Results indicate rather diligent responding in Eastern Asia and a part of Northern Europe. Yet in other regions (e.g., part of Latin America and the Caribbean, and Eastern Europe), C/IE responding might be distorting the data. We provide other researchers with information regarding when and to what extent C/IE responding can occur across countries. We enhance the understanding of heterogeneity in reporting behavior across countries.","PeriodicalId":49509,"journal":{"name":"Social Science Computer Review","volume":"37 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2025-02-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143528373","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Anything but Politics: Connectedness in Networked Social Groups for Addressing Prejudice","authors":"Brandon C. Bouchillon","doi":"10.1177/08944393251320059","DOIUrl":"https://doi.org/10.1177/08944393251320059","url":null,"abstract":"Research indicates that prejudice has been growing in America. Citizens feel increasingly threatened by immigrants, and hate crimes against immigrant groups have risen. Declining interpersonal contact has also made it more difficult to address prejudice directly. This study examines whether nonpolitical social media groups can foster connections that reduce prejudice. These groups allow users to connect on the basis of shared interests, enabling diverse individuals to form close relationships which may improve attitudes toward immigrants. Using a national web survey matched to U.S. Census percentages for sex, race, ethnicity, age, and region of residence ( N = 1500), along with a two-wave panel conducted over six weeks ( N = 752), results indicate that blatant prejudice is more prevalent than subtle prejudice. Respondents were more likely to feel threatened by immigrants than to withhold positive emotions from them. As a remedy, social connectedness in nonpolitical groups was associated with diminished blatant prejudice and lower levels of global prejudice, a measure that includes both subtle and blatant components. Findings suggest that feeling connected with different people remotely can improve attitudes toward racial and ethnic diversity, helping individuals feel less threatened by immigrants and less prejudiced overall.","PeriodicalId":49509,"journal":{"name":"Social Science Computer Review","volume":"22 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2025-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143485778","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}