Communication Methods and Measures最新文献_第8页

Machine Translation Vs. Multilingual Dictionaries Assessing Two Strategies for the Topic Modeling of Multilingual Text Collections 机器翻译与多语言词典:评估多语言文本集主题建模的两种策略

IF 11.4 1区文学

Communication Methods and Measures Pub Date : 2021-08-17 DOI: 10.1080/19312458.2021.1955845

D. Maier, C. Baden, Daniela Stoltenberg, Maya De Vries-Kedem, A. Waldherr

{"title":"Machine Translation Vs. Multilingual Dictionaries Assessing Two Strategies for the Topic Modeling of Multilingual Text Collections","authors":"D. Maier, C. Baden, Daniela Stoltenberg, Maya De Vries-Kedem, A. Waldherr","doi":"10.1080/19312458.2021.1955845","DOIUrl":"https://doi.org/10.1080/19312458.2021.1955845","url":null,"abstract":"ABSTRACT The goal of this paper is to evaluate two methods for the topic modeling of multilingual document collections: (1) machine translation (MT), and (2) the coding of semantic concepts using a multilingual dictionary (MD) prior to topic modeling. We empirically assess the consequences of these approaches based on both a quantitative comparison of models and a qualitative validation of each method’s potentials and weaknesses. Our case study uses two text collections (of tweets and news articles) in three languages (English, Hebrew, Arabic), covering the ongoing local conflicts between Israeli authorities, settlers, and Palestinian Bedouins in the West Bank. We find that both methods produce a large share of equivalent topics, especially in the context of fairly homogenous news discourse, yet show limited but systematic differences when applied to highly heterogenous social media discourse. While the MD model delivers a more nuanced picture of conflict-related topics, it misses several more peripheral topics, especially those unrelated to the dictionary’s focus, which are picked up by the MT model. Our study is a first step toward instrument validation, indicating that both methods yield valid, comparable results, while method-specific differences remain.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":"16 1","pages":"19 - 38"},"PeriodicalIF":11.4,"publicationDate":"2021-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45628519","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 16

A Quadrilogy for (Big) Data Reliabilities （大）数据可靠性的四边形

IF 11.4 1区文学

Communication Methods and Measures Pub Date : 2021-07-03 DOI: 10.1080/19312458.2020.1861592

K. Krippendorff

{"title":"A Quadrilogy for (Big) Data Reliabilities","authors":"K. Krippendorff","doi":"10.1080/19312458.2020.1861592","DOIUrl":"https://doi.org/10.1080/19312458.2020.1861592","url":null,"abstract":"ABSTRACT This paper responds to the challenge of testing the reliabilities of really big data and proposes a quadrilogy of four measures of the reliability of data, applicable quite generally. These measures grew out of the recognition that crowd coded data contest big data scientists’ conviction that the social contexts and meanings of data become irrelevant in the face of their sheer volumes. Bigness has also challenged available inter–coder agreement coefficients and available software, which are either too restricted regarding the forms of data they accept or exceed computational limits when data become very large. In the course of tailoring Krippendorff’s alpha to very large data, the possibility emerged of dividing the concept of reliability into four separate kinds, serving different methodological aims in social research. They respectively assess the replicability of the process of generating data, the accuracy of generating data, the surrogacy of proposed theories, coders, formulas, or algorithms to serve as a substitute for human coders, and the decisiveness among several human judgements. Their mathematical relationships assure comparability. The paper develops this quadrilogy of agreement measures first for binary data, provides a link to software for computing it, but then extends it to nominal data – a first step towards further generalizations. It also proposes a computational path to estimate the confidence limits for each of these measures and the probabilities of accepting data as reliable when there is a chance of being below a tolerable level. It ends with a discussion of how to select reliability benchmarks appropriate for the quadrilogy of agreement measures.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":"15 1","pages":"165 - 189"},"PeriodicalIF":11.4,"publicationDate":"2021-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/19312458.2020.1861592","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44142962","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

Assessing the Inclusion of Foil Items in a Scale to Measure Recognition of Health Messages. 评估健康信息识别量表中的箔片项目。

IF 11.4 1区文学

Communication Methods and Measures Pub Date : 2021-07-03 DOI: 10.1080/19312458.2020.1768520

Helen W Sullivan, Wen-Hung Chen, Kevin R Betts

引用次数: 0

Assessing (In)accuracy and Biases in Self-reported Measures of Exposure to Disagreement: Evidence from Linkage Analysis Using Digital Trace Data 评估自我报告的不一致暴露测量的准确性和偏差:使用数字跟踪数据的关联分析的证据

IF 11.4 1区文学

Communication Methods and Measures Pub Date : 2021-07-03 DOI: 10.1080/19312458.2021.1935824

Hyunjin Song, Jaeho Cho

引用次数: 2

Expert-Informed Topic Models for Document Set Discovery 用于文档集发现的专家知情主题模型

IF 11.4 1区文学

Communication Methods and Measures Pub Date : 2021-06-30 DOI: 10.1080/19312458.2021.1920008

E. M. Rinke, Timo Dobbrick, Charlotte Löb, Cäcilia Zirn, Hartmut Wessler

{"title":"Expert-Informed Topic Models for Document Set Discovery","authors":"E. M. Rinke, Timo Dobbrick, Charlotte Löb, Cäcilia Zirn, Hartmut Wessler","doi":"10.1080/19312458.2021.1920008","DOIUrl":"https://doi.org/10.1080/19312458.2021.1920008","url":null,"abstract":"ABSTRACT The first step in many text-as-data studies is to find documents that address a specific topic within a larger document set. Researchers often rely on simple keyword searches to do this, even though this may introduce considerable selection bias. Such bias may be even greater when researchers lack the domain knowledge required to make informed search decisions, for example, in cross-national research or research on unfamiliar social contexts. We propose expert-informed topic modeling (EITM) as a hybrid approach to tackle this problem. EITM combines the validity of external domain knowledge captured through expert surveys with probabilistic topic models to help researchers identify subsets of documents that cover initially unknown domain-specific topics, such as specific events and debates, that belong to a researcher-defined master topic. EITM is a flexible and efficient approach to the thematic selection of documents from large text corpora for further study. We benchmark and validate the method by discovering blog posts that address the public role of religion within large corpora of Australian, Swiss, and Turkish blog posts and provide researchers with a complete workflow to guide the application of EITM in their own work.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":"16 1","pages":"39 - 58"},"PeriodicalIF":11.4,"publicationDate":"2021-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/19312458.2021.1920008","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41421477","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 11

Automated Tracking Approaches for Studying Online Media Use: A Critical Review and Recommendations 研究在线媒体使用的自动跟踪方法：批判性评论和建议

IF 11.4 1区文学

Communication Methods and Measures Pub Date : 2021-04-13 DOI: 10.1080/19312458.2021.1907841

C. Christner, Aleksandra Urman, S. Adam, Michaela Maier

{"title":"Automated Tracking Approaches for Studying Online Media Use: A Critical Review and Recommendations","authors":"C. Christner, Aleksandra Urman, S. Adam, Michaela Maier","doi":"10.1080/19312458.2021.1907841","DOIUrl":"https://doi.org/10.1080/19312458.2021.1907841","url":null,"abstract":"ABSTRACT With the increasing importance of online information environments, researchers have started investigating direct measures of online media use, such as online tracking. Most existing studies using tracking data have so far relied on commercial solutions, but these have limitations in terms of their costliness, replicability, and applicability to certain research questions. Hence, different research groups are developing their own tracking solutions for academic purposes. In this paper, we provide a critical review and classification of the existing approaches, apt to guide research decisions on the appropriate tracking approach and tool. First, we develop criteria to distinguish different user-centric desktop and mobile tracking approaches and tools (types of information, technical complexity, privacy implementation, user experience, and availability). Second, we describe different tools and approaches – separately for desktop and mobile tracking – with concrete examples and evaluate them using the aforementioned criteria. Finally, we discuss how different mobile and desktop tracking solutions can complement each other and provide recommendations for future research.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":"16 1","pages":"79 - 95"},"PeriodicalIF":11.4,"publicationDate":"2021-04-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/19312458.2021.1907841","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47585304","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 26

Conceptualizing and Measuring Communication Interdependence: The Technology and Face-to-Face Integration Scale 沟通相互依赖的概念与测量:技术与面对面整合量表

IF 11.4 1区文学

Communication Methods and Measures Pub Date : 2021-04-08 DOI: 10.1080/19312458.2021.1894325

L. Sharabi, Elizabeth Dorrance Hall

{"title":"Conceptualizing and Measuring Communication Interdependence: The Technology and Face-to-Face Integration Scale","authors":"L. Sharabi, Elizabeth Dorrance Hall","doi":"10.1080/19312458.2021.1894325","DOIUrl":"https://doi.org/10.1080/19312458.2021.1894325","url":null,"abstract":"ABSTRACT A distinguishing feature of contemporary relationships is the integration of technological mediation into routine social interaction. The communication interdependence perspective (CIP) explains how interpersonal technologies are interwoven with face-to-face relationships, but its conceptualization of integration is limited. To fill this gap, we expand the CIP by proposing a new measure to explicate and operationalize the ways multiple modalities are interconnected. We evaluated our scale using data from students at two universities (Study 1; N = 355) and confirmed it in a sample of romantic couples (Study 2; N = 280). The 37-item measure exhibited strong psychometric properties and contained two types of constructive integration (using technology to preserve continuity in the relationship and to facilitate togetherness) and three destructive forms (using technology to turn away from the relationship, to perpetuate conflict, and to create tension). Potential applications of the scale for studying multimodal relationships are discussed.","PeriodicalId":47552,"journal":{"name":"Communication Methods and Measures","volume":"15 1","pages":"222 - 242"},"PeriodicalIF":11.4,"publicationDate":"2021-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/19312458.2021.1894325","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48131536","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

Better Crowdcoding: Strategies for Promoting Accuracy in Crowdsourced Content Analysis 更好的众包编码:提高众包内容分析准确性的策略

IF 11.4 1区文学

Communication Methods and Measures Pub Date : 2021-04-03 DOI: 10.1080/19312458.2021.1895977

Ceren Budak, R. Garrett, Daniel J. Sude

引用次数: 3

Análisis de contenido comparativo en la cobertura periodística de los casos de secuestro en Nigeria 尼日利亚新闻报道绑架案件的比较内容分析

IF 11.4 1区文学

Communication Methods and Measures Pub Date : 2021-03-03 DOI: 10.35951/V3I1.94

Abubakar Abba, Aminu Abbas, Aondover Eric Msughter

引用次数: 0

Apuntes metodológicos para el estudio del negacionismo climático en los medios escritos 研究书面媒体中否认气候的方法论笔记

IF 11.4 1区文学

Communication Methods and Measures Pub Date : 2021-02-26 DOI: 10.35951/V3I1.111

S. Martín-Sosa

引用次数: 4