Testing ‘Crowdcoding’ Methods in Sub-Saharan African Settings: Using the 2020 Tanzanian Elections to Test its Validity and Reliability

Q1 Arts and Humanities

Media Watch Pub Date : 2021-05-01 DOI:10.15655/mw_2021_v12i2_160146

Gregory Gondwe, E. Some

引用次数: 0

Abstract

This study replicates existing research on crowdcoding, and content analysis approaches to test the validity and reliability of content analysis methods in the African setting. We use data from the 2020 Tanzanian presidential elections as a case study. Instead of MTurk for crowdsourcing, the study utilized WhatsApp groups and university students from Tanzania to code the data. Using a collected and controlled sample of 400 tweets to represent Tanzania’s ruling and opposition parties, respectively, our overall findings suggested that crowdcoding produced more reliable data than qualitative content analysis (QCA). However, further analysis suggests that although Crowdcoding recorded higher agreement on validity scores, trained coders seemed to provide more reliability accuracy scores. Besides, data indicates that the traditional training of the coders was statistically insignificant in providing accurate validity and reliability scores for QCA.

查看原文本刊更多论文

在撒哈拉以南非洲地区测试“众编码”方法：利用2020年坦桑尼亚选举测试其有效性和可靠性

这项研究复制了现有的众包编码和内容分析方法的研究，以测试内容分析方法在非洲环境中的有效性和可靠性。我们使用2020年坦桑尼亚总统选举的数据作为案例研究。该研究利用WhatsApp群组和坦桑尼亚大学生对数据进行编码，而不是使用MTurk进行众包。使用收集和控制的400条推文样本，分别代表坦桑尼亚执政党和反对党，我们的总体发现表明，众包编码产生的数据比定性内容分析（QCA）更可靠。然而，进一步的分析表明，尽管群组编码在有效性得分上的一致性更高，但经过训练的编码人员似乎提供了更多的可靠性-准确性得分。此外，数据表明，编码员的传统训练在为QCA提供准确的有效性和可靠性分数方面在统计学上是不重要的。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Media Watch Arts and Humanities-Literature and Literary Theory

自引率

0.00%

发文量

期刊介绍： Journal of Media Watch is a double blind peer-reviewed tri-annual journal published from India. It is the only journal in the discipline from Asia and India listed in many leading indexing platforms. The journal keeps high quality peer evaluation and academic standards in all levels of its publication. Journal of Media Watch reflects empirical and fundamental research, theoretical articulations, alternative critical thinking, diverse knowledge spectrum, cognizant technologies, scientific postulates, alternative social synergies, exploratory documentations, visual enquiries, narrative argumentations, innovative interventions, and minority inclusiveness in its content and selection. The journal aims at publishing and documenting research publication in the field of communication and media studies that covers a wide range of topics and sub-fields like print media, television, radio, film, public relations, advertising, journalism and social media and the cultural impact and activation of these media in the society. It aims at providing a platform for the scholars to present their research to an international academic community with wide access and reach. Published topics in Media Watch enjoy very high impact and major citation. The journal is supported by strong international editorial advisory support from leading academicians in the world.