Audience evaluations of news videos made with various levels of automation: A population-based survey experiment

IF 2.7 2区文学 Q1 COMMUNICATION

Journalism Pub Date : 2024-05-08 DOI:10.1177/14648849241243189

Neil Thurman, Sally Stares, Michael Koliska

{"title":"Audience evaluations of news videos made with various levels of automation: A population-based survey experiment","authors":"Neil Thurman, Sally Stares, Michael Koliska","doi":"10.1177/14648849241243189","DOIUrl":null,"url":null,"abstract":"The use of automation in news content creation is expanding from the written to the audio-visual medium with news organizations including Reuters turning to video automation services provided by companies such as Wibbitz. Although researchers have explored audience perceptions of text-based news automation, to date no published study has examined how news consumers perceive automated news videos. We conducted a between-subjects online survey experiment to compare how a socio-demographically representative sample ( n = 4200) of online news consumers in the UK perceived human-made, partly automated, and highly automated short-form online news videos on 14 different story topics. Our findings show that human-made videos received on average more favourable responses on some evaluation variables, although the differences were not large. We also found some significant differences in the relative evaluation of automated and human-made news videos across different individual stories. For practitioners our results suggest partly automated news videos with post-automation human editing can be well received. For researchers our results show the need to use reasonably large sets of experimental stimuli, and suggest that ensuring socio-demographic variation within samples of respondents is worthwhile.","PeriodicalId":51432,"journal":{"name":"Journalism","volume":"44 1","pages":""},"PeriodicalIF":2.7000,"publicationDate":"2024-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journalism","FirstCategoryId":"98","ListUrlMain":"https://doi.org/10.1177/14648849241243189","RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMMUNICATION","Score":null,"Total":0}

引用次数: 0

Abstract

The use of automation in news content creation is expanding from the written to the audio-visual medium with news organizations including Reuters turning to video automation services provided by companies such as Wibbitz. Although researchers have explored audience perceptions of text-based news automation, to date no published study has examined how news consumers perceive automated news videos. We conducted a between-subjects online survey experiment to compare how a socio-demographically representative sample ( n = 4200) of online news consumers in the UK perceived human-made, partly automated, and highly automated short-form online news videos on 14 different story topics. Our findings show that human-made videos received on average more favourable responses on some evaluation variables, although the differences were not large. We also found some significant differences in the relative evaluation of automated and human-made news videos across different individual stories. For practitioners our results suggest partly automated news videos with post-automation human editing can be well received. For researchers our results show the need to use reasonably large sets of experimental stimuli, and suggest that ensuring socio-demographic variation within samples of respondents is worthwhile.

查看原文本刊更多论文

观众对不同自动化程度的新闻视频的评价：基于人群的调查实验

自动化在新闻内容创作中的应用正从文字媒介扩展到视听媒介，包括路透社在内的新闻机构都开始使用 Wibbitz 等公司提供的视频自动化服务。虽然研究人员已经探讨了受众对基于文本的新闻自动化的看法，但迄今为止，还没有公开发表的研究对新闻消费者如何看待自动化新闻视频进行过探讨。我们进行了一项主体间在线调查实验，比较了具有社会人口代表性的英国在线新闻消费者样本（n = 4200）对 14 个不同新闻主题的人造、部分自动化和高度自动化在线新闻短视频的看法。我们的研究结果表明，人造视频在某些评价变量上平均获得了更多的好评，尽管差异并不大。我们还发现，在不同的新闻报道中，对自动化和人工制作的新闻视频的相对评价存在一些显著差异。对于从业人员来说，我们的结果表明，经过后期人工编辑的部分自动化新闻视频会受到好评。对于研究人员来说，我们的结果表明需要使用相当大的实验刺激，并建议确保受访者样本中的社会人口差异是值得的。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Journalism COMMUNICATION-

CiteScore

7.90

自引率

10.30%

发文量

123

期刊介绍： Journalism is a major international, peer-reviewed journal that provides a dedicated forum for articles from the growing community of academic researchers and critical practitioners with an interest in journalism. The journal is interdisciplinary and publishes both theoretical and empirical work and contributes to the social, economic, political, cultural and practical understanding of journalism. It includes contributions on current developments and historical changes within journalism.