Fabrizio Gilardi, Sabrina Di Lorenzo, Juri Ezzaini, Beryl Santa, Benjamin Streiff, Eric Zurfluh, Emma Hoes
{"title":"Disclosure of AI-Generated News Increases Engagement but Does Not Reduce Aversion, Despite Positive Quality Ratings","authors":"Fabrizio Gilardi, Sabrina Di Lorenzo, Juri Ezzaini, Beryl Santa, Benjamin Streiff, Eric Zurfluh, Emma Hoes","doi":"arxiv-2409.03500","DOIUrl":null,"url":null,"abstract":"The advancement of artificial intelligence (AI) has led to its application in\nmany areas, including journalism. One key issue is the public's perception of\nAI-generated content. This preregistered study investigates (i) the perceived\nquality of AI-assisted and AI-generated versus human-generated news articles,\n(ii) whether disclosure of AI's involvement in generating these news articles\ninfluences engagement with them, and (iii) whether such awareness affects the\nwillingness to read AI-generated articles in the future. We employed a\nbetween-subjects survey experiment with 599 participants from the\nGerman-speaking part of Switzerland, who evaluated the credibility,\nreadability, and expertise of news articles. These articles were either written\nby journalists (control group), rewritten by AI (AI-assisted group), or\nentirely generated by AI (AI-generated group). Our results indicate that all\nnews articles, regardless of whether they were written by journalists or AI,\nwere perceived to be of equal quality. When participants in the treatment\ngroups were subsequently made aware of AI's involvement in generating the\narticles, they expressed a higher willingness to engage with (i.e., continue\nreading) the articles than participants in the control group. However, they\nwere not more willing to read AI-generated news in the future. These results\nsuggest that aversion to AI usage in news media is not primarily rooted in a\nperceived lack of quality, and that by disclosing using AI, journalists could\nattract more immediate engagement with their content, at least in the short\nterm.","PeriodicalId":501112,"journal":{"name":"arXiv - CS - Computers and Society","volume":"62 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Computers and Society","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.03500","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
The advancement of artificial intelligence (AI) has led to its application in
many areas, including journalism. One key issue is the public's perception of
AI-generated content. This preregistered study investigates (i) the perceived
quality of AI-assisted and AI-generated versus human-generated news articles,
(ii) whether disclosure of AI's involvement in generating these news articles
influences engagement with them, and (iii) whether such awareness affects the
willingness to read AI-generated articles in the future. We employed a
between-subjects survey experiment with 599 participants from the
German-speaking part of Switzerland, who evaluated the credibility,
readability, and expertise of news articles. These articles were either written
by journalists (control group), rewritten by AI (AI-assisted group), or
entirely generated by AI (AI-generated group). Our results indicate that all
news articles, regardless of whether they were written by journalists or AI,
were perceived to be of equal quality. When participants in the treatment
groups were subsequently made aware of AI's involvement in generating the
articles, they expressed a higher willingness to engage with (i.e., continue
reading) the articles than participants in the control group. However, they
were not more willing to read AI-generated news in the future. These results
suggest that aversion to AI usage in news media is not primarily rooted in a
perceived lack of quality, and that by disclosing using AI, journalists could
attract more immediate engagement with their content, at least in the short
term.