人工智能辅助多模态文本中的语音:读者关注什么?

Q1 Arts and Humanities
Xiao Tan , Wei Xu , Chaoran Wang
{"title":"人工智能辅助多模态文本中的语音:读者关注什么?","authors":"Xiao Tan ,&nbsp;Wei Xu ,&nbsp;Chaoran Wang","doi":"10.1016/j.compcom.2025.102918","DOIUrl":null,"url":null,"abstract":"<div><div>Despite the extensive research on voice in traditional text-based writing, there is a notable lack of empirical studies examining this concept within multimodal writing contexts. The shift towards multimodality in writing research, coupled with the rise of Generative Artificial Intelligence (GenAI) in content creation, calls for a deeper understanding of how voice is perceived by readers beyond traditional writing contexts. This mixed-method study addresses this gap by exploring voice construction in GenAI-assisted photo essays from a dialogic perspective. In this study, we invited writing teachers to rank five student-produced photo essays according to their perceived voice strengths and analyzed the rankings using Kendall's Coefficient Concordance. The statistical analysis shows a weak agreement (W = 0.27) among raters, suggesting that voice is perceived quite diversely. The follow-up interviews with six focal raters reveal that they could agree on the importance of having unique ideas and angles in writing, keeping writing coherent and focused, using appropriate quotations, and incorporating images to enhance storytelling. However, opinions diverge regarding using primary and secondary texts, adopting academic discourse features, and including AI-generated images. The study adds to scholarly conversation of voice in composition studies and suggests that divergence in perceiving voice could be leveraged to fuel the discussion about voice in writing pedagogy.</div></div>","PeriodicalId":35773,"journal":{"name":"Computers and Composition","volume":"75 ","pages":"Article 102918"},"PeriodicalIF":0.0000,"publicationDate":"2025-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Voice in AI-assisted multimodal texts: What do readers pay attention to?\",\"authors\":\"Xiao Tan ,&nbsp;Wei Xu ,&nbsp;Chaoran Wang\",\"doi\":\"10.1016/j.compcom.2025.102918\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Despite the extensive research on voice in traditional text-based writing, there is a notable lack of empirical studies examining this concept within multimodal writing contexts. The shift towards multimodality in writing research, coupled with the rise of Generative Artificial Intelligence (GenAI) in content creation, calls for a deeper understanding of how voice is perceived by readers beyond traditional writing contexts. This mixed-method study addresses this gap by exploring voice construction in GenAI-assisted photo essays from a dialogic perspective. In this study, we invited writing teachers to rank five student-produced photo essays according to their perceived voice strengths and analyzed the rankings using Kendall's Coefficient Concordance. The statistical analysis shows a weak agreement (W = 0.27) among raters, suggesting that voice is perceived quite diversely. The follow-up interviews with six focal raters reveal that they could agree on the importance of having unique ideas and angles in writing, keeping writing coherent and focused, using appropriate quotations, and incorporating images to enhance storytelling. However, opinions diverge regarding using primary and secondary texts, adopting academic discourse features, and including AI-generated images. The study adds to scholarly conversation of voice in composition studies and suggests that divergence in perceiving voice could be leveraged to fuel the discussion about voice in writing pedagogy.</div></div>\",\"PeriodicalId\":35773,\"journal\":{\"name\":\"Computers and Composition\",\"volume\":\"75 \",\"pages\":\"Article 102918\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-02-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers and Composition\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S8755461525000052\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"Arts and Humanities\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Composition","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S8755461525000052","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Arts and Humanities","Score":null,"Total":0}
引用次数: 0

摘要

尽管人们对传统文本写作中的语音进行了广泛的研究,但在多模态写作环境中对这一概念进行实证研究的人却很少。写作研究向多模态的转变,加上生成式人工智能(GenAI)在内容创作方面的兴起,要求我们更深入地了解读者在传统写作环境之外是如何感知声音的。这个混合方法的研究通过从对话的角度探索genai辅助照片文章中的语音结构来解决这一差距。在这项研究中,我们邀请写作教师根据他们感知到的声音优势对五篇学生制作的照片文章进行排名,并使用肯德尔系数一致性分析排名。统计分析显示,评分者之间的一致性较弱(W = 0.27),表明声音的感知相当多样化。对6位焦点评分者的后续采访显示,他们都同意在写作中拥有独特的想法和角度、保持写作的连贯和重点、使用适当的引文以及结合图像来增强故事叙述的重要性。然而,在使用一手文本和第二手文本、采用学术话语特征以及包括人工智能生成的图像方面,意见分歧。该研究增加了写作研究中声音的学术讨论,并建议利用声音感知的分歧来推动关于写作教学中声音的讨论。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Voice in AI-assisted multimodal texts: What do readers pay attention to?
Despite the extensive research on voice in traditional text-based writing, there is a notable lack of empirical studies examining this concept within multimodal writing contexts. The shift towards multimodality in writing research, coupled with the rise of Generative Artificial Intelligence (GenAI) in content creation, calls for a deeper understanding of how voice is perceived by readers beyond traditional writing contexts. This mixed-method study addresses this gap by exploring voice construction in GenAI-assisted photo essays from a dialogic perspective. In this study, we invited writing teachers to rank five student-produced photo essays according to their perceived voice strengths and analyzed the rankings using Kendall's Coefficient Concordance. The statistical analysis shows a weak agreement (W = 0.27) among raters, suggesting that voice is perceived quite diversely. The follow-up interviews with six focal raters reveal that they could agree on the importance of having unique ideas and angles in writing, keeping writing coherent and focused, using appropriate quotations, and incorporating images to enhance storytelling. However, opinions diverge regarding using primary and secondary texts, adopting academic discourse features, and including AI-generated images. The study adds to scholarly conversation of voice in composition studies and suggests that divergence in perceiving voice could be leveraged to fuel the discussion about voice in writing pedagogy.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Computers and Composition
Computers and Composition Arts and Humanities-Language and Linguistics
CiteScore
4.30
自引率
0.00%
发文量
34
审稿时长
25 days
期刊介绍: Computers and Composition: An International Journal is devoted to exploring the use of computers in writing classes, writing programs, and writing research. It provides a forum for discussing issues connected with writing and computer use. It also offers information about integrating computers into writing programs on the basis of sound theoretical and pedagogical decisions, and empirical evidence. It welcomes articles, reviews, and letters to the Editors that may be of interest to readers, including descriptions of computer-aided writing and/or reading instruction, discussions of topics related to computer use of software development; explorations of controversial ethical, legal, or social issues related to the use of computers in writing programs.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信