Video, talk and text: How do parties communicate coherently across modalities in live videostreams?

IF 2.3 2区 文学 Q1 COMMUNICATION
Scott Dutt, Sage Graham
{"title":"Video, talk and text: How do parties communicate coherently across modalities in live videostreams?","authors":"Scott Dutt,&nbsp;Sage Graham","doi":"10.1016/j.dcm.2023.100726","DOIUrl":null,"url":null,"abstract":"<div><p>This study explores how participants co-accomplish coherence in multi-modal conversation. We observed online watch parties, with an interest in the intertwining of text, talk and video. The data comes from two different communities on the live-streaming platform Twitch.tv. Each community consists of one live-streamer and their viewership. The live-streamers broadcast an audio-visual artifact, while simultaneously communicating with their viewers in real-time. The two were highly interactive, despite one (the streamer) speaking and reading, and the other (the chatters) typing and listening. The crisscross of modalities introduces challenges for the management and intelligibility of conversation. One coherence strategy involved a 4-stage process whereby streamers redirected viewers’ attention, and then initiated a collaborative activity. This 4–stage sequence illustrates a predictable structure that is potentially applicable to other digital &amp; multimodal environments. Methodological challenges of digitally-mediated interaction are addressed, such as transcription of voice-and-text cross-modal conversation.</p></div>","PeriodicalId":46649,"journal":{"name":"Discourse Context & Media","volume":"55 ","pages":"Article 100726"},"PeriodicalIF":2.3000,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Discourse Context & Media","FirstCategoryId":"98","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2211695823000594","RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMMUNICATION","Score":null,"Total":0}
引用次数: 0

Abstract

This study explores how participants co-accomplish coherence in multi-modal conversation. We observed online watch parties, with an interest in the intertwining of text, talk and video. The data comes from two different communities on the live-streaming platform Twitch.tv. Each community consists of one live-streamer and their viewership. The live-streamers broadcast an audio-visual artifact, while simultaneously communicating with their viewers in real-time. The two were highly interactive, despite one (the streamer) speaking and reading, and the other (the chatters) typing and listening. The crisscross of modalities introduces challenges for the management and intelligibility of conversation. One coherence strategy involved a 4-stage process whereby streamers redirected viewers’ attention, and then initiated a collaborative activity. This 4–stage sequence illustrates a predictable structure that is potentially applicable to other digital & multimodal environments. Methodological challenges of digitally-mediated interaction are addressed, such as transcription of voice-and-text cross-modal conversation.

视频、谈话和文本:各方如何在直播视频流中跨模式进行连贯沟通?
本研究探讨了参与者如何在多模式对话中共同实现连贯性。我们观察了在线观看派对,对文本、谈话和视频的交织感兴趣。数据来自直播平台Twitch.tv上的两个不同社区。每个社区由一个直播流媒体及其收视率组成。直播带播放视听制品,同时与观众实时交流。尽管一个(流光溢彩者)在说话和阅读,另一个(喋喋不休者)在打字和听,但两人的互动性很强。模式的交叉给会话的管理和可理解性带来了挑战。一个连贯性策略涉及一个四阶段的过程,通过这个过程,流媒体重新引导观众的注意力,然后发起一项合作活动。这个4阶段序列说明了一个可预测的结构,该结构可能适用于其他数字&;多模式环境。数字媒介交互的方法学挑战得到了解决,例如语音和文本跨模态对话的转录。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Discourse Context & Media
Discourse Context & Media COMMUNICATION-
CiteScore
5.00
自引率
10.00%
发文量
46
审稿时长
55 days
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信