Multimodality and cross-modal cohesion in manga

Victoria Yefymenko
{"title":"Multimodality and cross-modal cohesion in manga","authors":"Victoria Yefymenko","doi":"10.26565/2218-2926-2022-24-08","DOIUrl":null,"url":null,"abstract":"Manga with their distinct style and symbolism represent a growing reading trend in the world. Manga use an established set of symbols to convey various emotions. Manga have generally been more experimental in layout than Western comics. They are more fragmentary and contain more panels that enhance the dynamism of the story. We aimed to outline methodological approaches to the analysis of manga; to summarize specific features of manga as a separate medium; to analyse how multimodal cohesion is created in manga; to reveal various types of relations between visual and verbal modes. Manga is a multimodal discourse, combining several modes, mainly visual and verbal. The aural mode is represented by linguistic and visual signs, e.g. jagged borders of a speech bubble or the size and boldness of letters. We applied methods originally designed for the film analysis to the analysis of manga, in particular, Tseng’s (2013) theory of cross-modal cohesion, based on tracking cross-modally realized characters, objects, actions, and settings. This analysis included building cross-modal cohesive chains. We argue that it is possible to track cross-modal cohesion in manga, based on the interaction of visual, verbal, and aural components of identity chains. Besides, the interaction between visual and verbal modes was revealed by analysing text-image relations. In this paper we have outlined manga-specific features, distinctive features of manga’s page layout, cinematic devices, which manga borrowed from films, some of which may be used as focalisation-marking devices.","PeriodicalId":62895,"journal":{"name":"科学24小时","volume":"69 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2022-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"科学24小时","FirstCategoryId":"1089","ListUrlMain":"https://doi.org/10.26565/2218-2926-2022-24-08","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Manga with their distinct style and symbolism represent a growing reading trend in the world. Manga use an established set of symbols to convey various emotions. Manga have generally been more experimental in layout than Western comics. They are more fragmentary and contain more panels that enhance the dynamism of the story. We aimed to outline methodological approaches to the analysis of manga; to summarize specific features of manga as a separate medium; to analyse how multimodal cohesion is created in manga; to reveal various types of relations between visual and verbal modes. Manga is a multimodal discourse, combining several modes, mainly visual and verbal. The aural mode is represented by linguistic and visual signs, e.g. jagged borders of a speech bubble or the size and boldness of letters. We applied methods originally designed for the film analysis to the analysis of manga, in particular, Tseng’s (2013) theory of cross-modal cohesion, based on tracking cross-modally realized characters, objects, actions, and settings. This analysis included building cross-modal cohesive chains. We argue that it is possible to track cross-modal cohesion in manga, based on the interaction of visual, verbal, and aural components of identity chains. Besides, the interaction between visual and verbal modes was revealed by analysing text-image relations. In this paper we have outlined manga-specific features, distinctive features of manga’s page layout, cinematic devices, which manga borrowed from films, some of which may be used as focalisation-marking devices.
漫画中的多模态和跨模态衔接
漫画以其独特的风格和象征意义代表了世界上日益增长的阅读趋势。漫画使用一套既定的符号来传达各种情感。日本漫画在布局上通常比西方漫画更具实验性。它们更零碎,包含更多的面板,以增强故事的活力。我们的目标是概述分析漫画的方法论方法;总结漫画作为一种独立媒介的特点;分析漫画中多模态衔接的形成;揭示视觉模式与言语模式之间的各种关系。漫画是一种多模态话语,结合了几种模式,主要是视觉和口头。听觉模式由语言和视觉符号表示,例如语音气泡的锯齿状边界或字母的大小和粗细。我们将最初为电影分析设计的方法应用于漫画分析,特别是Tseng(2013)的跨模态衔接理论,该理论基于追踪跨模态实现的人物、物体、动作和背景。该分析包括构建跨模态内聚链。我们认为,基于身份链的视觉、语言和听觉成分的相互作用,可以跟踪漫画中的跨模态衔接。此外,通过对文本-图像关系的分析,揭示了视觉模式和语言模式之间的相互作用。在本文中,我们概述了漫画特有的特征,漫画的页面布局的鲜明特征,电影装置,漫画借鉴了电影,其中一些可以用作聚焦标记装置。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
6690
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信