Multimodal communication最新文献

Investigating pausing and gesturing patterns in children with and without developmental language disorder 调查患有和未患有语言发育障碍儿童的停顿和手势模式

Multimodal communication Pub Date : 2024-06-04 DOI: 10.1515/mc-2024-0025

Corrado Bellifemine, Loulou Kosmala

{"title":"Investigating pausing and gesturing patterns in children with and without developmental language disorder","authors":"Corrado Bellifemine, Loulou Kosmala","doi":"10.1515/mc-2024-0025","DOIUrl":"https://doi.org/10.1515/mc-2024-0025","url":null,"abstract":"\u0000 This study aims at observing the co-occurrence of filled (FP) and unfilled pauses (UP) and gestures in the narratives of children with and without Developmental Language Disorder (DLD). Although children with DLD are known to be more “disfluent” than typically developing children (TD), little is known about the role of pauses in children’s speech and their interaction with gestures. 22 French-speaking children with DLD and 22 age- and gender-matched controls, between 7 and 10, recounted a cartoon excerpt. We annotated pauses and their position in utterances, and we coded gestures according to their function. Despite a similar pausing rate across groups, results show that TD children produced more utterance-beginning FPs and more mid-utterance UPs, while children with DLD produced more standalone FPs and mid-utterance UPs. Furthermore, multimodal patterns of co-occurrence, specific to pause type, emerged. While both groups had similar gesture rates and produced mostly referential gestures, TD children produced slightly more beat gestures during FPs and more self-adaptors and pragmatic gestures during UPs. Children with DLD produced more referential gestures and object-adaptors during UPs. These differences point to the temporal relationship between gestures and pauses and the multiple ways these two phenomena may interact according to the child’s profile.","PeriodicalId":471309,"journal":{"name":"Multimodal communication","volume":"6 8","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141266580","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Tattoos as multimodal semiotic assemblages 作为多模式符号组合的纹身

Multimodal communication Pub Date : 2024-03-08 DOI: 10.1515/mc-2023-0068

Felix Banda, S. Roux, A. Peck

引用次数: 0

Kefaya Ba2a as cringe comedy and the multimodal humorous stunts of the podcast’s communitas 作为恐怖喜剧的 Kefaya Ba2a 以及播客社区的多模态幽默特技

Multimodal communication Pub Date : 2024-02-21 DOI: 10.1515/mc-2024-0006

Dina M. Oleimy

{"title":"Kefaya Ba2a as cringe comedy and the multimodal humorous stunts of the podcast’s communitas","authors":"Dina M. Oleimy","doi":"10.1515/mc-2024-0006","DOIUrl":"https://doi.org/10.1515/mc-2024-0006","url":null,"abstract":"\u0000 The aim of this research is to investigate how Egyptian podcast Kefaya Ba2a (That is Enough!) is a good instance of cringe comedy that aims at critising and commenting on social issues in a sarcastic manner. This research presents an interpretive reading of the podcast as a cultural practice that leads to creating a discourse (or narrative) that provides different/alternative knowledge breaking social norms. The meanings and themes delivered through the podcast’s narratives manage to create a communication code that is shared and negotiated by the Kefaya Ba2a digi-communitas on the podcast’s Facebook page (https://www.facebook.com/groups/kefayaba2a). The analytical framework of this research is based on the frame that both Kress and Van Leeuwen propose through their theory of multimodal communication (Kress, Gunther & Theo Van Leeuwen. 2001. Multimodal discourse: The modes and media of contemporary communication. Arnold Publishers). The theory suggests a four-strata-frame that focuses on different multimodal resources that contribute to meaning-making. This research investigates the different semiotic resources that all combine to create the discourse of Kefaya Ba2a which takes humour as its major tool to deliver certain messages. It also explores the effect of Kefaya Ba2a’s discourse on its audience who have the chance to respond to it on the podcast’s Facebook page. Different response patterns are demonstrated to show how Kefaya Ba2a’s discourse turns to into a user-generated content that opens the opportunity for new readings of the original discourse. In this regard, multimodality is investigated to show how audience communicates with the themes and topics the podcast tackles using multimodal resources to generate their readings.","PeriodicalId":471309,"journal":{"name":"Multimodal communication","volume":"202 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-02-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140443600","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Cringe humor in Egyptian TokTok: multimodal critical discourse analysis of selected comic strips 埃及 TokTok 中的边缘幽默：对部分连环画的多模态批判性话语分析

Multimodal communication Pub Date : 2024-02-20 DOI: 10.1515/mc-2024-0004

N. Lotfy

引用次数: 0

Handle with care! teachers in Egyptian cringe comedies: a multimodal analysis 小心处理！埃及恐怖喜剧中的教师：多模态分析

Multimodal communication Pub Date : 2024-02-19 DOI: 10.1515/mc-2024-0008

Amany Y. A. A. Youssef

{"title":"Handle with care! teachers in Egyptian cringe comedies: a multimodal analysis","authors":"Amany Y. A. A. Youssef","doi":"10.1515/mc-2024-0008","DOIUrl":"https://doi.org/10.1515/mc-2024-0008","url":null,"abstract":"\u0000 For almost a century, several Egyptian comedies have set up cringe-worthy power-sensitive encounters between struggling low-paid teachers and spoiled rich and powerful students, often leading to negative portrayals of teachers and student-teacher relationship. One play, Madraset el-Moshaghbeen ‘School of the Rowdies’ (1971), has long been held accountable for student misconduct across the country. A 2008 film with a loosely similar theme, RamaDan Mabrouk Abul-Alamein Hamouda, has received a much warmer welcome as a harmless light comedy. This paper brings these two comedies into focus and probes into the management of cringe in filmic text based on the Benign-Violation Theory of humor as well as Baldry and Thibault’s (2006. Multimodal transcription and text analysis: A multimedia toolkit and coursebook with associated on-line course. Equinox) Multimodal Transcription Model. Optimizing for the four dimensions of psychological distance (temporal, social, spatial, and hypothetical) would help control the benignity of embarrassing violations and free the audience to enjoy the humor. Alternatively, minimizing psychological distance would evoke audience empathy with the violated teacher character and may block audience amusement. Audience reactions through the comment field on strategic clips from the film and play on YouTube would reveal whether a cringe-inducing scene has evoked amusement, vicarious embarrassment, or both. The paper proposes an inventory of the features that would contribute to adjusting psychological distance to achieve the desired effect. These features intersect with the four dimensions of psychological distance, narrative and stylistic choices, as well as the multimodal affordances of filmic and embodied expressions.","PeriodicalId":471309,"journal":{"name":"Multimodal communication","volume":"16 12","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-02-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139958502","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Cringe witnessing in post-millennial stand-up comedy performances by Ali Wong and Ali Quandil 阿里-王和阿里-昆迪尔在 "后千年 "单口相声表演中的边缘见证

Multimodal communication Pub Date : 2024-01-30 DOI: 10.1515/mc-2024-0007

D. Elshazly

{"title":"Cringe witnessing in post-millennial stand-up comedy performances by Ali Wong and Ali Quandil","authors":"D. Elshazly","doi":"10.1515/mc-2024-0007","DOIUrl":"https://doi.org/10.1515/mc-2024-0007","url":null,"abstract":"\u0000 Cringe comedy, wittily disseminating truth through the interplay between the verbal and contextual, centralizes vicarious/embarrassment as its endpoint through levels of para/linguistic incongruity and social superiority. This paper focuses on the stand-up comedian presentation along with paratextual elements that document the sociopolitical situation in two different cultures contributing to the process of perception on the part of the gazing audience. The paper questions the spectatorial gaze through post-millennial media practices that pertain to the visual among other visceral affects thus diminishing the role of the active witness whose role is beyond watching. The act of witnessing, globally foregrounded and requested by the turn of the twenty-first century, is investigated within the structure of stand-up comedy to figure out whether or not the spectator is an active witness or a by-stander. For this purpose, the study applies Andy Lavender’s model of performance modalities to stand-up comedy performances by the American Ali Wong and the Egyptian Ali Quandil; Don Wong and Mawdoa Hareemi Shweya (Some Feminine Stuff) in 2022 and 2021 respectively. Lavender’s model proposes that four modalities (the emotional, physical, discursive, contextual) turn the actor/performer into the physical medium of communication to the audience.","PeriodicalId":471309,"journal":{"name":"Multimodal communication","volume":"106 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140485532","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Background check: cross-cultural differences in the spatial context of comic scenes 背景检查:喜剧场景空间语境中的跨文化差异

Multimodal communication Pub Date : 2023-11-01 DOI: 10.1515/mc-2023-0027

Fred Atilla, Bien Klomberg, Bruno Cardoso, Neil Cohn

{"title":"Background check: cross-cultural differences in the spatial context of comic scenes","authors":"Fred Atilla, Bien Klomberg, Bruno Cardoso, Neil Cohn","doi":"10.1515/mc-2023-0027","DOIUrl":"https://doi.org/10.1515/mc-2023-0027","url":null,"abstract":"Abstract Cognitive research points towards cultural differences in the way people perceive and express scenes. Whereas people from Western cultures focus more on focal objects, those from East Asia have been shown to focus on the surrounding context. This paper examines whether these cultural differences are expressed in complex multimodal media such as comics. We compared annotated panels across comics from six countries to examine how backgrounds convey contextual information of scenes in explicit or implicit ways. Compared to Western comics from the United States and Spain, East Asian comics from Japan and China expressed the context of scenes more implicitly. In addition, Nigerian comics moderately emulated American comics in background use, while Russian comics emulated Japanese manga, consistent with their visual styles. The six countries grouped together based on whether they employed more explicit strategies such as detailed, depicted backgrounds, or implicit strategies such as leaving the background empty. These cultural differences in background use can be attributed to both cognitive patterns of attention and comics’ graphic styles. Altogether, this study provides support for cultural differences in attention manifesting in visual narratives, and elucidates how spatial relationships are depicted in visual narratives across cultures.","PeriodicalId":471309,"journal":{"name":"Multimodal communication","volume":"67 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135217723","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Multimodal discourse analysis as a method for revealing narrative strategies in news videos 新闻视频叙事策略的多模态语篇分析

Multimodal communication Pub Date : 2023-10-20 DOI: 10.1515/mc-2023-0029

John A. Bateman, Chiao-I Tseng

{"title":"Multimodal discourse analysis as a method for revealing narrative strategies in news videos","authors":"John A. Bateman, Chiao-I Tseng","doi":"10.1515/mc-2023-0029","DOIUrl":"https://doi.org/10.1515/mc-2023-0029","url":null,"abstract":"Abstract News reporting has long been seen as involving a form of storytelling but techniques for revealing narrative constructions in audiovisual news remain limited. As the forms of expression mobilised for news become ever more diverse and multimodal, the challenges posed for analysis grow accordingly. The present paper asks to what extent we can pursue more differentiating accounts of the increasingly diverse audiovisual features employed in news video by employing recent advances in multimodal discourse analysis. Specifically, we explore how to recognise storytelling strategies deployed in audiovisual news reporting both more reliably and in ways that complement conventional journalistic labels, such as those discussed in research into news sensationalism. As an illustration, we offer a contrastive analysis of the specific reporting strategies of ‘individualisation’ employed in 166 news reports from two leading German news channels, Tagesschau and Bild TV , produced between 1 January 2022 and 15 March 2022. We show how we scale analysis methods to achieve greater coverage of data and discuss how this meets several recurring challenges for multimodal analysis more generally.","PeriodicalId":471309,"journal":{"name":"Multimodal communication","volume":"69 4","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135567595","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Multimodal meaning-making in student presentations: the impact of explicit feedback in a German as a foreign language classroom 学生演讲中的多模态意义建构:显性反馈对德语课堂教学的影响

Multimodal communication Pub Date : 2023-10-18 DOI: 10.1515/mc-2023-0011

Dennis Lindenberg

{"title":"Multimodal meaning-making in student presentations: the impact of explicit feedback in a German as a foreign language classroom","authors":"Dennis Lindenberg","doi":"10.1515/mc-2023-0011","DOIUrl":"https://doi.org/10.1515/mc-2023-0011","url":null,"abstract":"Abstract This study examines the impact of teacher feedback on seven students’ presentations on social and cultural topics held in a German-as-a-foreign language classroom in Japan. Following the submission of self-recorded presentation drafts on an online learning platform, students received explicit feedback on how their spoken commentary related to the visible information on slides derived from the theoretical insights of social semiotics and systemic functional linguistics. After allocating one class to revising their work, students presented their finalized presentations, which were video recorded, cut, and prepared for analysis. Subsequently, a total of 14 sections that underwent alterations in both the draft and in-class presentation were scrutinized following a qualitative multimodal discourse analytical framework. By demonstrating the differences between two students’ early drafts and their final in-class presentations, this study shows how adding verbal language that extended a slide’s content strengthened audience engagement through interpersonal functions in language, gaze, body orientation, and gesture. Further, restructuring and inserting additional entities on the PowerPoint slide helped emphasize the talk’s ideational components. The findings of this study have implications for multiliteracies pedagogy in a foreign language context, highlighting the importance of a holistic approach that considers language and other modes as complementary aspects of communication.","PeriodicalId":471309,"journal":{"name":"Multimodal communication","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135823573","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Multimodal arguments: language, script, and politics 多模态论证:语言、剧本和政治

Multimodal communication Pub Date : 2023-10-17 DOI: 10.1515/mc-2023-0016

Dris Soulaimani

引用次数: 0