{"title":"Multimodal rhythm in TikTok videos: Exploring a recontextualization of the Gillard ‘misogyny speech’","authors":"Joshua Han, Michele Zappavigna","doi":"10.1177/26349795231207228","DOIUrl":"https://doi.org/10.1177/26349795231207228","url":null,"abstract":"This article presents a multimodal rhythmic analysis of a TikTok video, adopting a social semiotic perspective on embodied meaning-making. We highlight the importance of rhythm in coordinating and intertwining semiotic modes to produce meaning. The study develops a method for undertaking an integrated multimodal analysis of rhythm across speech, bodily action, gesture and music, and develops a transcription convention for representing this rhythmic unfolding. The data considered is a TikTok ‘glambot/boss challenge’ video featuring a lip sync to audio sampled from former Australian Prime Minister Julia Gillard’s 2012 culturally iconic ‘Misogyny Speech’ condemning misogynist and sexist men, particularly those in positions of power. This speech achieved viral prominence internationally and continues to be a key feminist text in Australian political history. The paper demonstrates how end-accented rhythmic groups create anticipation and lead to the main event in both the speech and glambot sections of the video. Alongside the rhythmic analysis, the article examines the intertextual meanings established with other TikTok videos that iterate the glambot meme and glambot challenge.","PeriodicalId":134431,"journal":{"name":"Multimodality & Society","volume":"25 12","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135875564","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Sound-vibration: Relations between bodies, low frequencies, and multisensory experiments","authors":"Joana B. Burd","doi":"10.1177/26349795231211434","DOIUrl":"https://doi.org/10.1177/26349795231211434","url":null,"abstract":"Multimodality research has enabled academics to propose and support new ideas in multiple modes for interpretation, communication, and as an important part of art education. In this piece, multimodal listening is situated as a transcendence of ear-centric approaches and the use of vibration as a poetic practice in contemporary art. As a result, sonic arts and sound experience principles are used to talk about everyday sounds in new and immersive ways, encouraging the audience to disrupt established sensorial boundaries. Subsequently, sound-vibration can be interrelated as a mode of multimodality and as a resource for meaning-making in possible contemporary practices. If perception is considered multifaceted, one could notice the world as an integration of conscious or unaware inputs. In the experience of sound installations, one may explore oscillations as a valuable channel for understanding multimodal approaches since, unlike visual or tactile interactions, the relationship between sound and the body hinges on fully embodied situations. The underlying thought in this piece will emerge from two recent art pieces, that produce atmospheres and blur the concrete division of senses, transversely representing the potential of the low frequencies.","PeriodicalId":134431,"journal":{"name":"Multimodality & Society","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134908710","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Prompting story elements in first grade: An intermodal approach for exploring two teachers’ orchestrations","authors":"Kim Ridell, Robert Walldén","doi":"10.1177/26349795231205199","DOIUrl":"https://doi.org/10.1177/26349795231205199","url":null,"abstract":"Although the teaching of narrative texts in primary school is well researched, there is a lack of insight into how visual models and multimodal prompts are used by teachers to convey genre-specific knowledge. Therefore, we conducted a multimodal study of the teaching practices in two first-grade classrooms during joint re-tellings of the folktale Little Red Riding Hood and subsequent interactions around narrative genre. In both cases, the teachers used the graphical model The Story Face as well as a whiteboard canvas in their orchestrations. Data was collected in the form of audio and video recordings. Underpinned by a social semiotic framework combined with Bernstein’s concept framing, the analyses revealed that both teachers focused on story events and the story’s macrostructure while displaying different orientations in the use of verbal language and visual representations. This resulted in different emphases on either story-specific or more general features of narrative genre. Furthermore, the students showed an interest in iconic and suspense-building story dialogue, but this aspect was generally de-emphasized by the teachers’ use of verbal language and visual resources. Based on these findings, we discuss the significance of studying teachers’ differing orchestrations through overlapping modes.","PeriodicalId":134431,"journal":{"name":"Multimodality & Society","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135804338","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multimodality and museums: Innovative research methods and interpretive frameworks","authors":"","doi":"10.1177/26349795231199144","DOIUrl":"https://doi.org/10.1177/26349795231199144","url":null,"abstract":"","PeriodicalId":134431,"journal":{"name":"Multimodality & Society","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136236676","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Working beside/s words: A case study in the partiality and provinciality of language","authors":"Crispin Thurlow","doi":"10.1177/26349795231202250","DOIUrl":"https://doi.org/10.1177/26349795231202250","url":null,"abstract":"Part visual essay, the case study reported here considers the classist implications of over-attending to (spoken) language in the workplace. Rooted in the core principle of multimodality, the paper surfaces ways of doing/knowing which inevitably sit beside (next to) words, but which also sometimes exist besides (in spite of) words. The empirical stimulus for the paper is fieldwork conducted in Extremadura, Spain; here, in fields and factories, we find work that is highly accomplished and meticulously coordinated, but which for practical reasons is conducted almost entirely without speech – for hours on end. By privileging language work and “talk on the job”, discourse scholars not only misrecognize the complex semiotic organization of jobs but effectively sideline whole domains of working-class, manual labor. These matters thus have ethical and political ramifications as well as epistemological or methodological ones.","PeriodicalId":134431,"journal":{"name":"Multimodality & Society","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135059472","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Book Review: of Multimodal communication in intercultural interaction","authors":"Wing Yee Jenifer Ho","doi":"10.1177/26349795231202249","DOIUrl":"https://doi.org/10.1177/26349795231202249","url":null,"abstract":"","PeriodicalId":134431,"journal":{"name":"Multimodality & Society","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135785881","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Race and multimodality: An introduction to the special issue","authors":"Sachi Sekimoto, Christopher Brown","doi":"10.1177/26349795231194806","DOIUrl":"https://doi.org/10.1177/26349795231194806","url":null,"abstract":"This issue brings together teachers, researchers, performing artists and creative practitioners who discuss, analyze, and reflect on the possibilities offered by examining how multimodality shapes the social and cultural landscape of understanding race and racism. We invite readers to consider: How is race a multimodal construction? How is race, as a social and cultural artifact, constructed and reproduced within the multimodal machinery of modern society? What possibilities does multimodal theorizing offer as a pedagogical approach to advance anti-racism? We argue that multimodality allows for a different conceptualization of race – it is not a text written with the arbitrary and slippery language of race, but an assemblage of multiple modes that constitutes a racial world that is not only “read” but also “lived” and “felt” by those who live in it. The authors in this issue demonstrate how race shows up—or appears—as an assemblage of multiple modes of communication that individuals and groups utilize to make meaning. Through the analyses of multimodal texts such as videos, photos, legal documents, film subtitling, ethnographic observations, interracial dialogue and spoken word performance, they explore the social and cultural construction of race as multimodal process.","PeriodicalId":134431,"journal":{"name":"Multimodality & Society","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131258752","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Book Review: White Sight: Visual Politics and Practices of Whiteness","authors":"Francesca Sobande","doi":"10.1177/26349795231191026","DOIUrl":"https://doi.org/10.1177/26349795231191026","url":null,"abstract":"","PeriodicalId":134431,"journal":{"name":"Multimodality & Society","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130882882","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Conversations about race: A reflection on shifts in thinking, teaching and creative practice","authors":"Marike Spangenberg","doi":"10.1177/26349795231191024","DOIUrl":"https://doi.org/10.1177/26349795231191024","url":null,"abstract":"Over the course of a year, I was involved in biweekly discussions in which a group of lecturers, members of management and administrative staff at a higher education institution in Stellenbosch, South Africa discussed personal experiences regarding race in and outside of our institution. The purpose of these discussions was to become more aware of how different people experience race, and in turn power, within the same space and place. With the Academy being a predominantly ‘white space’, these conversations affirmed the need for a collective consciousness of different experiences relating to race and power, as it directly impacts teaching and learning practices. As a white educator and Eurocentrically taught creative practitioner, the engagement in these conversations not only brought attention to different experiences and viewpoints, but also made me question my innate visual resources and bias regarding the construction of knowledge as relating to race, power, and place. In this paper I reflect upon the influence of these conversations on my personal thinking, teaching approaches and creative practice. I trace the process of gradual self-awareness, that has led to intentional adaptations in my teaching approach and alternative approaches in my practice as an illustrator. In so doing, the value of multimodal learning practices, particularly relating to race, is justified.","PeriodicalId":134431,"journal":{"name":"Multimodality & Society","volume":"395 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133938264","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Objects of mestizo memory","authors":"A. F. Mejía","doi":"10.1177/26349795231187086","DOIUrl":"https://doi.org/10.1177/26349795231187086","url":null,"abstract":"This visual essay explores the relationship of racialization and family archives based on an inquiry into my Guatemalan father’s collection of media artifacts. The media objects include VHS tapes, photographic prints, and legal documents. All of the images presented are from my father’s media archive, and they are presented in relation to a series of textual reflections. These reflections are drawn from my own experiences producing oral histories with my tía Marta in Guatemala, my father’s reflections on his archive of media objects, and a review of colonial texts that elaborated the descriptions of ethnoracial categories related to “mestizaje” in Central America. Taken together, this image-based and textual exploration presents the reader with an opportunity to reflect on the contingent, fraught, and open-ended process of racialization, as well as on moments of foreclosure where boundaries of ethnoracial identity are demarcated and reified. The essay meditates on ways that utterances and dialogue about family archives constitute sites of racialization. There is a corresponding video essay featuring my father’s narration along with his interaction with his archive at the link below: https://www.youtube.com/watch?v=PwPmMwBJc-k.","PeriodicalId":134431,"journal":{"name":"Multimodality & Society","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121328242","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}