The Transcribing and Encoding Scheme of Multimodal Dynamic Genres

Abstract

Dynamic genres where pictures move, sound plays and language comes in changing combinations of speech, song and writing are ubiquitous throughout our lives. Yet the problem as to how we can go about analyzing them in blend with image, movement, sound, music and speech with a view to generating and multiplying the meaning in multimodal videos or communicative events crops up. The paper presents the establishment of a transcribing and encoding scheme based on the multimodal transcription of dynamic texts and multiple-tier annotation via multimodal discourse software Elan, which can simultaneously handle multi-modes that are co-deployed in audio or video genres. The last but not least one is hoping to benefit the implementation of the dynamic discourse analysis through the utilization of Elan by applying the closely related multimodal theories originating from social semiotics in terms of image, movement, speech, music and sound.