{"title":"研究医学视听幻灯片演示中语言-视觉模式的相互作用","authors":"Yu-Shan Fan , Muhammad Ibaad Khattak","doi":"10.1016/j.jeap.2025.101584","DOIUrl":null,"url":null,"abstract":"<div><div>This study examines 26 student-produced audio-slide presentations from an academic writing course at a medical university in Taiwan. The analysis focuses on the interaction between verbal and visual modes in this format, which features pre-recorded oral narration synchronized with static slides. Using Systemic Functional-Multimodal Discourse Analysis, three distinct presentation patterns—slide-based, poster-style, and text-based—were identified, each reflecting different configurations of academic discourse features and digital affordances. Slide- and text-based formats tended to rely on dense scriptural visuals and verbal-visual repetition, while poster-style presentations demonstrated more deliberate visual composition and rhetorical structuring. Although students exhibited emerging multimodal awareness, many struggled with elaborative intersemiotic relations, such as meronymy, hyponymy, and collocation. These findings suggest that students are in a transitional stage of developing genre-specific multimodal literacy. The study concludes with pedagogical implications for supporting the development of coherent and rhetorically effective multimodal academic communication.</div></div>","PeriodicalId":47717,"journal":{"name":"Journal of English for Academic Purposes","volume":"78 ","pages":"Article 101584"},"PeriodicalIF":3.4000,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Investigating verbal-visual mode interaction in medical audio-slide presentations\",\"authors\":\"Yu-Shan Fan , Muhammad Ibaad Khattak\",\"doi\":\"10.1016/j.jeap.2025.101584\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>This study examines 26 student-produced audio-slide presentations from an academic writing course at a medical university in Taiwan. The analysis focuses on the interaction between verbal and visual modes in this format, which features pre-recorded oral narration synchronized with static slides. Using Systemic Functional-Multimodal Discourse Analysis, three distinct presentation patterns—slide-based, poster-style, and text-based—were identified, each reflecting different configurations of academic discourse features and digital affordances. Slide- and text-based formats tended to rely on dense scriptural visuals and verbal-visual repetition, while poster-style presentations demonstrated more deliberate visual composition and rhetorical structuring. Although students exhibited emerging multimodal awareness, many struggled with elaborative intersemiotic relations, such as meronymy, hyponymy, and collocation. These findings suggest that students are in a transitional stage of developing genre-specific multimodal literacy. The study concludes with pedagogical implications for supporting the development of coherent and rhetorically effective multimodal academic communication.</div></div>\",\"PeriodicalId\":47717,\"journal\":{\"name\":\"Journal of English for Academic Purposes\",\"volume\":\"78 \",\"pages\":\"Article 101584\"},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2025-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of English for Academic Purposes\",\"FirstCategoryId\":\"98\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1475158525001158\",\"RegionNum\":1,\"RegionCategory\":\"文学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of English for Academic Purposes","FirstCategoryId":"98","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1475158525001158","RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
Investigating verbal-visual mode interaction in medical audio-slide presentations
This study examines 26 student-produced audio-slide presentations from an academic writing course at a medical university in Taiwan. The analysis focuses on the interaction between verbal and visual modes in this format, which features pre-recorded oral narration synchronized with static slides. Using Systemic Functional-Multimodal Discourse Analysis, three distinct presentation patterns—slide-based, poster-style, and text-based—were identified, each reflecting different configurations of academic discourse features and digital affordances. Slide- and text-based formats tended to rely on dense scriptural visuals and verbal-visual repetition, while poster-style presentations demonstrated more deliberate visual composition and rhetorical structuring. Although students exhibited emerging multimodal awareness, many struggled with elaborative intersemiotic relations, such as meronymy, hyponymy, and collocation. These findings suggest that students are in a transitional stage of developing genre-specific multimodal literacy. The study concludes with pedagogical implications for supporting the development of coherent and rhetorically effective multimodal academic communication.
期刊介绍:
The Journal of English for Academic Purposes provides a forum for the dissemination of information and views which enables practitioners of and researchers in EAP to keep current with developments in their field and to contribute to its continued updating. JEAP publishes articles, book reviews, conference reports, and academic exchanges in the linguistic, sociolinguistic and psycholinguistic description of English as it occurs in the contexts of academic study and scholarly exchange itself.