{"title":"音乐家和非音乐家的动态视听通信","authors":"Xiyu Guo, Jianning Qu, Mengying Liu, Chuanjun Liu, Jianping Huang","doi":"10.1177/03057356231185467","DOIUrl":null,"url":null,"abstract":"Most previous audio-visual crossmodal correspondence studies focused on static visual or auditory stimuli. Moreover, some researchers have found that music training can effectively improve the interaction between auditory and visual channels by enhancing neural plasticity. This study focused on whether crossmodal correspondence occurs when people face dynamic visual and auditory stimuli, and whether it is affected by musical training. Participants were asked to judge different changes in pitch (rise and drop) by showing them different patterns of visual circle motion (enlarged, reduced, and unchanged). The results revealed that the audio-visual congruent combinations (the pitch rise when the circle was enlarged and the pitch drop when the circle was reduced) significantly shortened participants’ response times, whereas the audio-visual neutral combinations (the unchanged shape) had the highest accuracy. Participants with musical training were faster than participants without musical training to judge pitch changes in conditions where the association between pitch and shape size was incongruent. These findings provide empirical evidence for dynamic audio-visual crossmodal correspondence and shed light on the bright prospect of using congruent audio-visual stimuli in animation.","PeriodicalId":47977,"journal":{"name":"Psychology of Music","volume":null,"pages":null},"PeriodicalIF":1.6000,"publicationDate":"2023-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Dynamic audio-visual correspondence in musicians and non-musicians\",\"authors\":\"Xiyu Guo, Jianning Qu, Mengying Liu, Chuanjun Liu, Jianping Huang\",\"doi\":\"10.1177/03057356231185467\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Most previous audio-visual crossmodal correspondence studies focused on static visual or auditory stimuli. Moreover, some researchers have found that music training can effectively improve the interaction between auditory and visual channels by enhancing neural plasticity. This study focused on whether crossmodal correspondence occurs when people face dynamic visual and auditory stimuli, and whether it is affected by musical training. Participants were asked to judge different changes in pitch (rise and drop) by showing them different patterns of visual circle motion (enlarged, reduced, and unchanged). The results revealed that the audio-visual congruent combinations (the pitch rise when the circle was enlarged and the pitch drop when the circle was reduced) significantly shortened participants’ response times, whereas the audio-visual neutral combinations (the unchanged shape) had the highest accuracy. Participants with musical training were faster than participants without musical training to judge pitch changes in conditions where the association between pitch and shape size was incongruent. These findings provide empirical evidence for dynamic audio-visual crossmodal correspondence and shed light on the bright prospect of using congruent audio-visual stimuli in animation.\",\"PeriodicalId\":47977,\"journal\":{\"name\":\"Psychology of Music\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.6000,\"publicationDate\":\"2023-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Psychology of Music\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1177/03057356231185467\",\"RegionNum\":3,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"0\",\"JCRName\":\"MUSIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychology of Music","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/03057356231185467","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"MUSIC","Score":null,"Total":0}
Dynamic audio-visual correspondence in musicians and non-musicians
Most previous audio-visual crossmodal correspondence studies focused on static visual or auditory stimuli. Moreover, some researchers have found that music training can effectively improve the interaction between auditory and visual channels by enhancing neural plasticity. This study focused on whether crossmodal correspondence occurs when people face dynamic visual and auditory stimuli, and whether it is affected by musical training. Participants were asked to judge different changes in pitch (rise and drop) by showing them different patterns of visual circle motion (enlarged, reduced, and unchanged). The results revealed that the audio-visual congruent combinations (the pitch rise when the circle was enlarged and the pitch drop when the circle was reduced) significantly shortened participants’ response times, whereas the audio-visual neutral combinations (the unchanged shape) had the highest accuracy. Participants with musical training were faster than participants without musical training to judge pitch changes in conditions where the association between pitch and shape size was incongruent. These findings provide empirical evidence for dynamic audio-visual crossmodal correspondence and shed light on the bright prospect of using congruent audio-visual stimuli in animation.
期刊介绍:
Psychology of Music and SEMPRE provide an international forum for researchers working in the fields of psychology of music and music education, to encourage the exchange of ideas and to disseminate research findings. Psychology of Music publishes peer-reviewed papers directed at increasing the scientific understanding of any psychological aspect of music. These include studies on listening, performing, creating, memorising, analysing, describing, learning, and teaching, as well as applied social, developmental, attitudinal and therapeutic studies. Special emphasis is placed on studies carried out in naturalistic settings, especially those which address the interface between music psychology and music education.