Dynamic audio-visual correspondence in musicians and non-musicians

IF 1.6 3区 心理学 0 MUSIC
Xiyu Guo, Jianning Qu, Mengying Liu, Chuanjun Liu, Jianping Huang
{"title":"Dynamic audio-visual correspondence in musicians and non-musicians","authors":"Xiyu Guo, Jianning Qu, Mengying Liu, Chuanjun Liu, Jianping Huang","doi":"10.1177/03057356231185467","DOIUrl":null,"url":null,"abstract":"Most previous audio-visual crossmodal correspondence studies focused on static visual or auditory stimuli. Moreover, some researchers have found that music training can effectively improve the interaction between auditory and visual channels by enhancing neural plasticity. This study focused on whether crossmodal correspondence occurs when people face dynamic visual and auditory stimuli, and whether it is affected by musical training. Participants were asked to judge different changes in pitch (rise and drop) by showing them different patterns of visual circle motion (enlarged, reduced, and unchanged). The results revealed that the audio-visual congruent combinations (the pitch rise when the circle was enlarged and the pitch drop when the circle was reduced) significantly shortened participants’ response times, whereas the audio-visual neutral combinations (the unchanged shape) had the highest accuracy. Participants with musical training were faster than participants without musical training to judge pitch changes in conditions where the association between pitch and shape size was incongruent. These findings provide empirical evidence for dynamic audio-visual crossmodal correspondence and shed light on the bright prospect of using congruent audio-visual stimuli in animation.","PeriodicalId":47977,"journal":{"name":"Psychology of Music","volume":null,"pages":null},"PeriodicalIF":1.6000,"publicationDate":"2023-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychology of Music","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/03057356231185467","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"MUSIC","Score":null,"Total":0}
引用次数: 0

Abstract

Most previous audio-visual crossmodal correspondence studies focused on static visual or auditory stimuli. Moreover, some researchers have found that music training can effectively improve the interaction between auditory and visual channels by enhancing neural plasticity. This study focused on whether crossmodal correspondence occurs when people face dynamic visual and auditory stimuli, and whether it is affected by musical training. Participants were asked to judge different changes in pitch (rise and drop) by showing them different patterns of visual circle motion (enlarged, reduced, and unchanged). The results revealed that the audio-visual congruent combinations (the pitch rise when the circle was enlarged and the pitch drop when the circle was reduced) significantly shortened participants’ response times, whereas the audio-visual neutral combinations (the unchanged shape) had the highest accuracy. Participants with musical training were faster than participants without musical training to judge pitch changes in conditions where the association between pitch and shape size was incongruent. These findings provide empirical evidence for dynamic audio-visual crossmodal correspondence and shed light on the bright prospect of using congruent audio-visual stimuli in animation.
音乐家和非音乐家的动态视听通信
以前的大多数视听跨模态对应研究都集中在静态视觉或听觉刺激上。此外,一些研究人员发现,音乐训练可以通过增强神经可塑性,有效改善听觉和视觉通道之间的互动。这项研究的重点是当人们面对动态视觉和听觉刺激时,跨模态对应是否发生,以及它是否受到音乐训练的影响。参与者被要求通过向他们展示不同的视觉圆圈运动模式(放大、缩小和不变)来判断音高的不同变化(上升和下降)。结果表明,视听一致组合(圆圈扩大时音高上升,圆圈缩小时音高下降)显著缩短了参与者的反应时间,而视听中性组合(形状不变)的准确率最高。在音高和形状大小之间的关联不一致的情况下,接受过音乐训练的参与者比没有接受过音乐培训的参与者更快地判断音高的变化。这些发现为动态视听跨模态对应提供了经验证据,并为在动画中使用一致的视听刺激提供了光明的前景。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
4.00
自引率
17.60%
发文量
88
期刊介绍: Psychology of Music and SEMPRE provide an international forum for researchers working in the fields of psychology of music and music education, to encourage the exchange of ideas and to disseminate research findings. Psychology of Music publishes peer-reviewed papers directed at increasing the scientific understanding of any psychological aspect of music. These include studies on listening, performing, creating, memorising, analysing, describing, learning, and teaching, as well as applied social, developmental, attitudinal and therapeutic studies. Special emphasis is placed on studies carried out in naturalistic settings, especially those which address the interface between music psychology and music education.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信