Perceiving Tempo in Incongruent Audiovisual Presentations of Human Motion: Evidence for a Visual Driving Effect

IF 1.4

Timing & Time Perception Pub Date : 2021-05-11 DOI:10.1163/22134468-BJA10036

Xinyue Wang, Clemens Wöllner, Zhuanghua Shi

{"title":"Perceiving Tempo in Incongruent Audiovisual Presentations of Human Motion: Evidence for a Visual Driving Effect","authors":"Xinyue Wang, Clemens Wöllner, Zhuanghua Shi","doi":"10.1163/22134468-BJA10036","DOIUrl":null,"url":null,"abstract":"\nCompared to vision, audition has been considered to be the dominant sensory modality for temporal processing. Nevertheless, recent research suggests the opposite, such that the apparent inferiority of visual information in tempo judgements might be due to the lack of ecological validity of experimental stimuli, and reliable visual movements may have the potential to alter the temporal location of perceived auditory inputs. To explore the role of audition and vision in overall time perception, audiovisual stimuli with various degrees of temporal congruence were developed in the current study. We investigated which sensory modality weighs more in holistic tempo judgements with conflicting audiovisual information, and whether biological motion (point-light displays of dancers) rather than auditory cues (rhythmic beats) dominate judgements of tempo. A bisection experiment found that participants relied more on visual tempo compared to auditory tempo in overall tempo judgements. For fast tempi (150 to 180 BPM), participants judged ‘fast’ significantly more often with visual cues regardless of the auditory tempo, whereas for slow tempi (60 to 90 BPM), they did so significantly less often. Our results support the notion that visual stimuli with higher ecological validity have the potential to drive up or down the holistic perception of tempo.","PeriodicalId":29927,"journal":{"name":"Timing & Time Perception","volume":"1 1","pages":""},"PeriodicalIF":1.4000,"publicationDate":"2021-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"5","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Timing & Time Perception","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1163/22134468-BJA10036","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 5

Abstract

Compared to vision, audition has been considered to be the dominant sensory modality for temporal processing. Nevertheless, recent research suggests the opposite, such that the apparent inferiority of visual information in tempo judgements might be due to the lack of ecological validity of experimental stimuli, and reliable visual movements may have the potential to alter the temporal location of perceived auditory inputs. To explore the role of audition and vision in overall time perception, audiovisual stimuli with various degrees of temporal congruence were developed in the current study. We investigated which sensory modality weighs more in holistic tempo judgements with conflicting audiovisual information, and whether biological motion (point-light displays of dancers) rather than auditory cues (rhythmic beats) dominate judgements of tempo. A bisection experiment found that participants relied more on visual tempo compared to auditory tempo in overall tempo judgements. For fast tempi (150 to 180 BPM), participants judged ‘fast’ significantly more often with visual cues regardless of the auditory tempo, whereas for slow tempi (60 to 90 BPM), they did so significantly less often. Our results support the notion that visual stimuli with higher ecological validity have the potential to drive up or down the holistic perception of tempo.

查看原文本刊更多论文

在令人不快的人类运动视听演示中感知节奏：视觉驱动效应的证据

与视觉相比，听觉被认为是时间处理的主要感觉模式。然而，最近的研究表明情况恰恰相反，视觉信息在节奏判断中的明显劣势可能是由于实验刺激缺乏生态有效性，而可靠的视觉运动可能有可能改变感知听觉输入的时间位置。为了探索听觉和视觉在整体时间感知中的作用，本研究开发了具有不同程度时间一致性的视听刺激。我们研究了在视听信息冲突的情况下，哪种感觉模式在整体节奏判断中更重要，以及生物运动（舞者的点光显示）而不是听觉线索（节奏节拍）是否主导了节奏判断。一项平分实验发现，在整体节奏判断中，参与者更依赖视觉节奏，而不是听觉节奏。对于快节奏（150至180 BPM），无论听觉节奏如何，参与者都会更频繁地用视觉线索判断“快”，而对于慢节奏（60至90 BPM），他们这样做的频率明显更低。我们的研究结果支持这样一种观点，即具有更高生态有效性的视觉刺激有可能提高或降低对节奏的整体感知。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Timing & Time Perception Multiple-

CiteScore

1.60

自引率

14.30%

发文量

期刊介绍： Timing & Time Perception aims to be the forum for all psychophysical, neuroimaging, pharmacological, computational, and theoretical advances on the topic of timing and time perception in humans and other animals. We envision a multidisciplinary approach to the topics covered, including the synergy of: Neuroscience and Philosophy for understanding the concept of time, Cognitive Science and Artificial Intelligence for adapting basic research to artificial agents, Psychiatry, Neurology, Behavioral and Computational Sciences for neuro-rehabilitation and modeling of the disordered brain, to name just a few. Given the ubiquity of interval timing, this journal will host all basic studies, including interdisciplinary and multidisciplinary works on timing and time perception and serve as a forum for discussion and extension of current knowledge on the topic.