Multisensory Research最新文献_第3页

Shifting Fall Perception: How Virtual Reality Alters the Precision of Estimating Postural Instability Onset. 移动跌倒感知：虚拟现实如何改变估计姿势不稳定发作的精度。

IF 1.5 4区心理学

Multisensory Research Pub Date : 2026-05-19 DOI: 10.1163/22134808-bja10195

Robert E McIlroy, Michael Barnett-Cowan

{"title":"Shifting Fall Perception: How Virtual Reality Alters the Precision of Estimating Postural Instability Onset.","authors":"Robert E McIlroy, Michael Barnett-Cowan","doi":"10.1163/22134808-bja10195","DOIUrl":"https://doi.org/10.1163/22134808-bja10195","url":null,"abstract":"Perceiving postural instability accurately is crucial for fall prevention. While sensory integration of visual, vestibular, and somatosensory inputs is known to influence balance, the specific impact of high-consequence visual contexts, such as exposure to height, remains under-investigated due to safety constraints in physical environments. This study serves as a proof-of-concept investigation into the use of virtual reality (VR) for manipulating visual context during a postural temporal-order judgement task. In Experiment 1, participants performed the task in real-world conditions (eyes closed and eyes open). Perceived onset of instability was delayed in both conditions (eyes closed: 25.78 ms; eyes open: 12.33 ms), but these did not differ significantly from true simultaneity. Experiment 2 used VR to safely place participants at the edge of a virtual skyscraper. While perceptual delays remained nonsignificant, precision increased significantly in VR (26.89% increase) compared to the real-world eyes-open condition. These results suggest that while the perceived timing of instability is robust, the presence of a high-arousal visual context in VR enhances the precision of multisensory decision-making. As a foundational step in validating VR-based psychophysical balance assessments, these findings demonstrate the feasibility of using virtual environments to study complex sensory motor integration that is difficult to replicate in naturalistic settings.","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-31"},"PeriodicalIF":1.5,"publicationDate":"2026-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147984243","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Duration, Sequence and Beat Perception across Modalities. 跨模态的持续时间，序列和节拍感知。

IF 1.5 4区心理学

Multisensory Research Pub Date : 2026-05-13 DOI: 10.1163/22134808-bja10194

Zhaleh Mohammad Alipour, Blake E Butler, Jessica A Grahn

{"title":"Duration, Sequence and Beat Perception across Modalities.","authors":"Zhaleh Mohammad Alipour, Blake E Butler, Jessica A Grahn","doi":"10.1163/22134808-bja10194","DOIUrl":"https://doi.org/10.1163/22134808-bja10194","url":null,"abstract":"Certain rhythmic sequences spontaneously induce the perception of a beat: a psychologically salient pulse that marks equally spaced points in time. However, individuals vary considerably in beat perception ability. This variability may arise from variability at multiple levels of a perceptual timing hierarchy of durations, sequences and beat. Specifically, variability could reflect individual differences in basic duration perception, even for single intervals, as single intervals are the building blocks for sequences. Alternatively, it could relate to differences in the timing or recall of temporal sequences despite good single-interval timing, as a sequence needs to be encoded accurately for an underlying beat to be perceived. Finally, it is possible that beat perception variability is specifically related to listeners' ability to extract the beat from temporal sequences. To determine whether evidence supports this three-level perceptual timing hierarchy, and how beat perception ability relates to single-duration and sequence perception ability, we tested performance on single-interval timing, nonbeat sequence timing, and beat sequence timing tasks using a three-alternative forced-choice paradigm. Moreover, we presented both visual and auditory stimuli to determine whether perceptual abilities across sensory modalities are related or independent. We applied a k-means clustering algorithm to partition participants based on task performance. The results support the three-level perceptual hierarchy in the auditory modality, and that beat perception deficits can arise from deficits at any level of the hierarchy. However, the hierarchy did not hold for the visual modality, suggesting rhythm and beat perception vary across modalities.","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-31"},"PeriodicalIF":1.5,"publicationDate":"2026-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147977028","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Tasting Accents: Three Studies on the Influence of Regional Accents on People's Expectations and Perception of Food. 品尝口音：地域口音对人们对食物的期望和感知影响的三项研究。

IF 1.5 4区心理学

Multisensory Research Pub Date : 2026-05-12 DOI: 10.1163/22134808-bja10193

Iuri Baptista, Charles Spence, Johan Swahn

引用次数: 0

Brief Audiovisual Feedback Training Yields Long-Lasting Gains in Multisensory Integration and Speech Comprehension: Contributions of Different Cognitive Abilities. 简短的视听反馈训练在多感觉整合和语言理解方面产生持久的收益：不同认知能力的贡献。

IF 1.5 4区心理学

Multisensory Research Pub Date : 2026-05-06 DOI: 10.1163/22134808-bja10192

Anna Borgolte, Laura Möde, Meriam Hamadouche, Stefan Bleich, Gregor Rafael Szycik, Erfan Ghaneirad

{"title":"Brief Audiovisual Feedback Training Yields Long-Lasting Gains in Multisensory Integration and Speech Comprehension: Contributions of Different Cognitive Abilities.","authors":"Anna Borgolte, Laura Möde, Meriam Hamadouche, Stefan Bleich, Gregor Rafael Szycik, Erfan Ghaneirad","doi":"10.1163/22134808-bja10192","DOIUrl":"https://doi.org/10.1163/22134808-bja10192","url":null,"abstract":"The ability to integrate information from different sensory modalities, such as vision and hearing, enables us to perceive and understand complex stimuli. The relevance of this ability can be seen in speech perception, for example, which requires the integration of auditory (e.g., voice) and visual (e.g., lip movements) information. Recent studies have shown that the accuracy of this integration process, and thus speech comprehension, can be improved by brief audiovisual feedback training. However, the long-term stability as well as associated cognitive mechanisms are not yet fully understood. In the present study, we evaluated the effect of a short audiovisual feedback training on multisensory integration and speech perception using three different paradigms. Audiovisual integration was evaluated at three distinct time points: pretraining, immediately post-training and 12 days later. To investigate the relationship between training efficacy and specific cognitive abilities, participants underwent the German version of the Wechsler Adult Intelligence Scale (WAIS-IV), which assesses language comprehension, perceptional reasoning, processing speed, working memory and overall intelligence quotient. Notably, our results indicate a sustained enhancement in audiovisual integration and speech perception that persisted for up to 12 days following the training. No associations with cognitive abilities were found. The findings indicate that a brief audiovisual feedback training enables long-term improvements in multisensory integration, independent of cognitive abilities.","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-21"},"PeriodicalIF":1.5,"publicationDate":"2026-05-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147977085","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Sensory Integration and Cognitive Motor Interference of Postural Control in Older Adults with Mild Cognitive Impairment: A Literature Review. 老年轻度认知障碍患者体位控制的感觉统合和认知运动干扰：文献综述。

IF 2.1 4区心理学

Multisensory Research Pub Date : 2026-04-28 DOI: 10.1163/22134808-bja10191

Genevieve B Smith, Richard Magill, Ashwini K Rao

{"title":"Sensory Integration and Cognitive Motor Interference of Postural Control in Older Adults with Mild Cognitive Impairment: A Literature Review.","authors":"Genevieve B Smith, Richard Magill, Ashwini K Rao","doi":"10.1163/22134808-bja10191","DOIUrl":"10.1163/22134808-bja10191","url":null,"abstract":"Older adults with mild cognitive impairment (MCI) have a higher risk for falls than cognitively healthy older adults. Risk factors for the increased risk for falls includes impaired postural control. The purpose of this literature review is to explore the literature examining the sensory strategies and cognitive processes of postural control in older adults with MCI. We included research papers examining sensory manipulations and cognitive motor interference on postural outcomes during static balance conditions between older adults with and without MCI utilizing instrumented assessments. Results of this review are mixed. While some research suggests older adults with MCI demonstrate differences in postural-sway outcome measures compared to older adults without MCI during static balance conditions with different sensory manipulations, this is not universal among all studies included in this review. Additional research suggests older adults with MCI demonstrate differences in postural-sway outcome measures for single- and dual-task motor performance and differences in single- and dual-task cognitive performance, but some studies included in this review found no group differences. While there is some evidence suggesting older adults with MCI demonstrate differences in postural-sway measures with sensory manipulations and cognitive motor interference on postural outcomes during static balance conditions compared to cognitively healthy older adults, results of this review are inconclusive. Future research is needed to understand postural control strategies with altered sensory input and cognitive motor interference in older adults with MCI during static balance conditions, which can enhance the effectiveness of fall prevention programs and reduce the future risk of falls.","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"471-491"},"PeriodicalIF":2.1,"publicationDate":"2026-04-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147823329","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Enhancing the Effectiveness of the Visual to Auditory Sensory Substitution Training Program through Learning Theories. 运用学习理论提高视听感觉替代训练的有效性。

IF 2.1 4区心理学

Multisensory Research Pub Date : 2026-04-22 DOI: 10.1163/22134808-bja10190

Sojung Park, Seoyeon Jin, Insook Han

{"title":"Enhancing the Effectiveness of the Visual to Auditory Sensory Substitution Training Program through Learning Theories.","authors":"Sojung Park, Seoyeon Jin, Insook Han","doi":"10.1163/22134808-bja10190","DOIUrl":"10.1163/22134808-bja10190","url":null,"abstract":"Sensory substitution transforms information normally received by impaired senses into alternate sensory inputs, leveraging brain plasticity to provide better access to visual information for individuals with sensory limitations. Visual to Auditory Sensory Substitution (VASS) converts visual data into auditory cues, aiding individuals with visual impairments. Despite prior research validating sensory substitution, effective VASS training programs remain underdeveloped. This study aims to address this gap by designing and evaluating a VASS training program based on educational theories like conceptual learning and information processing. A training program was developed for learning 23 shapes and figures, incorporating instructional strategies from educational psychology. The learning tasks were organized into modules that included review sessions, concept learning, repetitive practice, and assessments. The program's impact was assessed through a randomized experiment comparing a theory-based program with traditional repetitive training methods. Short-term and sustained outcomes were evaluated using midpoint test, immediate post-test, delayed post-test, and transfer test. The study involved adult learners without visual or auditory impairments to promote efficient program development and effectiveness evaluation. Statistically significant improvements were observed in the experimental group's midpoint and immediate post-test scores compared to the control group. However, no significant differences were found in the delayed post-test and transfer test. The findings suggest that integrating instructional design and learning strategies can lead to more effective training programs to support rehabilitation efforts for individuals with visual impairments. Further implications for rehabilitation are discussed.","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"621-648"},"PeriodicalIF":2.1,"publicationDate":"2026-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147977078","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Sweet Is Soft, Bitter Is Rough: Evidence for a Shared Emotional Dimension Across Taste and Touch. 甜是软的，苦是粗糙的：味觉和触觉共享情感维度的证据。

IF 2.1 4区心理学

Multisensory Research Pub Date : 2026-04-03 DOI: 10.1163/22134808-bja10189

Jongwan Kim

{"title":"Sweet Is Soft, Bitter Is Rough: Evidence for a Shared Emotional Dimension Across Taste and Touch.","authors":"Jongwan Kim","doi":"10.1163/22134808-bja10189","DOIUrl":"10.1163/22134808-bja10189","url":null,"abstract":"Although taste and touch are processed through separate sensory channels, both elicit strong emotional responses that may share an underlying affective organization. This study investigated whether gustatory and tactile experiences are structured within a common emotional coordinate system defined by valence and arousal. To address this question, we re-analyzed two previously collected datasets, one for taste-based emotion ratings and one for tactile emotion ratings. In two independent datasets, 30 participants evaluated four taste stimuli (sweet, sour, bitter, and salty) on ten affective adjectives, while a separate group of 27 participants rated four tactile textures (rough-hard, rough-soft, smooth-hard, and smooth-soft) on twenty affective adjectives. Principal component analyses of the group-averaged emotion matrices revealed comparable two-dimensional affective spaces in both modalities, corresponding to pleasant-unpleasant and high-low arousal dimensions. Procrustes alignment and consensus mapping demonstrated strong geometric correspondence between taste and touch, with sweet aligning most closely with smooth-soft, sour with smooth-hard, salty with rough-hard, and bitter with rough-soft. Quantitatively, the Procrustes distance was low ( d = 0.094), the mean cosine similarity across pairs was 0.70, and the Mantel test showed a significant correlation ( r = 0.90, p = 0.04), confirming robust cross-modal affective similarity. A combined multidimensional scaling solution further integrated both modalities into a unified affective map with negligible stress. Together, these results provide converging evidence that affective responses to taste and touch follow a shared low-dimensional structure, supporting the idea that affective responses across modalities can be represented within a common evaluative coordinate space. This finding highlights emotion as a unifying representational framework that bridges distinct perceptual domains and informs multisensory theories of affect.","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"597-619"},"PeriodicalIF":2.1,"publicationDate":"2026-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147619227","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

When in Doubt, Touch Is More Convincing Than Vision. 当有疑问时，触摸比视觉更有说服力。

IF 2.1 4区心理学

Multisensory Research Pub Date : 2026-03-24 DOI: 10.1163/22134808-bja10188

Merle T Fairhurst, Eoin Travers, Isabelle Ripp, Ophelia Deroy, Vincent Hayward

{"title":"When in Doubt, Touch Is More Convincing Than Vision.","authors":"Merle T Fairhurst, Eoin Travers, Isabelle Ripp, Ophelia Deroy, Vincent Hayward","doi":"10.1163/22134808-bja10188","DOIUrl":"10.1163/22134808-bja10188","url":null,"abstract":"We sometimes feel compelled to touch objects after having looked at them. Is this because touch gives us more accurate information, or is it simply because we tend to trust what we feel more than what we see? To disentangle these possibilities, participants were subjected to a variant of the 'Vertical-Horizontal' illusion where the length of a vertical bar is consistently overestimated relative to the length of a horizontal bar. Our variant focuses on points of subjective equality where the bars almost look the same, and possesses two key characteristics: it creates ambiguity as stimuli can be subjectively similar yet objectively distinct and operates both in vision and touch. In a forced resampling bimodal experiment, participants inspected the stimuli using both vision and touch, judged which bar appeared longer, and rated their confidence. They then re-examined the same objects using either vision or touch, as instructed, and provided a second judgement with another confidence rating. Resampling did not significantly improve the overall accuracy, but participants were more likely to change their mind when using touch. In a second, free resampling bimodal experiment, participants chose their preferred modality for reinspection. Neither modality led to more accurate responses, but participants chose to resample by touch increasingly more frequently when the vertical and horizontal bars' lengths were closer in perceived size, leading to higher ambiguity. Additionally, they were more likely to change their mind under these ambiguous conditions. These findings suggest a selective bias toward touch in case of ambiguity, even when it offers no objective advantage over vision.","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":"39 3-5","pages":"399-415"},"PeriodicalIF":2.1,"publicationDate":"2026-03-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147596231","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Overlapping Effects of Music Training on Multisensory and Emotion Processing: A Systematic Review. 音乐训练对多感觉和情绪加工的重叠效应：系统回顾。

IF 2.1 4区心理学

Multisensory Research Pub Date : 2026-02-20 DOI: 10.1163/22134808-bja10186

Yuqing Che, Kristina Eva Manda, Indi Parmar, Chris Ashwin, Karin Petrini

{"title":"Overlapping Effects of Music Training on Multisensory and Emotion Processing: A Systematic Review.","authors":"Yuqing Che, Kristina Eva Manda, Indi Parmar, Chris Ashwin, Karin Petrini","doi":"10.1163/22134808-bja10186","DOIUrl":"10.1163/22134808-bja10186","url":null,"abstract":"Evidence suggests musicians have enhanced audiovisual and emotion recognition abilities. However, these two lines of research have generally been separated in the literature, despite these processes being similarly altered in certain populations (e.g., autism, schizophrenia). The current systematic review presents a comprehensive picture of the effect of music training on behavioural and neural changes in audiovisual and emotion recognition processes, to better understand where they might overlap or share any similarities. It additionally assessed the impact of different music training factors (i.e., training onset, length, type of musical instrument and the type of research task). Finally, this review aimed to produce a clearer understanding of whether the effects of music training extend beyond the music and sound domain. Following PRISMA guidelines, 64 papers were identified, of which 41 examined audiovisual processing, 20 investigated emotion processing, and three examined both processes. The available evidence revealed a consistent musician's advantage for some audiovisual processes (e.g., audiovisual temporal correspondence), with some evidence that this advantage extended beyond the music domain. Consistent musician's advantages were also found for processing basic emotions from speech prosody, with some evidence that this extended to complex emotions. A shared brain network for these effects was identified comprising the anterior cingulate cortex and superior frontal gyrus. Together, our findings suggest that audiovisual and emotion recognition processes share a number of similarities in how music training can shape them. Further research should directly explore the combined effect of music training on multisensory and emotion recognition to inform effective music interventions aimed at enhancing these processes.","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"543-595"},"PeriodicalIF":2.1,"publicationDate":"2026-02-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147596216","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Audiovisual Contributions to the Occurrence of Roll Vection in Virtual Reality. 视听对虚拟现实中滚动向量发生的贡献。

IF 1.5 4区心理学

Multisensory Research Pub Date : 2026-02-17 DOI: 10.1163/22134808-bja10187

Max Teaford, Shyla S Khan, Tanner Greene, Sandra Pullam, Jacqueline Lawshe, Jackson Shaheen

{"title":"Audiovisual Contributions to the Occurrence of Roll Vection in Virtual Reality.","authors":"Max Teaford, Shyla S Khan, Tanner Greene, Sandra Pullam, Jacqueline Lawshe, Jackson Shaheen","doi":"10.1163/22134808-bja10187","DOIUrl":"https://doi.org/10.1163/22134808-bja10187","url":null,"abstract":"Vection (i.e., the experience of self-motion in the absence of actual motion), has traditionally been considered a visual phenomenon. However, recent work on yaw vection (i.e., illusory rotations around the vertical axis), suggests that auditory cues may contribute to vection as well; specifically, if the sounds are similar to those heard in the real world and come from a sound source that typically remains in the same spatial location. In the present study, we sought to determine if roll vection (i.e., illusory rotations around the longitudinal axis) is also enhanced by auditory cues. To test this possibility, we had 44 participants experience three different combinations of sensory cues (audiovisual, visual-only and auditory-only), which were presented via virtual reality a total of three times each. We found that participants experienced vection sooner and more convincingly the first two times they were exposed to the audiovisual condition relative to the visual-only and auditory-only conditions. However, there was no difference between the audiovisual and visual-only condition the third time they experienced them. Regardless of the number of times the participants experienced each condition, the audiovisual and visual-only conditions were always characterized by higher convincingness ratings and lower onset latencies than the auditory-only condition. In tandem, these results suggest that audiovisual stimuli can indeed elicit roll vection that starts earlier and is more convincing than unisensory variants of the stimuli (i.e., visual-only and auditory-only). However, the benefit of including auditory cues diminishes over the course of repetitions suggesting that the brain may down-weight auditory cues. Future studies are needed to better characterize the mechanisms underlying this finding and other factors which may impact this effect (e.g., sound type and field-of-view size).","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-22"},"PeriodicalIF":1.5,"publicationDate":"2026-02-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146214991","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0