Multisensory Research最新文献

{"title":"Viewpoint on Multisensory Time Perception.","authors":"Zhuanghua Shi, Virginie van Wassenhove","doi":"10.1163/22134808-bja10209","DOIUrl":"https://doi.org/10.1163/22134808-bja10209","url":null,"abstract":"<p><p>In this viewpoint article, Zhuanghua Shi and Virginie van Wassenhove discuss the past, present, and future of multisensory time perception. Drawing on decades of research, they argue that the field has undergone an important shift from the centralized internal clock toward timing as an active inference process. This framework, rooted in Bayesian models and predictive coding, suggests that our sense of time is not a passive readout but a construction that weighs evidence against contextual expectations. One thread in the discussion concerns the temporal window of integration: the authors contrast the narrow, potentially misleading windows seen with simple beeps and flashes with those, more stable, found in audiovisual speech. The authors also explore the interplay between automatic integration and top-down processes - such as attention and expectation - noting the brain's remarkable ability to rewrite recent history through postdictive inference to maintain a unified 'now'. Key controversies are raised and include whether timing relies on dedicated circuits or emerges from neural population dynamics, as well as the specific role of neural oscillations in parsing simultaneous inputs. The authors advocate for biological plausibility and the use of time-resolved encoding-decoding modeling approaches to predict brain activity. They emphasize the use of open-science practices, including the sharing of computational models and datasets. Looking ahead, the authors anticipate that AI will revolutionize the field by handling the computational complexity of massive datasets through 'vibe coding', allowing researchers to focus on fundamental theoretical insights. They advise young scientists to develop strong scientific intuitions before expanding into modeling and to remain bold in bridging multisensory perception with cognition (incl. consciousness and linguistics). The authors emphasize that multisensory timing is central for developing sensory prostheses, and a deeper understanding of how the brain achieves a seamless experience of reality.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-8"},"PeriodicalIF":2.1,"publicationDate":"2026-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148801264","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Viewpoint on Multisensory Integration in Psychiatric Disorders.","authors":"Sophie Molholm, Jean-Paul Noel, Mark T Wallace","doi":"10.1163/22134808-bja10207","DOIUrl":"10.1163/22134808-bja10207","url":null,"abstract":"<p><p>This article presents a compiled interview with three researchers in the field of multisensory integration, with an emphasis on how multisensory integration may go awry in psychiatric and neurodevelopmental conditions. Through structured dialogue, the authors reflect on the origins of the field, the development of key empirical and computational frameworks, and the growing relevance of multisensory science for understanding autism, schizophrenia, dyslexia, and related conditions. The discussion highlights the shift from descriptive accounts of multisensory phenomena toward normative models, including maximum likelihood estimation, causal inference, and correlation detection, as well as the need to link these computations to neural circuits and clinical heterogeneity. The authors consider ongoing challenges in the field, including inconsistent findings across clinical studies, limited statistical power, difficulties in defining and measuring multisensory function, and the need for larger, better-characterized cohorts. They also discuss emerging directions, including naturalistic paradigms, adaptive coding, open and team science, precision psychiatry, and the application of artificial intelligence to complex multimodal datasets. The interview concludes by emphasizing the promise of multisensory integration as a framework for understanding perception, cognition, and belief updating in health and disease.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-10"},"PeriodicalIF":2.1,"publicationDate":"2026-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148801287","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Viewpoint on Multisensory Technologies.","authors":"Monica Gori, Micah M Murray","doi":"10.1163/22134808-bja10210","DOIUrl":"https://doi.org/10.1163/22134808-bja10210","url":null,"abstract":"<p><p>In this viewpoint article, Monica Gori and Micah Murray share their perspectives on past, present, and future developments in multisensory technologies and their impact on society, as well as career perspectives for trainees. Using seminal works on the neurobiological bases of multisensory processes and their development as springboards, they discuss how they foresee continued advancements in the technologies for studying multisensory processes and rehabilitating/replacing sensory impairments. They see a strong tendency toward understanding inter- and intra-individual variability in multisensory processes and their plasticity as well as a societal impetus to transition from laboratory-based to applied research with bespoke solutions for individuals. These tendencies also encapsulate current controversies regarding the boundaries of neuroplasticity as well as the potential double-edged sword of AI-based technologies that have tremendous positive impact though perhaps at the 'cost' of negative collateral impact on functional capabilities. The domain of multisensory technologies offers trainees a wide breadth of career opportunities not only in academic research, but also in applied/industrial fields. Continued ameliorations in multisensory technologies are an exciting domain at the intersection of applied, basic, and clinical research wherein many inroads remain to be achieved.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-12"},"PeriodicalIF":2.1,"publicationDate":"2026-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148801245","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The Vestibular System Influences the Perceived Duration of Lights But Not of Sounds or Touches.","authors":"Fatemeh Ghasemi, Laurence R Harris","doi":"10.1163/22134808-bja10204","DOIUrl":"https://doi.org/10.1163/22134808-bja10204","url":null,"abstract":"<p><p>Accurately perceiving the duration of stimuli is important for many human behaviours, especially those involving movement such as when catching a ball. However, perceived duration is reportedly different depending on which sense is being monitored, with auditory stimuli often judged as longer than a matched visual stimulus. Recent experiments have implicated gravity in duration perception, but rigorous psychophysical methods have been lacking. Here, we developed a novel psychometric method for measuring perceived duration and manipulated the reliability of gravity by altering posture and by disruptive galvanic vestibular stimulation (dGVS). We assessed people's judgements of 1 s using visual (an LED), auditory (200 Hz at 56 dB played through headphones) or tactile (200 Hz played through tactors mounted on the backs of the hands) stimuli. Participants judged whether each stimulus, the duration of which was controlled by a QUick Estimation by Sequential Testing (QUEST) staircase, was longer or shorter than their internal estimate of 1 s in two postures: supine and standing. We also compared visual duration judgements in the presence of dGVS with those collected during sham stimulation to the neck. The perceived durations of auditory and tactile events were not affected by changing posture, but the perceived duration of a visual second was significantly longer when supine compared to when upright (by 45 ms) or during dGVS compared to during sham stimulation (by 66 ms). The duration of a light or tactile stimulus perceived as having a duration of 1 s was longer than the time needed for an auditory event to be perceived as being on for 1 s. We conclude that disrupting the vestibular system by lying supine or by electrical stimulation influences visual duration perception, but the perceived duration of auditory and tactile stimuli remains unaffected.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-12"},"PeriodicalIF":2.1,"publicationDate":"2026-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148801301","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A Systematic Review and Meta-Analysis of Audiovisual Multisensory Integration in Schizophrenia Spectrum Disorders.","authors":"Tyler C Dalal, Noah Brierley, Anne-Marie Muller, Ryan A Stevenson","doi":"10.1163/22134808-bja10202","DOIUrl":"https://doi.org/10.1163/22134808-bja10202","url":null,"abstract":"<p><p>A growing body of literature suggests that there may be deficits in audiovisual multisensory integration in schizophrenia at both the nonsocial and social levels of stimuli. The present study provides a meta-analytic synthesis of the literature on audiovisual multisensory integration in schizophrenia to evaluate if there are deficits in multisensory integration in schizophrenia relative to healthy controls (HCs) and whether these deficits are more prominent with certain types of stimuli. Initial searches identified 1552 articles for review, with 17 studies deemed appropriate for inclusion in the meta-analysis. Findings confirm that individuals with schizophrenia exhibit impaired multisensory integration relative to HCs, d = 0.60, 95% CI [0.46, 0.75]. This impairment was seen regardless of stimulus type, across both social, d = 0.71, 95% CI [0.50, 0.91], and nonsocial, d = 0.49, 95% CI [0.27, 0.71] stimuli and did not significantly differ ( p = 0.150). These findings strengthen the past literature suggesting individuals with schizophrenia do exhibit deficits in multisensory integration across multiple levels of stimuli. Clinical implications are discussed.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-20"},"PeriodicalIF":2.1,"publicationDate":"2026-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148686620","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"On the Multisensory Experience of Humidity: A Multidisciplinary and Multicultural Perspective.","authors":"Antonella Mazzone, Charles Spence","doi":"10.1163/22134808-bja10197","DOIUrl":"https://doi.org/10.1163/22134808-bja10197","url":null,"abstract":"<p><p>In this narrative historical review, we take a critical look at the multisensory experience of atmospheric moisture. While not sensed directly (rather, at its most basic, it is a touch blend), this sensation, which can be either positive or negatively valenced (in part, depending on whether we are in charge of the experience), reflects an inference about the environmental conditions as potentially assessed at the skin surface. The perception of humidity has been largely ignored by the long history of research on tactile psychophysics and instead appears only recently in the writings of environmental psychologists. Nevertheless, the perception of humidity is likely to become a growing environmental issue (e.g., in the era of global climate change). We look at the multisensory influences on the perception of humidity, a crucial component of thermal comfort, and possible individual, group, and cultural differences.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-27"},"PeriodicalIF":2.1,"publicationDate":"2026-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148686600","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Investigating the Time-Course of Verticality Sensitivity Changes During Visuo-Vestibular Conflict.","authors":"Emily C Perry, Andrew K Martin, Maria Gallagher","doi":"10.1163/22134808-bja10201","DOIUrl":"https://doi.org/10.1163/22134808-bja10201","url":null,"abstract":"<p><p>Verticality perception is a multisensory process that relies primarily on visual and vestibular input. Previous studies show that sensory conflict induced by optic flow causes increased errors in verticality perception. However, the time course over which sensory conflict alters verticality perception and the processes through which perceptual stability is subsequently restored, remain unknown. Experiment 1 aimed to examine how verticality perception changes over time in response to sensory conflict and Experiment 2 aimed to determine whether verticality perception recovers following the removal of a sensory conflict. Sensory conflict was induced using optic flow, such that visual cues signalled self-motion while vestibular input provided no self-motion signal. Sensitivity to verticality was measured using a Vertical Detection Task (VDT) in which participants judged whether lines were vertically oriented or not. Signal detection theory was used to analyse responses, where d ' was an index of perceptual sensitivity to verticality and criterion was a measure of response bias. In Experiment 1 participants completed the detection task whilst either roll optic flow or randomly moving dots were presented in the background. Results showed that d ' was significantly lower in the roll-optic flow condition, with this effect varying as a function of time. Specifically, d ' was significantly lower in the roll versus random visual stimulation condition for up to six minutes of exposure. Experiment 2 extended these findings by examining recovery from sensory conflict, comparing VDT performance during roll optic flow with performance at successive timepoints following its removal. Consistent with Experiment 1, d ' was significantly reduced during optic flow exposure. However, d ' returned to baseline levels by the first post-flow timepoint, indicating a rapid recovery of verticality sensitivity. Together, these findings demonstrate that sensory conflict reduces verticality sensitivity in a time-dependent manner, followed by rapid recovery within minutes after the conflict is removed.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-22"},"PeriodicalIF":2.1,"publicationDate":"2026-06-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148686610","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Seeing Scent in Sound: Exploratory Spontaneous Visual and Olfactory Mental Imagery Elicited by Musical Modes.","authors":"Oriente Pimentel Aldaz, Charles Spence","doi":"10.1163/22134808-bja10200","DOIUrl":"https://doi.org/10.1163/22134808-bja10200","url":null,"abstract":"<p><p>Musical modes (i.e., different patterns of pitch organisation within a scale) are widely recognised for their emotional character, yet little is known about the broader multisensory associations that listening to them might trigger. In the present exploratory study, we examine whether the full set of Western musical modes elicits systematic patterns of visual and olfactory mental imagery and whether these patterns correspond with how listeners spontaneously group the modes. In all, 249 participants generated open-ended visual and olfactory responses while listening to short modal excerpts and subsequently completed a free-sorting task. The results revealed a number of structured and recurrent imagery themes across participants (e.g., Nature-, Daytime-, and Happiness-related imagery for major modes, versus Dark-, Stress- and Sadness-related imagery for minor modes, alongside Floral-and-Fresh- versus Damp-, Dusty- and Smoke-related olfactory associations). Major and minor modes occupied distinct regions of similarity space across both visual and olfactory modalities; however, meaningful differentiation was also evident at the level of individual modes. This consistent relational structure across visual and olfactory imagery was likewise reflected in the grouping patterns observed in the free-sorting task. Together, these findings indicate that musical modes are associated with multiple sensory representations that extend beyond simple feature-level correspondences. These results therefore provide an exploratory mapping of visual and olfactory mental imagery and establish a foundation for future confirmatory research.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-45"},"PeriodicalIF":1.5,"publicationDate":"2026-06-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148228793","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The Contextually Tolerant but Temporally Intolerant Sensation Transference from Tactile to Taste in Drinking Coffee.","authors":"Natsumi Kubo, Atsunori Ariga","doi":"10.1163/22134808-bja10198","DOIUrl":"https://doi.org/10.1163/22134808-bja10198","url":null,"abstract":"<p><p>We automatically integrate sensory information from various modalities all the time. Although previous research has shown that our taste evaluation can be influenced by tactile texture of a beverage receptacle, the contextual and temporal tolerance of this kind of sensation transference remains unclear. In Experiment 1, 92 blindfolded Japanese participants in Tokyo evaluated a coffee (Rich Blend capsule, Nestlé) as less acid when they drank it from a smooth-texture cup compared to when they drank from a rough-texture cup, indicating the sensation transference from tactile to taste. This effect was also observed when the tactile input came from an object independent to the beverage in Experiment 2 ( n = 24), but absent when the stimuli were not synchronized in Experiment 3 ( n = 48). The present study tested the limits of sensation transference, and found that the stimuli must happen at the same time but do not have to come from the same object.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-22"},"PeriodicalIF":1.5,"publicationDate":"2026-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148165482","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The Pip-and-Pop Effect in Depth: How Multisensory Stimuli Influence Depth Perception.","authors":"Haami Yusein, Durk Talsma, Klaas Bombeke, Jonas De Bruyne","doi":"10.1163/22134808-bja10199","DOIUrl":"https://doi.org/10.1163/22134808-bja10199","url":null,"abstract":"<p><p>Multisensory integration is known to facilitate attentional selection, yet its influence on depth perception remains poorly understood, partly because depth has been difficult to manipulate and measure under controlled conditions. Here, we investigated how attentional benefits elicited by the audiovisual integration affect distance perception by adapting the classic pip-and-pop paradigm to immersive virtual reality. Participants ( N = 30) searched for a visual target whose transient colour change occurred either alone or synchronously with a nonspatial auditory stimulus. After identifying the target, participants indicated where they believed it had appeared in three-dimensional space (in terms of laterality, elevation and depth). Across trials, synchronous audiovisual pairing produced two reliable effects. First, participants responded faster when the target event was paired with a tone, replicating the core facilitation associated with the pip-and-pop effect in an immersive three-dimensional setting. Second, audiovisual pairing systematically biased depth perception: targets accompanied by a tone were judged as closer to the observer than identical targets presented without a tone, indicating a consistent underestimation of target distance. Exploratory analyses suggested that performance varied when the target's vertical position (height above the ground) was manipulated and also differed as a function of lateral target position. Together, these findings show that multisensory integration does not only alter the speed of attentional selection but also the perceived distance of a target. This extends pip-and-pop effects from attentional facilitation to spatial perception biases. In particular, it demonstrates that spatially mismatched but temporally synchronous audiovisual events can bias distance estimates in immersive environments.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-26"},"PeriodicalIF":1.5,"publicationDate":"2026-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148151352","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}