Multisensory Research最新文献

{"title":"Exploring the Effects of Auditory Stimuli on Consumption Behaviour (I): A Review.","authors":"Mayukha Pillay, Charles Spence","doi":"10.1163/22134808-bja10218","DOIUrl":"https://doi.org/10.1163/22134808-bja10218","url":null,"abstract":"<p><p>Since the 1950s, research has shown that various aspects of of food and beverage consumption can be influenced by the auditory environment in which the consumer happens to find themselves. Indeed, specific auditory stimuli have been used deliberately in the retail, food, and advertising industries to influence consumers' food/drink behaviour and perception. This narrative historical review summarizes what is currently known concerning the influence of auditory stimuli on people's eating and drinking behaviours. The auditory stimuli evaluated include background noise and music, soundscapes, mastication sounds, cooking and other food preparation sounds, food-packaging sounds, and even sound symbolism in the case of food and/or drink product names. The review concludes with a discussion on the mechanisms (including mediators and moderators) underpinning the influence of auditory stimuli on people's consumption behaviour. According to the research outlined here, auditory stimuli have the potential to impact the consumer's food and drink behaviours, including their food or drink intake, consumption rate, and choice.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-51"},"PeriodicalIF":2.1,"publicationDate":"2026-10-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149139242","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Integrating Identity and Emotion Information in Faces: Capacity Limits of Information Processing in Autism.","authors":"Marianna Constantinou, Dena Al-Thani, Marwa Qaraqe, Ala Yankouskaya","doi":"10.1163/22134808-bja10222","DOIUrl":"https://doi.org/10.1163/22134808-bja10222","url":null,"abstract":"<p><p>The ability to combine identity and emotional information when viewing faces allows typically developing individuals to process facial information efficiently. The aim of this study was to examine whether autistic adults share this ability and test if it reflects a broader pattern of integrative information processing. Nineteen autistic adults and nineteen typically developing adults completed a divided-attention task where they had to indicate when a target was present. Each participant completed two separate experiments: (i) the face experiment, which required detecting targets based on identity and emotional expression; and (ii) the object experiment, which required detecting targets based on colour and shape. Analyses assessed whether, and how, participants responded more efficiently in the presence of both targets, compared to either single target. By employing mathematical modelling tools developed in the System Factorial Technology (SFT) framework, results showed that autistic individuals process faces at the rate of typically developing individuals, but failed to exhibit integrative properties (supercapacity) seen in typically developing adults in either domain. In autistic adults, this pattern ranged from limited capacity for faces to capacity consistent with independent parallel processing for objects. Implications of these findings generalise to personalisation practices in education and can be used to inform the development of assistive technologies in autism.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-30"},"PeriodicalIF":2.1,"publicationDate":"2026-10-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149139213","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Viewpoint on Developmental Aspects of Multisensory Integration Across the Lifespan.","authors":"Andrew J Bremner, Patrick Bruns, Fiona N Newell","doi":"10.1163/22134808-bja10217","DOIUrl":"https://doi.org/10.1163/22134808-bja10217","url":null,"abstract":"<p><p>In this viewpoint article, Andy Bremner, Patrick Bruns and Fiona Newell provide an integrated perspective on how multisensory processing develops and changes across the lifespan. From their complementary backgrounds in infant development, crossmodal learning, and visual cognition, they reflect on the scientific influences that shaped their own research trajectories and discuss major conceptual and methodological advances in the field. These include emerging brain-imaging techniques that offer new insights into the foetal and postnatal development of multisensory processes, computational approaches such as Bayesian causal inference models, and studies of sensory deprivation and restoration that illuminate the plasticity of multisensory systems. The authors outline ongoing controversies, such as the interpretation of infant behavioural measures, the developmental timing of multisensory integration, and the causal relationship between sensory and cognitive ageing. They also discuss the expanding role of open science, for example, data sharing, preregistration, and methodological transparency, while noting practical and conceptual challenges for a field that relies on complex, resource-intensive developmental research. They emphasise the need for methodological harmonisation, cross-lab replication, and ecologically valid research approaches that capture multisensory processing in real-world environments. Looking ahead, they anticipate progress driven by AI-assisted data analysis, advances in infant and lifespan brain imaging, and increased attention to interindividual differences in multisensory development. Finally, they encourage early-career researchers to embrace interdisciplinary collaboration, rigorous experimental practice, and active participation in the growing multisensory research community.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-18"},"PeriodicalIF":2.1,"publicationDate":"2026-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149139203","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Viewpoint on Crossmodal Neural Plasticity.","authors":"Olivier Collignon, Ella Striem-Amit","doi":"10.1163/22134808-bja10221","DOIUrl":"https://doi.org/10.1163/22134808-bja10221","url":null,"abstract":"<p><p>Crossmodal neural plasticity, the brain's ability to adapt in response to sensory deprivation, serves as a primary model for understanding the multifaceted interplay between intrinsic neurobiological constraints and environmental experience in brain development. In this viewpoint, Olivier Collignon and Ella Striem-Amit engage in a collaborative dialogue exploring the fundamental principles of brain organization in individuals born with blindness, deafness, or without hands. The discussion evaluates current shifts in the field, including the move toward high-resolution neuroimaging, deep data acquisition, computational modeling, and the necessity of open science to better characterize unique populations. By bridging different theoretical perspectives, this Q&A provides a summary of the field's progress and identifies emerging methodological and conceptual directions for future research.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-10"},"PeriodicalIF":2.1,"publicationDate":"2026-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149139186","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Viewpoint on Hierarchical Organization of Multisensory Integration and Segregation.","authors":"Christoph Kayser, Uta Noppeney, Tim Rohe","doi":"10.1163/22134808-bja10211","DOIUrl":"https://doi.org/10.1163/22134808-bja10211","url":null,"abstract":"<p><p>In this viewpoint, Christoph Kayser, Uta Noppeney, and Tim Rohe highlight the central role of normative Bayesian frameworks, in particular Bayesian causal inference, for explaining how the brain decides whether sensory signals should be integrated or segregated and how they are weighted by their reliabilities. In parallel, the Multisensory Correlation Detector model is emphasized as a mechanistic proposal for how the brain computes spatial and temporal relations across sensory channels. Together, these developments have shifted the field from merely locating multisensory processing in the brain to characterizing the specific computations implemented across cortical hierarchies. The authors outline current trends, such as model-based analyses of neuroimaging and neurophysiological data, increasing use of artificial neural networks to study multisensory processing at larger scales, and emerging work in naturalistic, real-world settings. They discuss ongoing controversies surrounding the influence of attention and tasks on multisensory integration, the limits of Bayes optimality, and the role of neural oscillations, especially alpha rhythms, in shaping multisensory binding. They further advocate for stronger open-science practices and systematic replication of influential findings to consolidate the empirical and theoretical foundations of the field. Finally, they encourage early-career scientists to develop strong methodological skills, cultivate their own conceptual 'angle', and actively engage with the multisensory community.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-10"},"PeriodicalIF":2.1,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149118236","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Viewpoint on Computational Modeling of Multisensory Integration.","authors":"Ulrik Ravnsborg Beierholm, Hans Colonius, Ladan Shams","doi":"10.1163/22134808-bja10212","DOIUrl":"https://doi.org/10.1163/22134808-bja10212","url":null,"abstract":"<p><p>This article presents a compiled interview with three prominent figures in multisensory research: Ulrik Ravnsborg Beierholm, Hans Colonius, and Ladan Shams. Through structured dialogue, the authors reflect on the evolution of computational modeling, from early mathematical psychology to the current dominance of Bayesian causal inference (BCI). The discussion highlights key paradigm shifts, specifically the transition from descriptive studies of illusions to normative, mechanistic explanations of perception. The authors identify the 2002 demonstration by Ernst and Banks of statistically optimal integration as a pivotal milestone in establishing how the brain weighs sensory reliability. Crucially, the authors discuss the subsequent development of BCI as the first framework to formally address the 'binding problem' - the computational challenge of determining whether sensory signals originate from a common source (integration) or distinct sources (segregation). Current trends and controversies are explored, including the application of computational phenotypes to clinical populations, the debate over the neural implementation of Bayesian computations, and the rising influence of deep neural networks. While artificial intelligence (AI) offers new avenues for analyzing high-dimensional data, the authors emphasize the need for biological realism and explainability. The dialogue also addresses the importance of open science, the challenge of accounting for individual differences, and the necessity of moving toward naturalistic environments. The article concludes with professional advice for early-career scientists, emphasizing interdisciplinary training in mathematics and statistics. Collectively, the authors argue that multisensory processing is not a 'special case' of perception but the default mode of brain operation, providing essential principles for understanding learning, plasticity, and memory.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-10"},"PeriodicalIF":2.1,"publicationDate":"2026-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149118265","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The Impact of Off-Axis Visual Rotations on Pitch Vection.","authors":"Max A Teaford, Claire Beach, Sandra Pullam, Tinley R Card, Ashlyn M Ebert, Tanner Greene, Kate Graphos, Marlene Mejia, Samuel Weller","doi":"10.1163/22134808-bja10206","DOIUrl":"https://doi.org/10.1163/22134808-bja10206","url":null,"abstract":"<p><p>Vection, illusory translation and/or rotation sensations, has been studied extensively in the context of virtual environments. Past work focusing on illusory rotation sensations has focused almost exclusively on rotations aligned with the cardinal rotational axes of the head (i.e., on-axis rotations), which is problematic because it does not fully translate to the real world and virtual environments as rotations are often not aligned with the cardinal rotational axes of the head (i.e., off-axis rotations). While there is limited work examining perceptual experiences of vection elicited by off-axis visual rotations, there is work suggesting that it may elicit visuo-vestibular conflicts and motion sickness, implying that it should result in a less compelling experience of vection. To test this possibility, we had 40 participants complete an experiment in which they were exposed to visual scenes that featured different roll-tilts (-45°, 0°, and +45° relative to the rotational axes of their head) and visual motions (pitch rotation or no pitch rotation). It was found that when participants were exposed to visual pitch rotations when there was no visual roll-tilt it resulted in vection which started sooner, lasted longer, and was more convincing than when the scene was roll-tilted 45° to the right or left. Furthermore, all three of the aforementioned conditions elicited vection more than the no visual pitch rotation conditions. This suggests that off-axis visual rotations can diminish but not abolish the occurrence of vection. Additional work is needed to better understand the constraints of this effect.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-31"},"PeriodicalIF":2.1,"publicationDate":"2026-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148834491","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Viewpoint on Multisensory Body Perception and Body Illusions.","authors":"Tobias Heed, Matthew R Longo","doi":"10.1163/22134808-bja10214","DOIUrl":"https://doi.org/10.1163/22134808-bja10214","url":null,"abstract":"<p><p>In this interview-based viewpoint article, Tobias Heed and Matthew Longo discuss research investigating the role of multisensory signals in shaping perception of one's own body. Drawing on both classic and recent studies, they suggest that a central insight is that body perception and the sense of self are constructed based on the integration of real-time signals from several sensory modalities. Classic findings such as the rubber hand and Pinocchio illusions have demonstrated the flexibility of body representations, while Bayesian frameworks have provided principled accounts of how signals from different modalities are integrated. Methodological developments in psychophysics, computational modeling, and neuroimaging have enabled increasingly precise investigations of the neurocognitive mechanisms underlying embodied experience. Despite progress, many controversies remain, notably regarding the measurement and interpretation of body illusions, the influence of suggestibility and demand characteristics, and the roles of perceptual and decisional processes. The authors emphasize the importance of methodological development, combining quantitative and qualitative approaches, and improving data sharing and curation practices. They anticipate that progress will be driven by more naturalistic experimental paradigms, advances in computational methods, and efforts to bridge brain, body, and behavior across levels of analysis. They recommend that early-career researchers develop strong quantitative skills, engage broadly with interdisciplinary perspectives, and pursue fundamental questions about the nature of the body and self. The authors conclude that multisensory research on body perception provides a powerful framework for understanding the constructed nature of bodily experience and remains a vibrant and exciting field in which to work.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-8"},"PeriodicalIF":2.1,"publicationDate":"2026-08-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148820144","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Assessing Visual Speech Communication Abilities: Cross-Situational Consistency in Lipreadability.","authors":"Joel Myerson, Brent P Spehar, Michael J Strube, Sandra Hale, Nancy Tye-Murray, Mitchell S Sommers, Jonathan E Peelle","doi":"10.1163/22134808-bja10205","DOIUrl":"https://doi.org/10.1163/22134808-bja10205","url":null,"abstract":"<p><p>Speech perception during face-to-face conversations is perhaps the most functionally significant aspect of multisensory processing in people's everyday lives. Although they may not be aware of it, people use lipreading to both supplement auditory processing under poor listening conditions and compensate for age-related declines. Thus, understanding the sender's role in communication is as important as understanding the receiver's role, and in both cases, a fundamental question concerns whether individual differences reflect abilities and not just skills. From a psychometric perspective, an ability is distinguished by a high degree of cross-situational consistency in performance, which in turn has implications for how one remediates weaknesses clinically. Methodologically, round-robin designs, in which each participant is paired with everyone else in their group as both a sender and a receiver, represent an efficient way to measure cross-situational consistency, but although such designs have been used to study lipreading, the data have never before been analyzed in ways that address the ability/skill issue. Accordingly, the present investigation reanalyzed data from a previous round-robin study to assess consistency in both the accuracy with which different participants lipread others in their group and the accuracy with which individual talkers were lipread by the others in their group. The results provide evidence of two distinct abilities in visual speech communication: Receivers were consistently either good or poor at lipreading regardless of who the talker was, whereas talkers were consistently lipread either accurately or inaccurately regardless of who the lipreader was. Thus, just as communication under good listening conditions depends on a talker's intelligibility and the listener's hearing ability, under poor conditions, it also depends on two other abilities - both the receiver's lipreading ability, and the talker's ability to be lipread, which we have termed their 'lipreadability'. Importantly, these two visual speech abilities appear to be uncorrelated.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-14"},"PeriodicalIF":2.1,"publicationDate":"2026-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148801174","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Fearful Faces Always Attract Gaze in the Absence of Awareness, but Neutral Faces Only in Combination with a Neutral Voice.","authors":"Junchao Hu, Stephanie Badde, Petra Vetter","doi":"10.1163/22134808-bja10203","DOIUrl":"https://doi.org/10.1163/22134808-bja10203","url":null,"abstract":"<p><p>Fearful faces attract gaze even when they remain 'unseen', suggesting that the oculomotor system prioritizes threat-related facial information in the absence of visual awareness. As congruent voices enhance face perception, we tested whether emotional voices modulate the effects of suppressed fearful and neutral faces on observers' gaze. Using continuous flash suppression, we suppressed fearful and neutral faces from visual awareness and paired them with either a fearful voice, a neutral voice, or no voice. Concurrently, we tracked eye movements. We verified absence of visual awareness of the face using objective measures (chance performance in face localization and categorization tasks) and subjective measures (reports of zero face visibility). Eye tracking data from trials with successful suppression revealed distinct gaze patterns: Fearful faces attracted gaze regardless of vocal context, confirming that visual threats actively guide the eyes in the absence of awareness. By contrast, unseen neutral faces attracted gaze only when paired with a neutral voice, indicating a form of multisensory enhancement whereby emotionally matching sounds enhance weak visual signals to be prioritized by the oculomotor system.</p>","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":" ","pages":"1-22"},"PeriodicalIF":2.1,"publicationDate":"2026-08-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148801197","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}