{"title":"颜色-触觉跨模态对应及其对多模态感知中单模态判断的影响","authors":"Tianyi Yuan, P. Rau, Jingyu Zhao, Jian Zheng","doi":"10.1163/22134808-bja10098","DOIUrl":null,"url":null,"abstract":"\nThis study explored the colour–touch cross-modal correspondence and its impact on colour–touch multisensory perception. Two laboratory experiments were conducted based on a pre-experiment. In the first experiment, participants chose the colour according to their tactile sense against the vibration generated by the smartphone simulator. A positive cross-modal correspondence was obtained between the vibration amplitude and the colour chroma, indicating the existence of a colour–touch correspondence. The correspondence between vibration parameters and colour hue was preliminarily explored. The impact of the correspondence on the multisensory senses was investigated in the second experiment. Different stimulus combinations were played on a smartphone. The participants were asked to choose the perceived stimulus level. The data illustrated that a better correspondence improved judgement accuracy and reduced reactiontime. Overall, this study offers evidence for colour–touch cross-modal correspondence and presents its potential influence on the single-modal judgement in multimodal perception. The results can be applied in further cross-modal studies, assisting barrier-free society construction and multimodal interface design.","PeriodicalId":51298,"journal":{"name":"Multisensory Research","volume":null,"pages":null},"PeriodicalIF":1.8000,"publicationDate":"2023-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Colour–Touch Cross-Modal Correspondence and Its Impact on Single-Modal Judgement in Multimodal Perception\",\"authors\":\"Tianyi Yuan, P. Rau, Jingyu Zhao, Jian Zheng\",\"doi\":\"10.1163/22134808-bja10098\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\nThis study explored the colour–touch cross-modal correspondence and its impact on colour–touch multisensory perception. Two laboratory experiments were conducted based on a pre-experiment. In the first experiment, participants chose the colour according to their tactile sense against the vibration generated by the smartphone simulator. A positive cross-modal correspondence was obtained between the vibration amplitude and the colour chroma, indicating the existence of a colour–touch correspondence. The correspondence between vibration parameters and colour hue was preliminarily explored. The impact of the correspondence on the multisensory senses was investigated in the second experiment. Different stimulus combinations were played on a smartphone. The participants were asked to choose the perceived stimulus level. The data illustrated that a better correspondence improved judgement accuracy and reduced reactiontime. Overall, this study offers evidence for colour–touch cross-modal correspondence and presents its potential influence on the single-modal judgement in multimodal perception. The results can be applied in further cross-modal studies, assisting barrier-free society construction and multimodal interface design.\",\"PeriodicalId\":51298,\"journal\":{\"name\":\"Multisensory Research\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.8000,\"publicationDate\":\"2023-05-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Multisensory Research\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1163/22134808-bja10098\",\"RegionNum\":4,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"BIOPHYSICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Multisensory Research","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1163/22134808-bja10098","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"BIOPHYSICS","Score":null,"Total":0}
Colour–Touch Cross-Modal Correspondence and Its Impact on Single-Modal Judgement in Multimodal Perception
This study explored the colour–touch cross-modal correspondence and its impact on colour–touch multisensory perception. Two laboratory experiments were conducted based on a pre-experiment. In the first experiment, participants chose the colour according to their tactile sense against the vibration generated by the smartphone simulator. A positive cross-modal correspondence was obtained between the vibration amplitude and the colour chroma, indicating the existence of a colour–touch correspondence. The correspondence between vibration parameters and colour hue was preliminarily explored. The impact of the correspondence on the multisensory senses was investigated in the second experiment. Different stimulus combinations were played on a smartphone. The participants were asked to choose the perceived stimulus level. The data illustrated that a better correspondence improved judgement accuracy and reduced reactiontime. Overall, this study offers evidence for colour–touch cross-modal correspondence and presents its potential influence on the single-modal judgement in multimodal perception. The results can be applied in further cross-modal studies, assisting barrier-free society construction and multimodal interface design.
期刊介绍:
Multisensory Research is an interdisciplinary archival journal covering all aspects of multisensory processing including the control of action, cognition and attention. Research using any approach to increase our understanding of multisensory perceptual, behavioural, neural and computational mechanisms is encouraged. Empirical, neurophysiological, psychophysical, brain imaging, clinical, developmental, mathematical and computational analyses are welcome. Research will also be considered covering multisensory applications such as sensory substitution, crossmodal methods for delivering sensory information or multisensory approaches to robotics and engineering. Short communications and technical notes that draw attention to new developments will be included, as will reviews and commentaries on current issues. Special issues dealing with specific topics will be announced from time to time. Multisensory Research is a continuation of Seeing and Perceiving, and of Spatial Vision.