{"title":"同构的可视化--色彩和音乐的共鸣","authors":"Xue Mao, Jie Xu, Jiahong Lang, Shangshu Zhang","doi":"10.1016/j.visinf.2023.10.006","DOIUrl":null,"url":null,"abstract":"<div><p>Music and colour, as human hearing and visual art, are closely related to human psychological feelings and symbolic associations. There is an isomorphic relationship between music and colour. The article uses the concept of “synesthesia” in psychology and the “co-construction” relationship in mathematics as a bridge, based on Kandinsky’s “inner sound” theory and Mallion’s “tone-colour system”, an interdisciplinary theoretical model of “timbre isomorphism synesthesia” (ISCM) is constructed. At the practical level, based on the ISCM theory, a set of timbre synesthesia visualization tools ASAH and visualization processes are designed, through music data input, graphics mapping visualization, colour mapping visualization, real-time interactive visualization, and finally output timbre synesthesia visualization works. In order to avoid the visual homogenization caused by algorithm design, ASHA has set up a custom editor, which emphasizes the individual differences and multi-sensory experience of tonal synesthesia visualization.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 4","pages":"Pages 110-114"},"PeriodicalIF":3.8000,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X23000517/pdfft?md5=680eca924eb901cc315deae17009a9ef&pid=1-s2.0-S2468502X23000517-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Visualization of isomorphism-synesthesia of colour and music\",\"authors\":\"Xue Mao, Jie Xu, Jiahong Lang, Shangshu Zhang\",\"doi\":\"10.1016/j.visinf.2023.10.006\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Music and colour, as human hearing and visual art, are closely related to human psychological feelings and symbolic associations. There is an isomorphic relationship between music and colour. The article uses the concept of “synesthesia” in psychology and the “co-construction” relationship in mathematics as a bridge, based on Kandinsky’s “inner sound” theory and Mallion’s “tone-colour system”, an interdisciplinary theoretical model of “timbre isomorphism synesthesia” (ISCM) is constructed. At the practical level, based on the ISCM theory, a set of timbre synesthesia visualization tools ASAH and visualization processes are designed, through music data input, graphics mapping visualization, colour mapping visualization, real-time interactive visualization, and finally output timbre synesthesia visualization works. In order to avoid the visual homogenization caused by algorithm design, ASHA has set up a custom editor, which emphasizes the individual differences and multi-sensory experience of tonal synesthesia visualization.</p></div>\",\"PeriodicalId\":36903,\"journal\":{\"name\":\"Visual Informatics\",\"volume\":\"7 4\",\"pages\":\"Pages 110-114\"},\"PeriodicalIF\":3.8000,\"publicationDate\":\"2023-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2468502X23000517/pdfft?md5=680eca924eb901cc315deae17009a9ef&pid=1-s2.0-S2468502X23000517-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Visual Informatics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2468502X23000517\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Visual Informatics","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2468502X23000517","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
Visualization of isomorphism-synesthesia of colour and music
Music and colour, as human hearing and visual art, are closely related to human psychological feelings and symbolic associations. There is an isomorphic relationship between music and colour. The article uses the concept of “synesthesia” in psychology and the “co-construction” relationship in mathematics as a bridge, based on Kandinsky’s “inner sound” theory and Mallion’s “tone-colour system”, an interdisciplinary theoretical model of “timbre isomorphism synesthesia” (ISCM) is constructed. At the practical level, based on the ISCM theory, a set of timbre synesthesia visualization tools ASAH and visualization processes are designed, through music data input, graphics mapping visualization, colour mapping visualization, real-time interactive visualization, and finally output timbre synesthesia visualization works. In order to avoid the visual homogenization caused by algorithm design, ASHA has set up a custom editor, which emphasizes the individual differences and multi-sensory experience of tonal synesthesia visualization.