{"title":"Audio-Visual Interactive Art: Investigating the effect of gaze-controlled audio on visual attention and short term memory","authors":"Josefine Hölling, Marianne Svahn, S. Pauletto","doi":"10.1145/3478384.3478421","DOIUrl":"https://doi.org/10.1145/3478384.3478421","url":null,"abstract":"This article presents the development and testing of a system for interactive art. The system utilises eye tracking technology to detect the eye movements of people looking at a painting, and then uses this data to trigger sounds related to the painting. The system was developed in collaboration with a visual artist and a musician with the ultimate aim to integrate it into a new piece of interactive art. Described here in detail is the design and development of a prototype which was tested using a copy of a painting by Hieronymus Bosch: The Garden of Earthly Delights. Through this system we tested whether gaze-controlled audio affects visual attention and short term memory. The final system was integrated into a contemporary piece of interactive art currently exhibited in Ronneby, southern Sweden.","PeriodicalId":173309,"journal":{"name":"Proceedings of the 16th International Audio Mostly Conference","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125840602","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Filippo Carnovalini, A. Rodà, N. Harley, Steven T. Homer, Geraint A. Wiggins
{"title":"A New Corpus for Computational Music Research andA Novel Method for Musical Structure Analysis","authors":"Filippo Carnovalini, A. Rodà, N. Harley, Steven T. Homer, Geraint A. Wiggins","doi":"10.1145/3478384.3478402","DOIUrl":"https://doi.org/10.1145/3478384.3478402","url":null,"abstract":"Computational models of music, while providing good descriptions of melodic development, still cannot fully grasp the general structure comprised of repetitions, transpositions, and reuse of melodic material. We present a corpus of strongly structured baroque allemandes, and describe a top-down approach to abstract the shared structure of their musical content using tree representations produced from pairwise differences between the Schenkerian-inspired analyses of each piece, thereby providing a rich hierarchical description of the corpus.","PeriodicalId":173309,"journal":{"name":"Proceedings of the 16th International Audio Mostly Conference","volume":"45 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115221411","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}