{"title":"Mode Explorer: Using Model-based Sonification to Investigate Basins of Attraction","authors":"Jiajun Yang, T. Hermann","doi":"10.1145/3123514.3123525","DOIUrl":null,"url":null,"abstract":"This paper presents a novel interactive auditory data exploration method to investigate features of high-dimensional data distributions. The Mode Explorer couples a scratching-interaction on a 2D scatter plot of high-dimensional data to real-time dynamical processes, excited in data space at the nearest mode in the probability density function (pdf) obtained by kernel-density estimation. Specifically, the sign-inverted pdf is used as a potential function in which test particles perform oscillations at low friction, yielding signals that can directly be played back as sound. This Model-based sonification approach is used to interactively search the distribution for different modes, learn about their details, i.e. the Hessian matrix at the mode, and thus enable a non-parametric parameter selection for appropriate bandwidth.","PeriodicalId":282371,"journal":{"name":"Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences","volume":"96 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2017-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3123514.3123525","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
This paper presents a novel interactive auditory data exploration method to investigate features of high-dimensional data distributions. The Mode Explorer couples a scratching-interaction on a 2D scatter plot of high-dimensional data to real-time dynamical processes, excited in data space at the nearest mode in the probability density function (pdf) obtained by kernel-density estimation. Specifically, the sign-inverted pdf is used as a potential function in which test particles perform oscillations at low friction, yielding signals that can directly be played back as sound. This Model-based sonification approach is used to interactively search the distribution for different modes, learn about their details, i.e. the Hessian matrix at the mode, and thus enable a non-parametric parameter selection for appropriate bandwidth.