Sanket Rajeev Sabharwal, Arianna Musso, M. Breaden, Eva Riccomagno, A. Camurri, P. Keller
{"title":"运用格兰杰因果关系分析合奏音乐家影响的方向性","authors":"Sanket Rajeev Sabharwal, Arianna Musso, M. Breaden, Eva Riccomagno, A. Camurri, P. Keller","doi":"10.5821/conference-9788419184849.10","DOIUrl":null,"url":null,"abstract":"In small musical groups, performers can seem to coordinate their movements almost effortlessly in remarkable exhibits of joint action and entrainment. To achieve a common musical goal, co-performers interact and communicate using non-verbal means such as upper-body movements, and particularly head motion. Studying these phenomena in naturalistic contexts can be challenging since most techniques make use of motion capture technologies that can be intrusive and costly. To investigate an alternative method, we analyze video recordings of a professional instrumental ensemble by extracting trajectory information using pose estimation algorithms. We examine Kansei perspectives such as the analysis of non-verbal expression conveyed by bodily movements and gestures, and test for causal relationships and directed influence between performers using the Granger Causality method. We compute weighted probabilities representing the likelihood that each performer Granger Causes co-performers’ movements. Effects of different aspects of musical textures were examined and results indicated stronger directionality for homophonic textures (clear melodic leader) than polyphonic (ambiguous leadership).","PeriodicalId":433529,"journal":{"name":"9th International Conference on Kansei Engineering and Emotion Research. KEER2022. Proceedings","volume":"26 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Analyzing directionality of influence among ensemble musicians using Granger Causality\",\"authors\":\"Sanket Rajeev Sabharwal, Arianna Musso, M. Breaden, Eva Riccomagno, A. Camurri, P. Keller\",\"doi\":\"10.5821/conference-9788419184849.10\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In small musical groups, performers can seem to coordinate their movements almost effortlessly in remarkable exhibits of joint action and entrainment. To achieve a common musical goal, co-performers interact and communicate using non-verbal means such as upper-body movements, and particularly head motion. Studying these phenomena in naturalistic contexts can be challenging since most techniques make use of motion capture technologies that can be intrusive and costly. To investigate an alternative method, we analyze video recordings of a professional instrumental ensemble by extracting trajectory information using pose estimation algorithms. We examine Kansei perspectives such as the analysis of non-verbal expression conveyed by bodily movements and gestures, and test for causal relationships and directed influence between performers using the Granger Causality method. We compute weighted probabilities representing the likelihood that each performer Granger Causes co-performers’ movements. Effects of different aspects of musical textures were examined and results indicated stronger directionality for homophonic textures (clear melodic leader) than polyphonic (ambiguous leadership).\",\"PeriodicalId\":433529,\"journal\":{\"name\":\"9th International Conference on Kansei Engineering and Emotion Research. KEER2022. Proceedings\",\"volume\":\"26 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-09-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"9th International Conference on Kansei Engineering and Emotion Research. KEER2022. Proceedings\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.5821/conference-9788419184849.10\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"9th International Conference on Kansei Engineering and Emotion Research. KEER2022. Proceedings","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.5821/conference-9788419184849.10","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Analyzing directionality of influence among ensemble musicians using Granger Causality
In small musical groups, performers can seem to coordinate their movements almost effortlessly in remarkable exhibits of joint action and entrainment. To achieve a common musical goal, co-performers interact and communicate using non-verbal means such as upper-body movements, and particularly head motion. Studying these phenomena in naturalistic contexts can be challenging since most techniques make use of motion capture technologies that can be intrusive and costly. To investigate an alternative method, we analyze video recordings of a professional instrumental ensemble by extracting trajectory information using pose estimation algorithms. We examine Kansei perspectives such as the analysis of non-verbal expression conveyed by bodily movements and gestures, and test for causal relationships and directed influence between performers using the Granger Causality method. We compute weighted probabilities representing the likelihood that each performer Granger Causes co-performers’ movements. Effects of different aspects of musical textures were examined and results indicated stronger directionality for homophonic textures (clear melodic leader) than polyphonic (ambiguous leadership).