{"title":"Live Coding Machine Learning: Finding the Moments of Intervention in Autonomous Processes","authors":"Iván Paz, Shelly Knottsy","doi":"10.1162/comj_a_00663","DOIUrl":null,"url":null,"abstract":"Machine learning (ML) deals with algorithms able to learn from data, with the primary aim of finding optimum solutions to perform tasks autonomously. In recent years there has been development in integrating ML algorithms with live coding practices, raising questions about what to optimize or automate, the agency of the algorithms, and in which parts of the ML processes one might intervene midperformance. Live coding performance practices typically involve conversational interaction with algorithmic processes in real time. In analyzing systems integrating live coding and ML, we consider the musical and performative implications of the “moment of intervention” in the ML model and workflow, and the channels for real-time intervention. We propose a framework for analysis, through which we reflect on the domain-specific algorithms and practices being developed that combine these two practices.","PeriodicalId":50639,"journal":{"name":"Computer Music Journal","volume":"24 1","pages":""},"PeriodicalIF":0.4000,"publicationDate":"2024-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Music Journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1162/comj_a_00663","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0
Abstract
Machine learning (ML) deals with algorithms able to learn from data, with the primary aim of finding optimum solutions to perform tasks autonomously. In recent years there has been development in integrating ML algorithms with live coding practices, raising questions about what to optimize or automate, the agency of the algorithms, and in which parts of the ML processes one might intervene midperformance. Live coding performance practices typically involve conversational interaction with algorithmic processes in real time. In analyzing systems integrating live coding and ML, we consider the musical and performative implications of the “moment of intervention” in the ML model and workflow, and the channels for real-time intervention. We propose a framework for analysis, through which we reflect on the domain-specific algorithms and practices being developed that combine these two practices.
机器学习(ML)涉及能够从数据中学习的算法,其主要目的是找到最佳解决方案来自主执行任务。近年来,将 ML 算法与实时编码实践结合在一起的做法得到了发展,但也提出了一些问题,如哪些内容需要优化或自动化、算法的作用以及在执行过程中可以干预 ML 流程的哪些部分。实时编码性能实践通常涉及与算法过程的实时对话交互。在分析集成了现场编码和 ML 的系统时,我们会考虑 ML 模型和工作流程中 "干预时刻 "的音乐和表演含义,以及实时干预的渠道。我们提出了一个分析框架,通过该框架,我们思考了结合这两种实践而开发的特定领域算法和实践。
期刊介绍:
Computer Music Journal is published quarterly with an annual sound and video anthology containing curated music¹. For four decades, it has been the leading publication about computer music, concentrating fully on digital sound technology and all musical applications of computers. This makes it an essential resource for musicians, composers, scientists, engineers, computer enthusiasts, and anyone exploring the wonders of computer-generated sound.
Edited by experts in the field and featuring an international advisory board of eminent computer musicians, issues typically include:
In-depth articles on cutting-edge research and developments in technology, methods, and aesthetics of computer music
Reports on products of interest, such as new audio and MIDI software and hardware
Interviews with leading composers of computer music
Announcements of and reports on conferences and courses in the United States and abroad
Publication, event, and recording reviews
Tutorials, letters, and editorials
Numerous graphics, photographs, scores, algorithms, and other illustrations.