将肌电图生物信号转化为合成声音的端到端乐器系统

IF 0.4 Q4 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS

Computer Music Journal Pub Date : 2023-06-13 DOI:10.1162/comj_a_00672

Atau Tanaka;Federico Visi;Balandino Di Donato;Martin Klang;Michael Zbyszyński

引用次数: 0

摘要

本文介绍了一套定制系统，该系统结合了硬件和分类软件，可感知表演者身体因肌肉收缩而产生的生理信号，并将其转换为计算机合成的声音。我们的目标是在该领域研究历史的基础上，开发出一套可供非专业音乐家使用的完整集成系统。我们介绍了 "嵌入式视听交互肌电图"（Electromyogram），这是一个端到端的系统，包括音乐家身体上的可穿戴传感装置、基于定制微控制器的生物信号采集硬件、基于机器学习的手势到声音映射中间件，以及基于软件的颗粒合成声音输出。一种新颖的硬件设计将肌肉肌电信号数字化，并进行最少的模拟预处理，然后在音频信号处理链中将其处理为符合标准的音频和无线 MIDI 接口。映射层在强化学习配置中实现了交互式机器学习工作流程，可将手势特征映射到多维信息空间中的听觉元数据。该系统调整了现有的机器学习和合成模块，使之与硬件配合使用，从而形成了一个集成的端到端系统。我们将通过一系列公开展示和音乐会演出，探索其作为数字乐器的潜力。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

An End-to-End Musical Instrument System That Translates Electromyogram Biosignals to Synthesized Sound

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Computer Music Journal 工程技术-计算机：跨学科应用

CiteScore

1.80

自引率

0.00%

发文量

审稿时长

>12 weeks

期刊介绍： Computer Music Journal is published quarterly with an annual sound and video anthology containing curated music¹. For four decades, it has been the leading publication about computer music, concentrating fully on digital sound technology and all musical applications of computers. This makes it an essential resource for musicians, composers, scientists, engineers, computer enthusiasts, and anyone exploring the wonders of computer-generated sound. Edited by experts in the field and featuring an international advisory board of eminent computer musicians, issues typically include: In-depth articles on cutting-edge research and developments in technology, methods, and aesthetics of computer music Reports on products of interest, such as new audio and MIDI software and hardware Interviews with leading composers of computer music Announcements of and reports on conferences and courses in the United States and abroad Publication, event, and recording reviews Tutorials, letters, and editorials Numerous graphics, photographs, scores, algorithms, and other illustrations.