Controlling Form Through Intent: A BCI-VR System for Enhancing Cultural Presence in Chinese Shadow Puppetry

IF 3.4 4区 计算机科学 Q4 COMPUTER SCIENCE, SOFTWARE ENGINEERING
Hui Liang, Xinyu Ye
{"title":"Controlling Form Through Intent: A BCI-VR System for Enhancing Cultural Presence in Chinese Shadow Puppetry","authors":"Hui Liang,&nbsp;Xinyu Ye","doi":"10.1002/cav.70184","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>This study introduces a novel brain–computer interface (BCI) and virtual reality (VR) framework designed for immersive interaction with Chinese shadow puppetry. The system enables subjects to control two-dimensional movement and limb actions of virtual puppets through electroencephalogram (EEG)-based motor imagery and electrooculogram (EOG)-based blink detection. An EEG-based Localmotion (EBLM) algorithm is employed to achieve stable multi-directional movement decoding, integrating blink-triggered limb actions for precise puppet manipulation. Simplified multi-body dynamics within the VR environment replicate realistic puppet motion and situational interactivity. Experimental evaluations involving 20 participants demonstrated high decoding accuracy (82.7%), low false-trigger rates, and rapid adaptation. Compared with traditional VR controllers, BCI-driven interaction demonstrated lower task efficiency but showed improvements in immersion, cultural presence, and the sense of “control as performance”. This system suggests a potential digital pathway for intangible cultural heritage preservation, facilitating active participation, skill transmission, and profound cultural engagement.</p>\n </div>","PeriodicalId":50645,"journal":{"name":"Computer Animation and Virtual Worlds","volume":"37 6","pages":""},"PeriodicalIF":3.4000,"publicationDate":"2026-10-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Animation and Virtual Worlds","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/cav.70184","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"COMPUTER SCIENCE, SOFTWARE ENGINEERING","Score":null,"Total":0}
引用次数: 0

Abstract

This study introduces a novel brain–computer interface (BCI) and virtual reality (VR) framework designed for immersive interaction with Chinese shadow puppetry. The system enables subjects to control two-dimensional movement and limb actions of virtual puppets through electroencephalogram (EEG)-based motor imagery and electrooculogram (EOG)-based blink detection. An EEG-based Localmotion (EBLM) algorithm is employed to achieve stable multi-directional movement decoding, integrating blink-triggered limb actions for precise puppet manipulation. Simplified multi-body dynamics within the VR environment replicate realistic puppet motion and situational interactivity. Experimental evaluations involving 20 participants demonstrated high decoding accuracy (82.7%), low false-trigger rates, and rapid adaptation. Compared with traditional VR controllers, BCI-driven interaction demonstrated lower task efficiency but showed improvements in immersion, cultural presence, and the sense of “control as performance”. This system suggests a potential digital pathway for intangible cultural heritage preservation, facilitating active participation, skill transmission, and profound cultural engagement.

以意图控制形式:增强中国皮影戏文化存在感的BCI-VR系统
本研究介绍了一种新型的脑机接口(BCI)和虚拟现实(VR)框架,旨在与中国皮影戏进行沉浸式交互。该系统通过基于脑电图(EEG)的运动图像和基于眼电图(EOG)的眨眼检测,使受试者能够控制虚拟木偶的二维运动和肢体动作。采用基于脑电图的局部运动(EBLM)算法实现稳定的多方向运动解码,整合眨眼触发肢体动作,实现对木偶的精确操纵。在虚拟现实环境中简化的多体动力学复制真实的木偶运动和情景交互。涉及20名参与者的实验评估显示解码准确率高(82.7%),误触发率低,适应速度快。与传统VR控制器相比,bci驱动交互的任务效率较低,但在沉浸感、文化存在感和“控制即表现”感方面有所提高。该系统为非物质文化遗产保护提供了一条潜在的数字途径,促进了人们的积极参与、技能传播和深刻的文化参与。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Computer Animation and Virtual Worlds
Computer Animation and Virtual Worlds 工程技术-计算机:软件工程
CiteScore
2.20
自引率
0.00%
发文量
90
审稿时长
6-12 weeks
期刊介绍: With the advent of very powerful PCs and high-end graphics cards, there has been an incredible development in Virtual Worlds, real-time computer animation and simulation, games. But at the same time, new and cheaper Virtual Reality devices have appeared allowing an interaction with these real-time Virtual Worlds and even with real worlds through Augmented Reality. Three-dimensional characters, especially Virtual Humans are now of an exceptional quality, which allows to use them in the movie industry. But this is only a beginning, as with the development of Artificial Intelligence and Agent technology, these characters will become more and more autonomous and even intelligent. They will inhabit the Virtual Worlds in a Virtual Life together with animals and plants.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书