{"title":"以意图控制形式:增强中国皮影戏文化存在感的BCI-VR系统","authors":"Hui Liang, Xinyu Ye","doi":"10.1002/cav.70184","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>This study introduces a novel brain–computer interface (BCI) and virtual reality (VR) framework designed for immersive interaction with Chinese shadow puppetry. The system enables subjects to control two-dimensional movement and limb actions of virtual puppets through electroencephalogram (EEG)-based motor imagery and electrooculogram (EOG)-based blink detection. An EEG-based Localmotion (EBLM) algorithm is employed to achieve stable multi-directional movement decoding, integrating blink-triggered limb actions for precise puppet manipulation. Simplified multi-body dynamics within the VR environment replicate realistic puppet motion and situational interactivity. Experimental evaluations involving 20 participants demonstrated high decoding accuracy (82.7%), low false-trigger rates, and rapid adaptation. Compared with traditional VR controllers, BCI-driven interaction demonstrated lower task efficiency but showed improvements in immersion, cultural presence, and the sense of “control as performance”. This system suggests a potential digital pathway for intangible cultural heritage preservation, facilitating active participation, skill transmission, and profound cultural engagement.</p>\n </div>","PeriodicalId":50645,"journal":{"name":"Computer Animation and Virtual Worlds","volume":"37 6","pages":""},"PeriodicalIF":3.4000,"publicationDate":"2026-10-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Controlling Form Through Intent: A BCI-VR System for Enhancing Cultural Presence in Chinese Shadow Puppetry\",\"authors\":\"Hui Liang, Xinyu Ye\",\"doi\":\"10.1002/cav.70184\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n <p>This study introduces a novel brain–computer interface (BCI) and virtual reality (VR) framework designed for immersive interaction with Chinese shadow puppetry. The system enables subjects to control two-dimensional movement and limb actions of virtual puppets through electroencephalogram (EEG)-based motor imagery and electrooculogram (EOG)-based blink detection. An EEG-based Localmotion (EBLM) algorithm is employed to achieve stable multi-directional movement decoding, integrating blink-triggered limb actions for precise puppet manipulation. Simplified multi-body dynamics within the VR environment replicate realistic puppet motion and situational interactivity. Experimental evaluations involving 20 participants demonstrated high decoding accuracy (82.7%), low false-trigger rates, and rapid adaptation. Compared with traditional VR controllers, BCI-driven interaction demonstrated lower task efficiency but showed improvements in immersion, cultural presence, and the sense of “control as performance”. This system suggests a potential digital pathway for intangible cultural heritage preservation, facilitating active participation, skill transmission, and profound cultural engagement.</p>\\n </div>\",\"PeriodicalId\":50645,\"journal\":{\"name\":\"Computer Animation and Virtual Worlds\",\"volume\":\"37 6\",\"pages\":\"\"},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2026-10-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computer Animation and Virtual Worlds\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/cav.70184\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"COMPUTER SCIENCE, SOFTWARE ENGINEERING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Animation and Virtual Worlds","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/cav.70184","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"COMPUTER SCIENCE, SOFTWARE ENGINEERING","Score":null,"Total":0}
Controlling Form Through Intent: A BCI-VR System for Enhancing Cultural Presence in Chinese Shadow Puppetry
This study introduces a novel brain–computer interface (BCI) and virtual reality (VR) framework designed for immersive interaction with Chinese shadow puppetry. The system enables subjects to control two-dimensional movement and limb actions of virtual puppets through electroencephalogram (EEG)-based motor imagery and electrooculogram (EOG)-based blink detection. An EEG-based Localmotion (EBLM) algorithm is employed to achieve stable multi-directional movement decoding, integrating blink-triggered limb actions for precise puppet manipulation. Simplified multi-body dynamics within the VR environment replicate realistic puppet motion and situational interactivity. Experimental evaluations involving 20 participants demonstrated high decoding accuracy (82.7%), low false-trigger rates, and rapid adaptation. Compared with traditional VR controllers, BCI-driven interaction demonstrated lower task efficiency but showed improvements in immersion, cultural presence, and the sense of “control as performance”. This system suggests a potential digital pathway for intangible cultural heritage preservation, facilitating active participation, skill transmission, and profound cultural engagement.
期刊介绍:
With the advent of very powerful PCs and high-end graphics cards, there has been an incredible development in Virtual Worlds, real-time computer animation and simulation, games. But at the same time, new and cheaper Virtual Reality devices have appeared allowing an interaction with these real-time Virtual Worlds and even with real worlds through Augmented Reality. Three-dimensional characters, especially Virtual Humans are now of an exceptional quality, which allows to use them in the movie industry. But this is only a beginning, as with the development of Artificial Intelligence and Agent technology, these characters will become more and more autonomous and even intelligent. They will inhabit the Virtual Worlds in a Virtual Life together with animals and plants.