Jie Mei;Weize Chen;Ang Li;Yongzhi Huang;Xiaolin Xiao;Kun Wang;Weibo Yi;Tzyy-Ping Jung;Minpeng Xu;Dong Ming
{"title":"A High-DOF BCI Control Strategy Mapping Discrete Commands to Continuous Motion for a Drone","authors":"Jie Mei;Weize Chen;Ang Li;Yongzhi Huang;Xiaolin Xiao;Kun Wang;Weibo Yi;Tzyy-Ping Jung;Minpeng Xu;Dong Ming","doi":"10.1109/TASE.2025.3593497","DOIUrl":null,"url":null,"abstract":"Because of the non-stationary nature of electroencephalogram (EEG) signals, traditional non-invasive brain-computer interfaces (BCIs) usually only produce discrete commands, limiting their ability to control external devices continuously. This study proposes a novel BCI control strategy mapping multiple discrete commands to continuous motion, enabling real-time manipulation of a drone in four degrees of freedom (DOF). Our strategy used the fast steady state visual evoked potential (SSVEP) encoding and decoding method to convert user intentions into the drone’s flight status in near real-time. Simultaneously, the drone’s live video was embedded into the SSVEP stimuli, providing users with a first-person perspective control experience. In drone control experiments, participants successfully maneuvered the drone through complex path-following tasks in simulated and physical scenarios. The mean flight trajectory bias ratio was measured as 0.81, with a mean flight smoothness of -3.31 (measured by spectral arc length) and mean Fitts’s throughput of 9.18 bits/min. Notably, the brain-to-hand ratio (BHR) for all metrics approached 1, indicating that our non-invasive control system achieved comparable performance to manual control systems. These results suggest the effectiveness of our proposed BCI control strategy that maps discrete commands to continuous motion and extends the capabilities of non-invasive BCIs in continuous control scenarios. This study significantly advances the applications of BCI and propels human-machine interaction towards a more direct realm. Note to Practitioners—This work is motivated by the real-time and continuous control challenges in using non-invasive brain-computer interfaces (BCIs). Non-invasive BCIs establish a direct communication pathway between the human brain and external devices. Due to their safety and convenience, they are considered a promising human-machine interaction method for future practical applications. However, a major bottleneck is that non-invasive BCIs that generate discrete commands are unable to meet the demands of continuous control for external devices. Additionally, the low accuracy and high latency in decoding commands from human intent further distance current brain-control systems from practical application. In this paper, we propose a BCI strategy that includes a continuous encoding and decoding method for EEG signals. This strategy reduces the latency of command output while maintaining both the size of the command set and decoding accuracy. Furthermore, it introduces a method to map the decoded commands to continuous movements of external devices, effectively bridging the existing gap. We conducted extensive simulations and real-world experiments, demonstrating that the proposed strategy allows users to achieve continuous, real-time, four-degree-of-freedom control of a quadcopter using a non-invasive BCI. The analysis of results shows that, in terms of control accuracy, continuity, and operational efficiency, brain control is comparable to manual control. In the future, we aim to enhance the external devices with artificial intelligence to enable collaborative control between humans and machines, thereby advancing the practical development of BCIs.","PeriodicalId":51060,"journal":{"name":"IEEE Transactions on Automation Science and Engineering","volume":"22 ","pages":"20234-20248"},"PeriodicalIF":6.4000,"publicationDate":"2025-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Automation Science and Engineering","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11098920/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Because of the non-stationary nature of electroencephalogram (EEG) signals, traditional non-invasive brain-computer interfaces (BCIs) usually only produce discrete commands, limiting their ability to control external devices continuously. This study proposes a novel BCI control strategy mapping multiple discrete commands to continuous motion, enabling real-time manipulation of a drone in four degrees of freedom (DOF). Our strategy used the fast steady state visual evoked potential (SSVEP) encoding and decoding method to convert user intentions into the drone’s flight status in near real-time. Simultaneously, the drone’s live video was embedded into the SSVEP stimuli, providing users with a first-person perspective control experience. In drone control experiments, participants successfully maneuvered the drone through complex path-following tasks in simulated and physical scenarios. The mean flight trajectory bias ratio was measured as 0.81, with a mean flight smoothness of -3.31 (measured by spectral arc length) and mean Fitts’s throughput of 9.18 bits/min. Notably, the brain-to-hand ratio (BHR) for all metrics approached 1, indicating that our non-invasive control system achieved comparable performance to manual control systems. These results suggest the effectiveness of our proposed BCI control strategy that maps discrete commands to continuous motion and extends the capabilities of non-invasive BCIs in continuous control scenarios. This study significantly advances the applications of BCI and propels human-machine interaction towards a more direct realm. Note to Practitioners—This work is motivated by the real-time and continuous control challenges in using non-invasive brain-computer interfaces (BCIs). Non-invasive BCIs establish a direct communication pathway between the human brain and external devices. Due to their safety and convenience, they are considered a promising human-machine interaction method for future practical applications. However, a major bottleneck is that non-invasive BCIs that generate discrete commands are unable to meet the demands of continuous control for external devices. Additionally, the low accuracy and high latency in decoding commands from human intent further distance current brain-control systems from practical application. In this paper, we propose a BCI strategy that includes a continuous encoding and decoding method for EEG signals. This strategy reduces the latency of command output while maintaining both the size of the command set and decoding accuracy. Furthermore, it introduces a method to map the decoded commands to continuous movements of external devices, effectively bridging the existing gap. We conducted extensive simulations and real-world experiments, demonstrating that the proposed strategy allows users to achieve continuous, real-time, four-degree-of-freedom control of a quadcopter using a non-invasive BCI. The analysis of results shows that, in terms of control accuracy, continuity, and operational efficiency, brain control is comparable to manual control. In the future, we aim to enhance the external devices with artificial intelligence to enable collaborative control between humans and machines, thereby advancing the practical development of BCIs.
期刊介绍:
The IEEE Transactions on Automation Science and Engineering (T-ASE) publishes fundamental papers on Automation, emphasizing scientific results that advance efficiency, quality, productivity, and reliability. T-ASE encourages interdisciplinary approaches from computer science, control systems, electrical engineering, mathematics, mechanical engineering, operations research, and other fields. T-ASE welcomes results relevant to industries such as agriculture, biotechnology, healthcare, home automation, maintenance, manufacturing, pharmaceuticals, retail, security, service, supply chains, and transportation. T-ASE addresses a research community willing to integrate knowledge across disciplines and industries. For this purpose, each paper includes a Note to Practitioners that summarizes how its results can be applied or how they might be extended to apply in practice.