A High-DOF BCI Control Strategy Mapping Discrete Commands to Continuous Motion for a Drone

IF 6.4 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS
Jie Mei;Weize Chen;Ang Li;Yongzhi Huang;Xiaolin Xiao;Kun Wang;Weibo Yi;Tzyy-Ping Jung;Minpeng Xu;Dong Ming
{"title":"A High-DOF BCI Control Strategy Mapping Discrete Commands to Continuous Motion for a Drone","authors":"Jie Mei;Weize Chen;Ang Li;Yongzhi Huang;Xiaolin Xiao;Kun Wang;Weibo Yi;Tzyy-Ping Jung;Minpeng Xu;Dong Ming","doi":"10.1109/TASE.2025.3593497","DOIUrl":null,"url":null,"abstract":"Because of the non-stationary nature of electroencephalogram (EEG) signals, traditional non-invasive brain-computer interfaces (BCIs) usually only produce discrete commands, limiting their ability to control external devices continuously. This study proposes a novel BCI control strategy mapping multiple discrete commands to continuous motion, enabling real-time manipulation of a drone in four degrees of freedom (DOF). Our strategy used the fast steady state visual evoked potential (SSVEP) encoding and decoding method to convert user intentions into the drone’s flight status in near real-time. Simultaneously, the drone’s live video was embedded into the SSVEP stimuli, providing users with a first-person perspective control experience. In drone control experiments, participants successfully maneuvered the drone through complex path-following tasks in simulated and physical scenarios. The mean flight trajectory bias ratio was measured as 0.81, with a mean flight smoothness of -3.31 (measured by spectral arc length) and mean Fitts’s throughput of 9.18 bits/min. Notably, the brain-to-hand ratio (BHR) for all metrics approached 1, indicating that our non-invasive control system achieved comparable performance to manual control systems. These results suggest the effectiveness of our proposed BCI control strategy that maps discrete commands to continuous motion and extends the capabilities of non-invasive BCIs in continuous control scenarios. This study significantly advances the applications of BCI and propels human-machine interaction towards a more direct realm. Note to Practitioners—This work is motivated by the real-time and continuous control challenges in using non-invasive brain-computer interfaces (BCIs). Non-invasive BCIs establish a direct communication pathway between the human brain and external devices. Due to their safety and convenience, they are considered a promising human-machine interaction method for future practical applications. However, a major bottleneck is that non-invasive BCIs that generate discrete commands are unable to meet the demands of continuous control for external devices. Additionally, the low accuracy and high latency in decoding commands from human intent further distance current brain-control systems from practical application. In this paper, we propose a BCI strategy that includes a continuous encoding and decoding method for EEG signals. This strategy reduces the latency of command output while maintaining both the size of the command set and decoding accuracy. Furthermore, it introduces a method to map the decoded commands to continuous movements of external devices, effectively bridging the existing gap. We conducted extensive simulations and real-world experiments, demonstrating that the proposed strategy allows users to achieve continuous, real-time, four-degree-of-freedom control of a quadcopter using a non-invasive BCI. The analysis of results shows that, in terms of control accuracy, continuity, and operational efficiency, brain control is comparable to manual control. In the future, we aim to enhance the external devices with artificial intelligence to enable collaborative control between humans and machines, thereby advancing the practical development of BCIs.","PeriodicalId":51060,"journal":{"name":"IEEE Transactions on Automation Science and Engineering","volume":"22 ","pages":"20234-20248"},"PeriodicalIF":6.4000,"publicationDate":"2025-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Automation Science and Engineering","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11098920/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Because of the non-stationary nature of electroencephalogram (EEG) signals, traditional non-invasive brain-computer interfaces (BCIs) usually only produce discrete commands, limiting their ability to control external devices continuously. This study proposes a novel BCI control strategy mapping multiple discrete commands to continuous motion, enabling real-time manipulation of a drone in four degrees of freedom (DOF). Our strategy used the fast steady state visual evoked potential (SSVEP) encoding and decoding method to convert user intentions into the drone’s flight status in near real-time. Simultaneously, the drone’s live video was embedded into the SSVEP stimuli, providing users with a first-person perspective control experience. In drone control experiments, participants successfully maneuvered the drone through complex path-following tasks in simulated and physical scenarios. The mean flight trajectory bias ratio was measured as 0.81, with a mean flight smoothness of -3.31 (measured by spectral arc length) and mean Fitts’s throughput of 9.18 bits/min. Notably, the brain-to-hand ratio (BHR) for all metrics approached 1, indicating that our non-invasive control system achieved comparable performance to manual control systems. These results suggest the effectiveness of our proposed BCI control strategy that maps discrete commands to continuous motion and extends the capabilities of non-invasive BCIs in continuous control scenarios. This study significantly advances the applications of BCI and propels human-machine interaction towards a more direct realm. Note to Practitioners—This work is motivated by the real-time and continuous control challenges in using non-invasive brain-computer interfaces (BCIs). Non-invasive BCIs establish a direct communication pathway between the human brain and external devices. Due to their safety and convenience, they are considered a promising human-machine interaction method for future practical applications. However, a major bottleneck is that non-invasive BCIs that generate discrete commands are unable to meet the demands of continuous control for external devices. Additionally, the low accuracy and high latency in decoding commands from human intent further distance current brain-control systems from practical application. In this paper, we propose a BCI strategy that includes a continuous encoding and decoding method for EEG signals. This strategy reduces the latency of command output while maintaining both the size of the command set and decoding accuracy. Furthermore, it introduces a method to map the decoded commands to continuous movements of external devices, effectively bridging the existing gap. We conducted extensive simulations and real-world experiments, demonstrating that the proposed strategy allows users to achieve continuous, real-time, four-degree-of-freedom control of a quadcopter using a non-invasive BCI. The analysis of results shows that, in terms of control accuracy, continuity, and operational efficiency, brain control is comparable to manual control. In the future, we aim to enhance the external devices with artificial intelligence to enable collaborative control between humans and machines, thereby advancing the practical development of BCIs.
一种将离散指令映射到无人机连续运动的高自由度BCI控制策略
由于脑电图(EEG)信号的非平稳性,传统的非侵入性脑机接口(bci)通常只能产生离散命令,限制了其连续控制外部设备的能力。本研究提出了一种新的BCI控制策略,将多个离散命令映射到连续运动,从而实现无人机四自由度的实时操作。我们的策略采用快速稳态视觉诱发电位(SSVEP)编码和解码方法,近乎实时地将用户意图转换为无人机的飞行状态。同时,无人机的实时视频被嵌入到SSVEP刺激中,为用户提供第一人称视角的控制体验。在无人机控制实验中,参与者在模拟和物理场景中成功操纵无人机完成复杂的路径跟踪任务。平均飞行轨迹偏倚比为0.81,平均飞行平滑度为-3.31(以光谱弧长测量),平均Fitts吞吐量为9.18 bits/min。值得注意的是,所有指标的脑手比(BHR)接近1,表明我们的非侵入性控制系统达到了与手动控制系统相当的性能。这些结果表明我们提出的脑机接口控制策略的有效性,该策略将离散命令映射到连续运动,并扩展了非侵入性脑机接口在连续控制场景中的功能。本研究对脑机接口的应用有重要的推动作用,并推动人机交互向更直接的方向发展。从业人员注意:这项工作的动机是使用非侵入性脑机接口(bci)的实时和连续控制挑战。无创脑机接口在人脑和外部设备之间建立了直接的通信通路。由于其安全性和方便性,被认为是未来实际应用中很有前途的人机交互方法。然而,一个主要的瓶颈是产生离散命令的非侵入性脑机接口无法满足对外部设备的连续控制需求。此外,解码来自人类意图的命令的低准确率和高延迟进一步使当前的脑控制系统远离实际应用。在本文中,我们提出了一种脑机接口策略,其中包括脑电信号的连续编码和解码方法。这种策略减少了命令输出的延迟,同时保持了命令集的大小和解码的准确性。此外,它还引入了一种将解码命令映射到外部设备的连续运动的方法,有效地弥合了现有的差距。我们进行了大量的模拟和真实世界的实验,证明了所提出的策略允许用户使用非侵入性脑机接口实现四轴飞行器的连续、实时、四自由度控制。结果分析表明,在控制精度、连续性和操作效率方面,脑控可与手动控制相媲美。未来,我们的目标是用人工智能增强外部设备,实现人与机器之间的协同控制,从而推进bci的实用化发展。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Automation Science and Engineering
IEEE Transactions on Automation Science and Engineering 工程技术-自动化与控制系统
CiteScore
12.50
自引率
14.30%
发文量
404
审稿时长
3.0 months
期刊介绍: The IEEE Transactions on Automation Science and Engineering (T-ASE) publishes fundamental papers on Automation, emphasizing scientific results that advance efficiency, quality, productivity, and reliability. T-ASE encourages interdisciplinary approaches from computer science, control systems, electrical engineering, mathematics, mechanical engineering, operations research, and other fields. T-ASE welcomes results relevant to industries such as agriculture, biotechnology, healthcare, home automation, maintenance, manufacturing, pharmaceuticals, retail, security, service, supply chains, and transportation. T-ASE addresses a research community willing to integrate knowledge across disciplines and industries. For this purpose, each paper includes a Note to Practitioners that summarizes how its results can be applied or how they might be extended to apply in practice.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信