Research on shared control of robots based on hybrid brain-computer interface

IF 2.7 4区 医学 Q2 BIOCHEMICAL RESEARCH METHODS
Ziqi Zhang , Mengfan Li , Ran Wei , Wenzhe Liao , Fuyong Wang , Guizhi Xu
{"title":"Research on shared control of robots based on hybrid brain-computer interface","authors":"Ziqi Zhang ,&nbsp;Mengfan Li ,&nbsp;Ran Wei ,&nbsp;Wenzhe Liao ,&nbsp;Fuyong Wang ,&nbsp;Guizhi Xu","doi":"10.1016/j.jneumeth.2024.110280","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><p>With the arrival of the new generation of artificial intelligence wave, new human-robot interaction technologies continue to emerge. Brain–computer interface (BCI) offers a pathway for state monitoring and interaction control between human and robot. However, the unstable mental state reduce the accuracy of human brain intent decoding, and consequently affects the precision of BCI control.</p></div><div><h3>New methods</h3><p>This paper proposes a hybrid BCI-based shared control (HB-SC) method for brain-controlled robot navigation. Hybrid BCI fuses electroencephalogram (EEG) and electromyography (EMG) for mental state monitoring and interactive control to output human perception and decision. The shared control based on multi-sensory fusion integrates the special obstacle information perceived by humans with the regular environmental information perceived by the robot. In this process, valid BCI commands are screened by mental state assessment and output to a layered costmap for fusion.</p></div><div><h3>Results</h3><p>Eight subjects participated in the navigation experiment with dynamically changing mental state levels to validate the effects of a hybrid brain-computer interface through two shared control modes. The results show that the proposed HB-SC reduces collisions by 37.50 %, improves the success rate of traversing obstacles by 25.00 %, and the navigation trajectory is more consistent with expectations.</p></div><div><h3>Conclusions</h3><p>The HB-SC method can dynamically and intelligently adjust command output according to different brain states, helping to reduce errors made by subjects in a unstable mental state, thereby greatly enhancing the system's safety.</p></div>","PeriodicalId":16415,"journal":{"name":"Journal of Neuroscience Methods","volume":"412 ","pages":"Article 110280"},"PeriodicalIF":2.7000,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Neuroscience Methods","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0165027024002255","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"BIOCHEMICAL RESEARCH METHODS","Score":null,"Total":0}
引用次数: 0

Abstract

Background

With the arrival of the new generation of artificial intelligence wave, new human-robot interaction technologies continue to emerge. Brain–computer interface (BCI) offers a pathway for state monitoring and interaction control between human and robot. However, the unstable mental state reduce the accuracy of human brain intent decoding, and consequently affects the precision of BCI control.

New methods

This paper proposes a hybrid BCI-based shared control (HB-SC) method for brain-controlled robot navigation. Hybrid BCI fuses electroencephalogram (EEG) and electromyography (EMG) for mental state monitoring and interactive control to output human perception and decision. The shared control based on multi-sensory fusion integrates the special obstacle information perceived by humans with the regular environmental information perceived by the robot. In this process, valid BCI commands are screened by mental state assessment and output to a layered costmap for fusion.

Results

Eight subjects participated in the navigation experiment with dynamically changing mental state levels to validate the effects of a hybrid brain-computer interface through two shared control modes. The results show that the proposed HB-SC reduces collisions by 37.50 %, improves the success rate of traversing obstacles by 25.00 %, and the navigation trajectory is more consistent with expectations.

Conclusions

The HB-SC method can dynamically and intelligently adjust command output according to different brain states, helping to reduce errors made by subjects in a unstable mental state, thereby greatly enhancing the system's safety.

基于混合脑机接口的机器人共享控制研究
背景随着新一代人工智能浪潮的到来,新的人机交互技术不断涌现。脑机接口(BCI)为人与机器人之间的状态监测和交互控制提供了一条途径。本文提出了一种基于混合 BCI 的共享控制(HB-SC)方法,用于脑控机器人导航。混合BCI融合了脑电图(EEG)和肌电图(EMG),用于精神状态监测和交互控制,以输出人类的感知和决策。基于多感官融合的共享控制将人类感知到的特殊障碍物信息与机器人感知到的常规环境信息整合在一起。在此过程中,有效的 BCI 命令通过精神状态评估进行筛选,并输出到分层成本图中进行融合。结果八名受试者参与了精神状态水平动态变化的导航实验,通过两种共享控制模式验证了混合脑机接口的效果。结果表明,所提出的 HB-SC 减少了 37.50 % 的碰撞,提高了 25.00 % 的穿越障碍物的成功率,导航轨迹与预期更加一致。结论 HB-SC 方法可以根据不同的大脑状态动态、智能地调整指令输出,有助于减少受试者在不稳定的精神状态下产生的错误,从而大大提高系统的安全性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Neuroscience Methods
Journal of Neuroscience Methods 医学-神经科学
CiteScore
7.10
自引率
3.30%
发文量
226
审稿时长
52 days
期刊介绍: The Journal of Neuroscience Methods publishes papers that describe new methods that are specifically for neuroscience research conducted in invertebrates, vertebrates or in man. Major methodological improvements or important refinements of established neuroscience methods are also considered for publication. The Journal''s Scope includes all aspects of contemporary neuroscience research, including anatomical, behavioural, biochemical, cellular, computational, molecular, invasive and non-invasive imaging, optogenetic, and physiological research investigations.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信