Decoding Joint-Level Hand Movements With Intracortical Neural Signals in a Human Brain–Computer Interface

IF 5 3区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Huaqin Sun;Yu Qi;Xiaodi Wu;Junming Zhu;Jianmin Zhang;Yueming Wang
{"title":"Decoding Joint-Level Hand Movements With Intracortical Neural Signals in a Human Brain–Computer Interface","authors":"Huaqin Sun;Yu Qi;Xiaodi Wu;Junming Zhu;Jianmin Zhang;Yueming Wang","doi":"10.1109/TCDS.2024.3409555","DOIUrl":null,"url":null,"abstract":"Fine movements of hands play an important role in everyday life. While existing studies have successfully decoded hand gestures or finger movements from brain signals, direct decoding of single-joint kinematics remains challenging. This study aims to investigate the decoding of fine hand movements at the single-joint level. Neural activities were recorded from the motor cortex (MC) of a human participant while imagining eleven different hand movements. We comprehensively evaluated the decoding efficiency of various brain signal features, neural decoding algorithms, and single-joint kinematic variables for decoding. Results showed that using the spiking band power (SBP) signals, we could faithfully decode the single-joint angles with an average correlation coefficient of 0.77, outperforming other brain signal features. Nonlinear approaches that incorporate temporal context information, particularly recurrent neural networks, significantly outperformed traditional methods. Decoding joint angles yielded superior results compared to joint angular velocities. Our approach facilitates the construction of high-performance brain–computer interfaces for dexterous hand control.","PeriodicalId":54300,"journal":{"name":"IEEE Transactions on Cognitive and Developmental Systems","volume":"16 6","pages":"2100-2109"},"PeriodicalIF":5.0000,"publicationDate":"2024-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Cognitive and Developmental Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10547569/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Fine movements of hands play an important role in everyday life. While existing studies have successfully decoded hand gestures or finger movements from brain signals, direct decoding of single-joint kinematics remains challenging. This study aims to investigate the decoding of fine hand movements at the single-joint level. Neural activities were recorded from the motor cortex (MC) of a human participant while imagining eleven different hand movements. We comprehensively evaluated the decoding efficiency of various brain signal features, neural decoding algorithms, and single-joint kinematic variables for decoding. Results showed that using the spiking band power (SBP) signals, we could faithfully decode the single-joint angles with an average correlation coefficient of 0.77, outperforming other brain signal features. Nonlinear approaches that incorporate temporal context information, particularly recurrent neural networks, significantly outperformed traditional methods. Decoding joint angles yielded superior results compared to joint angular velocities. Our approach facilitates the construction of high-performance brain–computer interfaces for dexterous hand control.
在人脑-计算机接口中利用皮层内神经信号解码关节级手部运动
手部的精细动作在日常生活中起着重要作用。虽然现有的研究已经成功地从大脑信号中解码了手势或手指运动,但直接解码单关节的运动学仍然具有挑战性。本研究旨在探讨手部精细动作在单关节水平上的解码。当参与者想象11种不同的手部动作时,从运动皮层(MC)记录下神经活动。我们综合评估了各种脑信号特征、神经解码算法和单关节运动变量的解码效率。结果表明,利用峰值带功率(SBP)信号可以准确地解码单关节角,平均相关系数为0.77,优于其他脑信号特征。结合时间上下文信息的非线性方法,特别是递归神经网络,显著优于传统方法。与关节角速度相比,解码关节角度产生了更好的结果。我们的方法有助于构建用于灵巧手控制的高性能脑机接口。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
7.20
自引率
10.00%
发文量
170
期刊介绍: The IEEE Transactions on Cognitive and Developmental Systems (TCDS) focuses on advances in the study of development and cognition in natural (humans, animals) and artificial (robots, agents) systems. It welcomes contributions from multiple related disciplines including cognitive systems, cognitive robotics, developmental and epigenetic robotics, autonomous and evolutionary robotics, social structures, multi-agent and artificial life systems, computational neuroscience, and developmental psychology. Articles on theoretical, computational, application-oriented, and experimental studies as well as reviews in these areas are considered.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信