DRDNet: a dual-view representation decoupling network for handwriting imagery EEG classification.

IF 3.8
Zhihao Li, Fan Wang, Haichen Lu, Rongzhang Luo, Tianwen Li, Lei Zhao, Yunfa Fu
{"title":"DRDNet: a dual-view representation decoupling network for handwriting imagery EEG classification.","authors":"Zhihao Li, Fan Wang, Haichen Lu, Rongzhang Luo, Tianwen Li, Lei Zhao, Yunfa Fu","doi":"10.1088/1741-2552/ae9bef","DOIUrl":null,"url":null,"abstract":"<p><p><i>Objective</i>. Handwriting imagery (HI) based on electroencephalography (EEG) offers a non-invasive route to text input and complex intention expression for brain-computer interfaces (BCIs). However, HI EEG decoding is challenged by low signal-to-noise ratios, non-stationarity, cross-session distribution shifts, and the coexistence of continuous temporal trends and local high-response patterns.<i>Approach</i>. We propose a Dual-View Representation Decoupling Network (DRDNet) for HI EEG classification under within-subject cross-session and cross-subject evaluation settings. DRDNet first constructs two complementary temporal views from spatial EEG features using average and max pooling, corresponding to smooth trend-oriented and salient response-oriented representations. These views are then modeled by a bidirectional Mamba encoder and a Transformer encoder, respectively, and adaptively integrated through a time-step-level dynamic fusion mechanism followed by long short-term memory-based temporal aggregation. The method is evaluated on two tasks from a public HI EEG dataset: Chinese character stroke HI (CCSHI) and pinyin single-vowel HI (SVHI).<i>Main results</i>. DRDNet achieved average accuracies of 67.74% and 62.51%, with Cohen's kappa scores of 0.5968 and 0.5502, on CCSHI and SVHI, respectively. Under the cross-subject setting, DRDNet also achieved the best average accuracies of 62.54% and 54.40% on CCSHI and SVHI, respectively. DRDNet outperformed seven representative EEG decoding baselines under both evaluation settings. Confusion matrices, feature visualization, ablation studies, structural variant analysis, and complexity evaluation further showed improved feature separability and a favorable balance between decoding performance and computational efficiency.<i>Significance</i>. The results indicate that decoupling HI EEG into complementary temporal views and matching them with heterogeneous temporal encoders provides an effective representation learning strategy for robust non-invasive handwriting BCI decoding.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":3.8000,"publicationDate":"2026-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of neural engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1088/1741-2552/ae9bef","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Objective. Handwriting imagery (HI) based on electroencephalography (EEG) offers a non-invasive route to text input and complex intention expression for brain-computer interfaces (BCIs). However, HI EEG decoding is challenged by low signal-to-noise ratios, non-stationarity, cross-session distribution shifts, and the coexistence of continuous temporal trends and local high-response patterns.Approach. We propose a Dual-View Representation Decoupling Network (DRDNet) for HI EEG classification under within-subject cross-session and cross-subject evaluation settings. DRDNet first constructs two complementary temporal views from spatial EEG features using average and max pooling, corresponding to smooth trend-oriented and salient response-oriented representations. These views are then modeled by a bidirectional Mamba encoder and a Transformer encoder, respectively, and adaptively integrated through a time-step-level dynamic fusion mechanism followed by long short-term memory-based temporal aggregation. The method is evaluated on two tasks from a public HI EEG dataset: Chinese character stroke HI (CCSHI) and pinyin single-vowel HI (SVHI).Main results. DRDNet achieved average accuracies of 67.74% and 62.51%, with Cohen's kappa scores of 0.5968 and 0.5502, on CCSHI and SVHI, respectively. Under the cross-subject setting, DRDNet also achieved the best average accuracies of 62.54% and 54.40% on CCSHI and SVHI, respectively. DRDNet outperformed seven representative EEG decoding baselines under both evaluation settings. Confusion matrices, feature visualization, ablation studies, structural variant analysis, and complexity evaluation further showed improved feature separability and a favorable balance between decoding performance and computational efficiency.Significance. The results indicate that decoupling HI EEG into complementary temporal views and matching them with heterogeneous temporal encoders provides an effective representation learning strategy for robust non-invasive handwriting BCI decoding.

手写体图像脑电分类的双视图表示解耦网络。
目的:基于脑电图(EEG)的手写图像(HI)为脑机接口(bci)的文本输入和复杂意图表达提供了一种无创的途径。然而,HI脑电图解码面临着低信噪比、非平稳性、跨会话分布偏移以及连续时间趋势和局部高响应模式共存的挑战。方法:我们提出了一种双视图表示解耦网络(DRDNet)用于主题内交叉会话HI脑电分类。DRDNet首先利用平均池化和最大池化从空间脑电特征构建了两个互补的时间视图,对应于平滑趋势导向和显著响应导向的表征。然后,这些视图分别由双向Mamba编码器和Transformer编码器建模,并通过时间步长级动态融合机制进行自适应集成,随后是基于长短期记忆的时间聚合。在公开的HI脑电图数据集上对该方法进行了评估:汉字笔画手写图像(CCSHI)和拼音单元音手写图像(SVHI)。主要结果:DRDNet在CCSHI和SVHI上的平均准确率分别为67.74%和62.51%,Cohen’s kappa得分分别为0.5968和0.5502。在相同的交叉会话协议下,它优于7个代表性的EEG解码基线。混淆矩阵、特征可视化、消融研究、结构变异分析和复杂性评估进一步显示了特征可分离性的提高,以及解码性能和计算效率之间的良好平衡。结果表明,将HI脑电解耦成互补的时间视图并与异构时间编码器进行匹配,为鲁棒无创手写脑机接口解码提供了一种有效的表征学习策略。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书