Extensions and Application of the Robust Shared Response Model to Electroencephalography Data for Enhancing Brain-Computer Interface Systems

Andrew J. Graves, Cory Clayton, Joon Yuhl Soh, Gabe Yohe, P. Sederberg
{"title":"Extensions and Application of the Robust Shared Response Model to Electroencephalography Data for Enhancing Brain-Computer Interface Systems","authors":"Andrew J. Graves, Cory Clayton, Joon Yuhl Soh, Gabe Yohe, P. Sederberg","doi":"10.1109/SIEDS52267.2021.9483745","DOIUrl":null,"url":null,"abstract":"Brain Computer Interfaces (BCI) decode electroencephalography (EEG) data collected from the human brain to predict subsequent behavior. While this technology has promising applications, successfully implementing a model is challenging. The typical BCI control application requires many hours of training data from each individual to make predictions of intended activity specific to that individual. Moreover, there are individual differences in the organization of brain activity and low signal-to-noise ratios in noninvasive measurement techniques such as EEG. There is a fundamental bias-variance trade-off between developing a single model for all human brains vs. an individual model for each specific human brain. The Robust Shared Response Model (RSRM) attempts to resolve this tradeoff by leveraging both the homogeneity and heterogeneity of brain signals across people. RSRM extracts components that are common and shared across individual brains, while simultaneously learning unique representations between individual brains. By learning a latent shared space in conjunction with subject-specific representations, RSRM tends to result in better predictive performance on functional magnetic resonance imaging (fMRI) data relative to other common dimension reduction techniques. To our knowledge, we are the first research team attempting to expand the domain of RSRM by applying this technique to controlled experimental EEG data in a BCI setting. Using the openly available Motor Movement/ Imagery dataset, the decoding accuracy of RSRM exceeded models whose input was reduced by Principal Component Analysis (PCA), Independent Component Analysis (ICA), and subject-specific PCA. The results of our experiments suggest that RSRM can recover distributed latent brain signals and improve decoding accuracy of BCI tasks when dimension reduction is implemented as a feature engineering step. Future directions of this work include augmenting state-of-the art BCI with efficient reduced representations extracted by RSRM. This could enhance the utility of BCI technology in the real world. Furthermore, RSRM could have wide-ranging applications across other machine-learning applications that require classification of naturalistic data using reduced representations.","PeriodicalId":426747,"journal":{"name":"2021 Systems and Information Engineering Design Symposium (SIEDS)","volume":"08 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 Systems and Information Engineering Design Symposium (SIEDS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SIEDS52267.2021.9483745","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

Brain Computer Interfaces (BCI) decode electroencephalography (EEG) data collected from the human brain to predict subsequent behavior. While this technology has promising applications, successfully implementing a model is challenging. The typical BCI control application requires many hours of training data from each individual to make predictions of intended activity specific to that individual. Moreover, there are individual differences in the organization of brain activity and low signal-to-noise ratios in noninvasive measurement techniques such as EEG. There is a fundamental bias-variance trade-off between developing a single model for all human brains vs. an individual model for each specific human brain. The Robust Shared Response Model (RSRM) attempts to resolve this tradeoff by leveraging both the homogeneity and heterogeneity of brain signals across people. RSRM extracts components that are common and shared across individual brains, while simultaneously learning unique representations between individual brains. By learning a latent shared space in conjunction with subject-specific representations, RSRM tends to result in better predictive performance on functional magnetic resonance imaging (fMRI) data relative to other common dimension reduction techniques. To our knowledge, we are the first research team attempting to expand the domain of RSRM by applying this technique to controlled experimental EEG data in a BCI setting. Using the openly available Motor Movement/ Imagery dataset, the decoding accuracy of RSRM exceeded models whose input was reduced by Principal Component Analysis (PCA), Independent Component Analysis (ICA), and subject-specific PCA. The results of our experiments suggest that RSRM can recover distributed latent brain signals and improve decoding accuracy of BCI tasks when dimension reduction is implemented as a feature engineering step. Future directions of this work include augmenting state-of-the art BCI with efficient reduced representations extracted by RSRM. This could enhance the utility of BCI technology in the real world. Furthermore, RSRM could have wide-ranging applications across other machine-learning applications that require classification of naturalistic data using reduced representations.
增强脑机接口系统的鲁棒共享响应模型在脑电图数据中的扩展和应用
脑机接口(BCI)解码从人脑收集的脑电图(EEG)数据,以预测随后的行为。虽然该技术具有很好的应用前景,但成功实现模型是具有挑战性的。典型的脑机接口控制应用程序需要从每个人那里获得许多小时的训练数据,以预测特定于该个人的预期活动。此外,在脑电图等非侵入性测量技术中,大脑活动的组织和低信噪比存在个体差异。在为所有人类大脑开发单一模型与为每个特定人类大脑开发单个模型之间,存在一个基本的偏差-方差权衡。稳健共享反应模型(RSRM)试图通过利用人们大脑信号的同质性和异质性来解决这种权衡。RSRM提取个体大脑中共同和共享的成分,同时学习个体大脑之间的独特表征。相对于其他常见降维技术,RSRM在功能磁共振成像(fMRI)数据上具有更好的预测性能。据我们所知,我们是第一个试图通过将该技术应用于脑机接口设置中的受控实验脑电图数据来扩展RSRM领域的研究团队。使用公开可用的运动/图像数据集,RSRM的解码精度超过了通过主成分分析(PCA)、独立成分分析(ICA)和特定主题PCA减少输入的模型。实验结果表明,当将降维作为特征工程步骤时,RSRM可以恢复分布式脑潜伏信号,提高脑接口任务的解码精度。这项工作的未来方向包括用RSRM提取的高效简化表征来增强最先进的BCI。这可以增强BCI技术在现实世界中的效用。此外,RSRM可以广泛应用于其他需要使用简化表示对自然数据进行分类的机器学习应用程序。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信