上下文信息显著提高脑机接口性能——使用语言模型辅助脑机接口的文本输入案例研究。

Umut Orhan, Deniz Erdogmus, Kenneth E Hild, Brian Roark, Barry Oken, Melanie Fried-Oken
{"title":"上下文信息显著提高脑机接口性能——使用语言模型辅助脑机接口的文本输入案例研究。","authors":"Umut Orhan,&nbsp;Deniz Erdogmus,&nbsp;Kenneth E Hild,&nbsp;Brian Roark,&nbsp;Barry Oken,&nbsp;Melanie Fried-Oken","doi":"","DOIUrl":null,"url":null,"abstract":"<p><p>We present recent results on the design of the RSVP Keyboard - a brain computer interface (BCI) for expressive language generation for functionally locked-in individuals using rapid serial visual presentation of letters or other symbols such as icons. The proposed BCI design tightly incorporates probabilistic contextual information obtained from a language model into the single or multi-trial event related potential (ERP) decision mechanism. This tight fusion of contextual information with instantaneous and independent brain activity is demonstrated to potentially improve accuracy in a dramatic manner. Specifically, a simple regularized discriminant single-trial ERP classifier's performance can be increased from a naive baseline of 75% to 98% in a 28-symbol alphabet operating at 5% false ERP detection rate. We also demonstrate results which show that trained healthy subjects can achieve real-time typing accuracies over 90% mostly relying on single-trial ERP evidence when supplemented with a rudimentary n-gram language model. Further discussion and preliminary results include our initial efforts involving a locked-in individual and our efforts to train him to improve his skill in performing the task.</p>","PeriodicalId":72692,"journal":{"name":"Conference record. Asilomar Conference on Signals, Systems & Computers","volume":"45 ","pages":"132-136"},"PeriodicalIF":0.0000,"publicationDate":"2011-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4072332/pdf/nihms-494005.pdf","citationCount":"0","resultStr":"{\"title\":\"Context Information Significantly Improves Brain Computer Interface Performance - a Case Study on Text Entry Using a Language Model Assisted BCI.\",\"authors\":\"Umut Orhan,&nbsp;Deniz Erdogmus,&nbsp;Kenneth E Hild,&nbsp;Brian Roark,&nbsp;Barry Oken,&nbsp;Melanie Fried-Oken\",\"doi\":\"\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>We present recent results on the design of the RSVP Keyboard - a brain computer interface (BCI) for expressive language generation for functionally locked-in individuals using rapid serial visual presentation of letters or other symbols such as icons. The proposed BCI design tightly incorporates probabilistic contextual information obtained from a language model into the single or multi-trial event related potential (ERP) decision mechanism. This tight fusion of contextual information with instantaneous and independent brain activity is demonstrated to potentially improve accuracy in a dramatic manner. Specifically, a simple regularized discriminant single-trial ERP classifier's performance can be increased from a naive baseline of 75% to 98% in a 28-symbol alphabet operating at 5% false ERP detection rate. We also demonstrate results which show that trained healthy subjects can achieve real-time typing accuracies over 90% mostly relying on single-trial ERP evidence when supplemented with a rudimentary n-gram language model. Further discussion and preliminary results include our initial efforts involving a locked-in individual and our efforts to train him to improve his skill in performing the task.</p>\",\"PeriodicalId\":72692,\"journal\":{\"name\":\"Conference record. Asilomar Conference on Signals, Systems & Computers\",\"volume\":\"45 \",\"pages\":\"132-136\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2011-11-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4072332/pdf/nihms-494005.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Conference record. Asilomar Conference on Signals, Systems & Computers\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Conference record. Asilomar Conference on Signals, Systems & Computers","FirstCategoryId":"1085","ListUrlMain":"","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

我们介绍了RSVP键盘的最新设计成果,RSVP键盘是一种脑机接口(BCI),用于为功能锁定的个体提供表达性语言生成,使用快速串行视觉呈现字母或其他符号(如图标)。提出的脑机接口设计将从语言模型中获得的概率上下文信息紧密结合到单次或多次试验事件相关电位(ERP)决策机制中。这种上下文信息与瞬时和独立的大脑活动的紧密融合被证明可能以戏剧性的方式提高准确性。具体来说,一个简单的正则化判别单试验ERP分类器的性能可以在28个符号的字母表中从75%的初始基线提高到98%,在5%的错误ERP检测率下运行。我们还展示了训练有素的健康受试者在辅以基本n-gram语言模型的情况下,主要依靠单试验ERP证据,可以实现90%以上的实时打字准确率。进一步的讨论和初步结果包括我们对一个闭锁的人的初步努力,以及我们对他的训练,以提高他执行任务的技能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Context Information Significantly Improves Brain Computer Interface Performance - a Case Study on Text Entry Using a Language Model Assisted BCI.

We present recent results on the design of the RSVP Keyboard - a brain computer interface (BCI) for expressive language generation for functionally locked-in individuals using rapid serial visual presentation of letters or other symbols such as icons. The proposed BCI design tightly incorporates probabilistic contextual information obtained from a language model into the single or multi-trial event related potential (ERP) decision mechanism. This tight fusion of contextual information with instantaneous and independent brain activity is demonstrated to potentially improve accuracy in a dramatic manner. Specifically, a simple regularized discriminant single-trial ERP classifier's performance can be increased from a naive baseline of 75% to 98% in a 28-symbol alphabet operating at 5% false ERP detection rate. We also demonstrate results which show that trained healthy subjects can achieve real-time typing accuracies over 90% mostly relying on single-trial ERP evidence when supplemented with a rudimentary n-gram language model. Further discussion and preliminary results include our initial efforts involving a locked-in individual and our efforts to train him to improve his skill in performing the task.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
1.40
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信