Umut Orhan, Deniz Erdogmus, Kenneth E Hild, Brian Roark, Barry Oken, Melanie Fried-Oken
{"title":"上下文信息显著提高脑机接口性能——使用语言模型辅助脑机接口的文本输入案例研究。","authors":"Umut Orhan, Deniz Erdogmus, Kenneth E Hild, Brian Roark, Barry Oken, Melanie Fried-Oken","doi":"","DOIUrl":null,"url":null,"abstract":"<p><p>We present recent results on the design of the RSVP Keyboard - a brain computer interface (BCI) for expressive language generation for functionally locked-in individuals using rapid serial visual presentation of letters or other symbols such as icons. The proposed BCI design tightly incorporates probabilistic contextual information obtained from a language model into the single or multi-trial event related potential (ERP) decision mechanism. This tight fusion of contextual information with instantaneous and independent brain activity is demonstrated to potentially improve accuracy in a dramatic manner. Specifically, a simple regularized discriminant single-trial ERP classifier's performance can be increased from a naive baseline of 75% to 98% in a 28-symbol alphabet operating at 5% false ERP detection rate. We also demonstrate results which show that trained healthy subjects can achieve real-time typing accuracies over 90% mostly relying on single-trial ERP evidence when supplemented with a rudimentary n-gram language model. Further discussion and preliminary results include our initial efforts involving a locked-in individual and our efforts to train him to improve his skill in performing the task.</p>","PeriodicalId":72692,"journal":{"name":"Conference record. Asilomar Conference on Signals, Systems & Computers","volume":"45 ","pages":"132-136"},"PeriodicalIF":0.0000,"publicationDate":"2011-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4072332/pdf/nihms-494005.pdf","citationCount":"0","resultStr":"{\"title\":\"Context Information Significantly Improves Brain Computer Interface Performance - a Case Study on Text Entry Using a Language Model Assisted BCI.\",\"authors\":\"Umut Orhan, Deniz Erdogmus, Kenneth E Hild, Brian Roark, Barry Oken, Melanie Fried-Oken\",\"doi\":\"\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>We present recent results on the design of the RSVP Keyboard - a brain computer interface (BCI) for expressive language generation for functionally locked-in individuals using rapid serial visual presentation of letters or other symbols such as icons. The proposed BCI design tightly incorporates probabilistic contextual information obtained from a language model into the single or multi-trial event related potential (ERP) decision mechanism. This tight fusion of contextual information with instantaneous and independent brain activity is demonstrated to potentially improve accuracy in a dramatic manner. Specifically, a simple regularized discriminant single-trial ERP classifier's performance can be increased from a naive baseline of 75% to 98% in a 28-symbol alphabet operating at 5% false ERP detection rate. We also demonstrate results which show that trained healthy subjects can achieve real-time typing accuracies over 90% mostly relying on single-trial ERP evidence when supplemented with a rudimentary n-gram language model. Further discussion and preliminary results include our initial efforts involving a locked-in individual and our efforts to train him to improve his skill in performing the task.</p>\",\"PeriodicalId\":72692,\"journal\":{\"name\":\"Conference record. Asilomar Conference on Signals, Systems & Computers\",\"volume\":\"45 \",\"pages\":\"132-136\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2011-11-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4072332/pdf/nihms-494005.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Conference record. Asilomar Conference on Signals, Systems & Computers\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Conference record. Asilomar Conference on Signals, Systems & Computers","FirstCategoryId":"1085","ListUrlMain":"","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Context Information Significantly Improves Brain Computer Interface Performance - a Case Study on Text Entry Using a Language Model Assisted BCI.
We present recent results on the design of the RSVP Keyboard - a brain computer interface (BCI) for expressive language generation for functionally locked-in individuals using rapid serial visual presentation of letters or other symbols such as icons. The proposed BCI design tightly incorporates probabilistic contextual information obtained from a language model into the single or multi-trial event related potential (ERP) decision mechanism. This tight fusion of contextual information with instantaneous and independent brain activity is demonstrated to potentially improve accuracy in a dramatic manner. Specifically, a simple regularized discriminant single-trial ERP classifier's performance can be increased from a naive baseline of 75% to 98% in a 28-symbol alphabet operating at 5% false ERP detection rate. We also demonstrate results which show that trained healthy subjects can achieve real-time typing accuracies over 90% mostly relying on single-trial ERP evidence when supplemented with a rudimentary n-gram language model. Further discussion and preliminary results include our initial efforts involving a locked-in individual and our efforts to train him to improve his skill in performing the task.