Shengjie Zheng, Wenyi Li, Lang Qian, Che He, Xiaojian Li
{"title":"基于神经流形的脉冲神经网络增强脑机接口数据","authors":"Shengjie Zheng, Wenyi Li, Lang Qian, Che He, Xiaojian Li","doi":"10.48550/arXiv.2204.05132","DOIUrl":null,"url":null,"abstract":"ql20@mails.tsinghua.edu.cn Abstract. Brain-computer interfaces (BCIs), transform neural signals in the brain into instructions to control external devices. However, obtaining sufficient training data is difficult as well as limited. With the advent of advanced machine learning methods, the capability of brain-computer interfaces has been enhanced like never before, however, these methods require a large amount of data for training and thus require data augmentation of the limited data available. Here, we use spiking neural networks (SNN) as data generators. It is touted as the next-generation neural network and is considered as one of the algorithms oriented to general artificial intelligence because it borrows the neural information processing from biological neurons. We use the SNN to generate neural spike information that is bio-interpretable and conforms to the intrinsic patterns in the original neural data. Experiments show that the model can direct-ly synthesize new spike trains, which in turn improves the generalization ability of the BCI decoder. Both the input and output of the spiking neural model are spike information, which is a brain-inspired intelligence approach that can be better integrated with BCI in the specific patterns of neural population activity rather than on individual neurons[4]. The neural population dynamics exist in low-dimensional neural manifolds in a high-dimensional neural space[5]. Here, we employ a bio-interpretive SNN that mimics the neural information generation as well as the com-munication of biological neural populations. We analyze motor cortical neural population data recorded from monkeys to derive motor-related neural population dynamics. The neural spike properties of the SNN itself allow the direct generation of biologically meaningful spike trains that match the activity of real biological neural populations. We explored the interaction between the spike train synthesizer and the BCI decoder. Our results show that based on a small amount of training data as a template, data conforming to the dynamics of neural populations are generated, thus enhancing the decoding ability of the BCI decoder.","PeriodicalId":93416,"journal":{"name":"Artificial neural networks, ICANN : international conference ... proceedings. International Conference on Artificial Neural Networks (European Neural Network Society)","volume":"11 1","pages":"519-530"},"PeriodicalIF":0.0000,"publicationDate":"2022-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"A Spiking Neural Network based on Neural Manifold for Augmenting Intracortical Brain-Computer Interface Data\",\"authors\":\"Shengjie Zheng, Wenyi Li, Lang Qian, Che He, Xiaojian Li\",\"doi\":\"10.48550/arXiv.2204.05132\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"ql20@mails.tsinghua.edu.cn Abstract. Brain-computer interfaces (BCIs), transform neural signals in the brain into instructions to control external devices. However, obtaining sufficient training data is difficult as well as limited. With the advent of advanced machine learning methods, the capability of brain-computer interfaces has been enhanced like never before, however, these methods require a large amount of data for training and thus require data augmentation of the limited data available. Here, we use spiking neural networks (SNN) as data generators. It is touted as the next-generation neural network and is considered as one of the algorithms oriented to general artificial intelligence because it borrows the neural information processing from biological neurons. We use the SNN to generate neural spike information that is bio-interpretable and conforms to the intrinsic patterns in the original neural data. Experiments show that the model can direct-ly synthesize new spike trains, which in turn improves the generalization ability of the BCI decoder. Both the input and output of the spiking neural model are spike information, which is a brain-inspired intelligence approach that can be better integrated with BCI in the specific patterns of neural population activity rather than on individual neurons[4]. The neural population dynamics exist in low-dimensional neural manifolds in a high-dimensional neural space[5]. Here, we employ a bio-interpretive SNN that mimics the neural information generation as well as the com-munication of biological neural populations. We analyze motor cortical neural population data recorded from monkeys to derive motor-related neural population dynamics. The neural spike properties of the SNN itself allow the direct generation of biologically meaningful spike trains that match the activity of real biological neural populations. We explored the interaction between the spike train synthesizer and the BCI decoder. Our results show that based on a small amount of training data as a template, data conforming to the dynamics of neural populations are generated, thus enhancing the decoding ability of the BCI decoder.\",\"PeriodicalId\":93416,\"journal\":{\"name\":\"Artificial neural networks, ICANN : international conference ... proceedings. International Conference on Artificial Neural Networks (European Neural Network Society)\",\"volume\":\"11 1\",\"pages\":\"519-530\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-03-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Artificial neural networks, ICANN : international conference ... proceedings. International Conference on Artificial Neural Networks (European Neural Network Society)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.48550/arXiv.2204.05132\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Artificial neural networks, ICANN : international conference ... proceedings. International Conference on Artificial Neural Networks (European Neural Network Society)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.48550/arXiv.2204.05132","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A Spiking Neural Network based on Neural Manifold for Augmenting Intracortical Brain-Computer Interface Data
ql20@mails.tsinghua.edu.cn Abstract. Brain-computer interfaces (BCIs), transform neural signals in the brain into instructions to control external devices. However, obtaining sufficient training data is difficult as well as limited. With the advent of advanced machine learning methods, the capability of brain-computer interfaces has been enhanced like never before, however, these methods require a large amount of data for training and thus require data augmentation of the limited data available. Here, we use spiking neural networks (SNN) as data generators. It is touted as the next-generation neural network and is considered as one of the algorithms oriented to general artificial intelligence because it borrows the neural information processing from biological neurons. We use the SNN to generate neural spike information that is bio-interpretable and conforms to the intrinsic patterns in the original neural data. Experiments show that the model can direct-ly synthesize new spike trains, which in turn improves the generalization ability of the BCI decoder. Both the input and output of the spiking neural model are spike information, which is a brain-inspired intelligence approach that can be better integrated with BCI in the specific patterns of neural population activity rather than on individual neurons[4]. The neural population dynamics exist in low-dimensional neural manifolds in a high-dimensional neural space[5]. Here, we employ a bio-interpretive SNN that mimics the neural information generation as well as the com-munication of biological neural populations. We analyze motor cortical neural population data recorded from monkeys to derive motor-related neural population dynamics. The neural spike properties of the SNN itself allow the direct generation of biologically meaningful spike trains that match the activity of real biological neural populations. We explored the interaction between the spike train synthesizer and the BCI decoder. Our results show that based on a small amount of training data as a template, data conforming to the dynamics of neural populations are generated, thus enhancing the decoding ability of the BCI decoder.