Xiang Shen, Xiang Zhang, Yifan Huang, Shuhang Chen, Yiwen Wang
{"title":"Modelling mPFC Activities in Reinforcement Learning Framework for Brain-Machine Interfaces","authors":"Xiang Shen, Xiang Zhang, Yifan Huang, Shuhang Chen, Yiwen Wang","doi":"10.1109/NER.2019.8717162","DOIUrl":"https://doi.org/10.1109/NER.2019.8717162","url":null,"abstract":"Reinforcement learning (RL) algorithm interprets the movement intentions in Brain-machine interfaces (BMIs) with a reward signal. This reward can be an external reward (food or water) or an internal representation which links the correct movement with the external reward. Medial prefrontal cortex (mPFC) has been demonstrated to be closely related to the reward-guided learning. In this paper, we propose to model mPFC activities as an internal representation of the reward associated with different actions in a RL framework. Support vector machine (SVM) is adopted to analyze mPFC activities to distinguish the rewarded and unrewarded trials based on mPFC signals considering corresponding actions. Then the discrimination result will be utilized to train a RL decoder. Here we introduce the attention-gated reinforcement learning (AGREL) as the decoder to generate a mapping between motor cortex(M1) and action states. To evaluate our approach, we test on in vivo neural physiological data collected from rats when performing a two-lever discrimination task. The RL decoder using the internal action-reward evaluation achieves a prediction accuracy of 94.8%, which is very close to the one using the external reward. This indicates the potentials of modelling mPFC activities as an internal representation to associate the correct action with the reward.","PeriodicalId":356177,"journal":{"name":"2019 9th International IEEE/EMBS Conference on Neural Engineering (NER)","volume":"118 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124575148","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Anxiety detection from Electrodermal Activity Sensor with movement & interaction during Virtual Reality Simulation","authors":"Iakovos (Jacob) Kritikos, Giannis Tzannetos, Chara Zoitaki, Stavroula Poulopoulou, D. Koutsouris","doi":"10.1109/NER.2019.8717170","DOIUrl":"https://doi.org/10.1109/NER.2019.8717170","url":null,"abstract":"Nowadays, Virtual Reality (VR) is bringing great benefits to Anxiety Disorder treatments, as well as to other brain cognitive dysfunctions. The advantage of VR is that it can provoke stimuli to the same degree as real-life situations. However, measurement methods of physiological changes caused by the aforementioned stimuli, which apply to VR Anxiety Disorder treatments, have not been examined extensively. As a result, clinicians who use biosignal sensors tend to ask their patients to remain motionless during simulations in order to achieve accurate measurements from the sensors. It is clear that this practice limits the level and range of benefits yielded when using VR simulation. As a consequence, the patients’ experience is restricted and so is the potential of the sensors’ application in the treatment methods. Furthermore, the data gathered from the sensors is handled using conventional analysis affecting the conclusions drawn about the patients’ state. This study aims to emphasise the importance of interacting with the stimuli during the VR treatment through the proposal of an Electrodermal Activity (EDA) Sensor System architecture that can be combined with VR simulations while still allowing the patient to move and interact within the Virtual Environment, without compromising the sensor’s measurements. Continuous Deconvolution Analysis is used to draw conclusions from the gathered biosensor data.","PeriodicalId":356177,"journal":{"name":"2019 9th International IEEE/EMBS Conference on Neural Engineering (NER)","volume":"183 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116687019","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Large-Scale Neural Consolidation in BMI Learning*","authors":"Albert You, Ellen L. Zippi, J. Carmena","doi":"10.1109/NER.2019.8717068","DOIUrl":"https://doi.org/10.1109/NER.2019.8717068","url":null,"abstract":"Brain-machine interfaces (BMIs) use signals acquired from the brain to control actuators such as computer cursors or robotic arms, with potential to restore motor function to individuals with disabilities. While the process of learning and controlling a BMI is complex, involving cortico-striatal networks, it has been well-established that the brain is able to learn to control BMI actuators using relatively few neurons as direct inputs into the decoder. In particular, neurons that are used as inputs to a BMI decoder (direct neurons) experience changes in direction tuning and modulation depth, eventually forming a stable neuroprosthetic map. Furthermore, previous work has shown that indirect neurons (those that are not inputs to the decoder) also form a stable neuroprosthetic map that differs from manual reaching. However, it is still unclear how these changes in indirect units are formed over the course of learning. We found that indirect neurons adapted similarly to that of direct neurons over learning. Indirect neurons formed a stabilized tuning map, decreased neural dimensionality, and consolidated firing activity into more correlated patterns. Furthermore, direct and indirect neurons adapted together, not only coordinating activity within each population, but across populations as well. Together, our results show that indirect neurons change alongside direct neurons, suggesting a large-scale neural search and adaptation for direct neurons.","PeriodicalId":356177,"journal":{"name":"2019 9th International IEEE/EMBS Conference on Neural Engineering (NER)","volume":"123 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116214007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Iñaki Ortego-Isasa, A. Martins, N. Birbaumer, A. Ramos-Murguialday
{"title":"First Steps Towards Understanding How Non-Invasive Magnetic Stimulation Affects Neural Firing at Spinal Cord","authors":"Iñaki Ortego-Isasa, A. Martins, N. Birbaumer, A. Ramos-Murguialday","doi":"10.1109/NER.2019.8717038","DOIUrl":"https://doi.org/10.1109/NER.2019.8717038","url":null,"abstract":"Magnetic stimulation using commercial transcranial magnetic stimulators (TMS) and coils is becoming an established tool for neurostimulation. However, when applied at the lumbar region it is not clear which neural structures are stimulated and especially, if the spinal cord (SC) can be stimulated. Computational modeling with realistic human body models is a promising tool to understand better the basic mechanisms of the stimulation. In this study we have used a realistic model to calculate the current density (J) distribution and magnitude under different output power levels of a commercial stimulator to describe the electromagnetic effects on the different tissues. Our results suggest that spinal cord stimulation with TMS is possible. However, significant muscle contraction is produced due to the high stimulation needed, which might make this stimulation non-practical. The spatial resolution of this technology is very poor to stimulate specific parts of the SC only. Although the stimulation aims at SC structures, we observed that most of the current does not reach the SC, but the cerebrospinal fluid (CSF). All together, these results represent a first step towards understanding and optimizing magnetic transpinal stimulation.","PeriodicalId":356177,"journal":{"name":"2019 9th International IEEE/EMBS Conference on Neural Engineering (NER)","volume":"442 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123428492","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Faller, Yida Lin, Jayce Doose, G. Saber, J. McIntosh, J. Teves, R. Goldman, M. George, P. Sajda, T. Brown
{"title":"An EEG-fMRI-TMS instrument to investigate BOLD response to EEG guided stimulation","authors":"J. Faller, Yida Lin, Jayce Doose, G. Saber, J. McIntosh, J. Teves, R. Goldman, M. George, P. Sajda, T. Brown","doi":"10.1109/NER.2019.8716889","DOIUrl":"https://doi.org/10.1109/NER.2019.8716889","url":null,"abstract":"Depression is a serious mental illness that is frequently resistant to a first round of pharmacotherapy. Electroconvulsive therapy (ECT) is effective even for such treatment resistant depression but is associated with significant adverse effects. Repetitive transcranial magnetic stimulation (rTMS) over the left dorsolateral prefrontal cortex in comparison causes only mild discomfort but is less effective than ECT. We hypothesize that TMS treatment efficacy could be improved by locking TMS onset to a specific, potentially subject specific phase of the prefrontal alpha rhythm in the electroencephalogram (EEG). Here, we present an instrument that can track and predict phase of the alpha rhythm in the EEG to precisely target TMS while concurrently recording functional magnetic resonance imaging (fMRI) to study local and distributed hemodynamic brain responses to stimulation. Tests of the instrument with three healthy adults indicate that EEG phase-locked TMS can be administered accurately enough to start testing systematically whether specific stimulation protocols can lead to clinically significant improvements in depression. To our knowledge, this is the first system that can deliver TMS phase-locked to the alpha rhythm while concurrently recording fMRI. For patients, such EEG guided TMS treatment could lead to better clinical outcomes and lower incidence of adverse effects.","PeriodicalId":356177,"journal":{"name":"2019 9th International IEEE/EMBS Conference on Neural Engineering (NER)","volume":"1924 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128012922","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Trent L. Simmons, J. Snider, Moran Amit, T. Ng, J. Townsend, L. Chukoskie
{"title":"An Objective System for Quantifying the Effect of Cognitive Load on Movement in Individuals with Autism Spectrum Disorder","authors":"Trent L. Simmons, J. Snider, Moran Amit, T. Ng, J. Townsend, L. Chukoskie","doi":"10.1109/NER.2019.8717022","DOIUrl":"https://doi.org/10.1109/NER.2019.8717022","url":null,"abstract":"For someone with Autism Spectrum Disorder, performance on tasks that require coordinated motor and cognitive activities, such as walking while talking (or texting) on our phones, can take substantially more effort to accomplish. While it is more common to isolate and examine motor and cognitive skill in separate experiments, we propose a dual task experiment to allow us to examine performance in people with autism more realistically. We designed a system composed of three task types and accompanying hardware to simultaneously quantify balance, fine motor skill, and cognitive ability. We hypothesized that the additional demands of the balance and speeded finger-tapping tasks would degrade motor performance in the simultaneous conditions, but not impact cognitive (N-Back task) performance. Movement data were evaluated by comparing the change of each group across 3 levels of cognitive load (0-, 1-, and 2-back). We tested the task on a small sample of young adults with autism spectrum disorder (ASD; n=4) and matched controls (n=4). We observed a trend largely consistent with our hypotheses. The system’s temporal precision and modular design also allow for the incorporation of other sensors as needed, like EEG or heart rate variability. We propose that a version of this system be tested as a putative outcome measure for interventions involving attention, cognitive load or certain types of motor skill training.","PeriodicalId":356177,"journal":{"name":"2019 9th International IEEE/EMBS Conference on Neural Engineering (NER)","volume":"PP 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126421847","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. A. Feitosa, C. A. S. Filho, R. Casseb, A. Camargo, B. S. G. Martins, B. Ballester, P. Omedas, P. Verschure, T. D. Oberg, Li Li Min, G. Castellano
{"title":"Complex network changes during a virtual reality rehabilitation protocol following stroke: a case study","authors":"J. A. Feitosa, C. A. S. Filho, R. Casseb, A. Camargo, B. S. G. Martins, B. Ballester, P. Omedas, P. Verschure, T. D. Oberg, Li Li Min, G. Castellano","doi":"10.1109/NER.2019.8717143","DOIUrl":"https://doi.org/10.1109/NER.2019.8717143","url":null,"abstract":"Stroke is one of the main causes of disabilities caused by injuries to the human central nervous system, yielding a wide range of mild to severe impairments that can compromise sensorimotor and cognitive functions. Although rehabilitation protocols may improve function of stroke survivors, patients often reach plateaus while undergoing therapy. Recently, virtual reality (VR) technologies have been paired with traditional rehabilitation aiming to improve function recovery after stroke. Aiming to better understand structural brain changes due to VR rehabilitation protocols, we modeled the brain as a graph and extracted three measures representing the network’s topology: degree, clustering coefficient and betweenness centrality (BC). In this single case study, our results indicate that all metrics increased on the ipsilesional hemisphere, while remaining about the same at the contrale-sional site. Particularly, the number of functional connections increased in the lesion area overtime. In addition, the BC displayed the highest variations, and in brain regions related to the patient’s cognitive and motor impairments; hence, we argue that this measure could be regarded as an indicative for brain plasticity mechanisms.","PeriodicalId":356177,"journal":{"name":"2019 9th International IEEE/EMBS Conference on Neural Engineering (NER)","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121414337","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A psychophysical and electrophysiological platform using internal action selection task in primate parkinsonian model*","authors":"Wenjuan Hu, Qiyi Hu, Y. Qiu, Keyi Liu, Yao Chen","doi":"10.1109/NER.2019.8717156","DOIUrl":"https://doi.org/10.1109/NER.2019.8717156","url":null,"abstract":"Internal action selection is an important motor control, in which patients with Parkinson's disease (PD) generally show deficiencies. Basal ganglia (BG) is proved to play an important role in decision-making and act as a specialized internal selection device within the vertebrate brain architecture. Furthermore, some studies showed there was a close relationship among striatal dopamine signaling, action selection and time interval by training mice to perform an internal selection task. However, the neural mechanism of the internal action selection is still unclear.In this study, we setup a platform for psychophysical and electrophysiological study and recorded behavioral data from normal human subjects and primates when they performing an internal action selection task. The results showed that longer trial intervals led to longer action transition time, which indicates the time interval biases internal action selection, and the effect of movement direction was not significant. Furthermore, we recorded the task-related neuronal activity in primate’s primary motor cortex (M1). Preliminary data showed there were significant firing rate changes in M1 at the transition of action selection.","PeriodicalId":356177,"journal":{"name":"2019 9th International IEEE/EMBS Conference on Neural Engineering (NER)","volume":"48 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130038140","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Maxime Fauvet, S. Crémoux, A. Chalard, J. Tisseyre, D. Gasq, D. Amarantini
{"title":"A novel method to generalize time-frequency coherence analysis between EEG or EMG signals during repetitive trials with high intra-subject variability in duration","authors":"Maxime Fauvet, S. Crémoux, A. Chalard, J. Tisseyre, D. Gasq, D. Amarantini","doi":"10.1109/NER.2019.8716973","DOIUrl":"https://doi.org/10.1109/NER.2019.8716973","url":null,"abstract":"Time-frequency coherence analysis between EEG and EMG signals represents a valuable tool to gain insight into neural mechanisms underlying motor control. However, for self-paced movements, the variability of inter-trial duration limits its proper use. To overcome this obstacle, we propose a time-normalizing approach and test it on both simulated and experimental data recorded during elbow extension movements performed by a post-stroke subject. Results show that the proposed time-normalization improves both the consistency and the accuracy of time-frequency coherence calculation, detection and quantification. The proposed time-normalization overcomes a major limitation to generalization of coherence analysis and can be suggested as an essential step to perform for coherence in presence of high intra-subject variability in duration.","PeriodicalId":356177,"journal":{"name":"2019 9th International IEEE/EMBS Conference on Neural Engineering (NER)","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127775000","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Spatial Resolution of Visual Stimuli in SSVEP-based Brain-Computer Interface","authors":"Jing Mu, D. Grayden, Y. Tan, D. Oetomo","doi":"10.1109/NER.2019.8717155","DOIUrl":"https://doi.org/10.1109/NER.2019.8717155","url":null,"abstract":"Communicating spatial coordinates plays a crucial role in human-robot interactions, where a given target, object, or location needs to be localized. The steady-state visual evoked potential (SSVEP) is one of the most robustly detectable signals in electroencephalography (EEG)-based brain-computer interfaces (BCIs). However, the spatial resolution of the visual stimuli in a SSVEP-based BCI needs to be characterized for localization applications. In this study, we demonstrate that the influence of an adjacent stimulus attenuates to the baseline level when it is outside the paracentral region of human field of view (FOV) based on data collected from five subjects. This conservatively defines the spatial resolution in SSVEP. A potential lateral inhibition phenomenon was also observed when the two stimuli were immediately next to each other, which may reflect the center-surround structure of the receptive fields in visual cortex. Moreover, different frequency setups appear to affect the robustness of the SSVEP-based BCI and suggest that adjacent stimuli should be with frequencies that are more distinguishable visually.","PeriodicalId":356177,"journal":{"name":"2019 9th International IEEE/EMBS Conference on Neural Engineering (NER)","volume":"56 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130254502","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}