Journal of neural engineering最新文献

筛选
英文 中文
Distraction impact of concurrent conversation on event-related potential based brain-computer interfaces. 同时进行的对话对基于事件相关电位的脑机接口的分心影响。
Journal of neural engineering Pub Date : 2024-09-05 DOI: 10.1088/1741-2552/ad731e
Minju Kim, Sung-Phil Kim
{"title":"Distraction impact of concurrent conversation on event-related potential based brain-computer interfaces.","authors":"Minju Kim, Sung-Phil Kim","doi":"10.1088/1741-2552/ad731e","DOIUrl":"10.1088/1741-2552/ad731e","url":null,"abstract":"<p><p><i>Objective.</i>This study investigates the impact of conversation on the performance of visual event-related potential (ERP)-based brain-computer interfaces (BCIs), considering distractions in real life environment. The research aims to understand how cognitive distractions from speaking and listening activities affect ERP-BCI performance.<i>Approach.</i>The experiment employs a dual-task paradigm where participants control a smart light using visual ERP-BCIs while simultaneously conducting speaking or listening tasks.<i>Main results.</i>The findings reveal that speaking notably degrades BCI accuracy and the amplitude of ERP components, while increases the latency variability of ERP components and occipital alpha power. In contrast, listening and simple syllable repetition tasks have a lesser impact on these variables. The results suggest that speaking activity significantly distracts visual attentional processes critical for BCI operation<i>Significance</i>. This study highlights the need to take distractions by daily conversation into account of the design and implementation of ERP-BCIs.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142047662","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Utilizing diffusion tensor imaging as an image biomarker in exploring the therapeutic efficacy of forniceal deep brain stimulation in a mice model of Alzheimer's disease. 利用弥散张量成像作为图像生物标志物,探索在阿尔茨海默病小鼠模型中使用穹窿深部脑刺激疗法的疗效。
Journal of neural engineering Pub Date : 2024-09-04 DOI: 10.1088/1741-2552/ad7322
You-Yin Chen, Chih-Ju Chang, Yao-Wen Liang, Hsin-Yi Tseng, Ssu-Ju Li, Ching-Wen Chang, Yen-Ting Wu, Huai-Hsuan Shao, Po-Chun Chen, Ming-Liang Lai, Wen-Chun Deng, RuSiou Hsu, Yu-Chun Lo
{"title":"Utilizing diffusion tensor imaging as an image biomarker in exploring the therapeutic efficacy of forniceal deep brain stimulation in a mice model of Alzheimer's disease.","authors":"You-Yin Chen, Chih-Ju Chang, Yao-Wen Liang, Hsin-Yi Tseng, Ssu-Ju Li, Ching-Wen Chang, Yen-Ting Wu, Huai-Hsuan Shao, Po-Chun Chen, Ming-Liang Lai, Wen-Chun Deng, RuSiou Hsu, Yu-Chun Lo","doi":"10.1088/1741-2552/ad7322","DOIUrl":"10.1088/1741-2552/ad7322","url":null,"abstract":"<p><p><i>Objective.</i>With prolonged life expectancy, the incidence of memory deficits, especially in Alzheimer's disease (AD), has increased. Although multiple treatments have been evaluated, no promising treatment has been found to date. Deep brain stimulation (DBS) of the fornix area was explored as a possible treatment because the fornix is intimately connected to memory-related areas that are vulnerable in AD; however, a proper imaging biomarker for assessing the therapeutic efficiency of forniceal DBS in AD has not been established.<i>Approach.</i>This study assessed the efficacy and safety of DBS by estimating the optimal intersection volume between the volume of tissue activated and the fornix. Utilizing a gold-electroplating process, the microelectrode's surface area on the neural probe was increased, enhancing charge transfer performance within potential water window limits. Bilateral fornix implantation was conducted in triple-transgenic AD mice (3 × Tg-AD) and wild-type mice (strain: B6129SF1/J), with forniceal DBS administered exclusively to 3 × Tg-AD mice in the DBS-on group. Behavioral tasks, diffusion tensor imaging (DTI), and immunohistochemistry (IHC) were performed in all mice to assess the therapeutic efficacy of forniceal DBS.<i>Main results.</i>The results illustrated that memory deficits and increased anxiety-like behavior in 3 × Tg-AD mice were rescued by forniceal DBS. Furthermore, forniceal DBS positively altered DTI indices, such as increasing fractional anisotropy (FA) and decreasing mean diffusivity (MD), together with reducing microglial cell and astrocyte counts, suggesting a potential causal relationship between revised FA/MD and reduced cell counts in the anterior cingulate cortex, hippocampus, fornix, amygdala, and entorhinal cortex of 3 × Tg-AD mice following forniceal DBS.<i>Significance.</i>The efficacy of forniceal DBS in AD can be indicated by alterations in DTI-based biomarkers reflecting the decreased activation of glial cells, suggesting reduced neural inflammation as evidenced by improvements in memory and anxiety-like behavior.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":"21 5","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142127767","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Motor imagery with cues in virtual reality, audio and screen. 通过虚拟现实、音频和屏幕的提示进行运动想象。
Journal of neural engineering Pub Date : 2024-09-04 DOI: 10.1088/1741-2552/ad775e
Sonal Santosh Baberwal, Luz Alejandra Magre, K R Sanjaya D Gunawardhana, Michael Parkinson, Tomas Ward, Shirley Coyle
{"title":"Motor imagery with cues in virtual reality, audio and screen.","authors":"Sonal Santosh Baberwal, Luz Alejandra Magre, K R Sanjaya D Gunawardhana, Michael Parkinson, Tomas Ward, Shirley Coyle","doi":"10.1088/1741-2552/ad775e","DOIUrl":"https://doi.org/10.1088/1741-2552/ad775e","url":null,"abstract":"<p><strong>Objective: </strong>Training plays a significant role in motor imagery (MI), particularly in applications such as Motor Imagery-based Brain-Computer Interface (MIBCI) systems and rehabilitation systems. Previous studies have investigated the intricate relationship between cues and MI signals. However, the medium of presentation still remains an emerging area to be explored, as possible factors to enhance Motor Imagery signals..&#xD;Approach: We hypothesise that the medium used for cue presentation can significantly influence both performance and training outcomes in MI tasks. To test this hypothesis, we designed and executed an experiment implementing no- feedback MI. Our investigation focused on three distinct cue presentation mediums -audio, screen, and virtual reality(VR) headsets-all of which have potential implications for BCI use in the Activities of Daily Lives.&#xD;Main Results: The results of our study uncovered notable variations in MI signals depending on the medium of cue presentation, where the analysis is based on 3 EEG channels. To substantiate our findings, we employed a comprehensive approach, utilizing various evaluation metrics including Event- Related Synchronisation(ERS)/Desynchronisation(ERD), Feature Extraction (using Recursive Feature Elimination (RFE)), Machine Learning methodologies (using Ensemble Learning), and participant Questionnaires. All the approaches signify that Motor Imagery signals are enhanced when presented in VR, followed by audio, and lastly screen. Applying a Machine Learning approach across all subjects, the mean cross-validation accuracy (Mean ± Std. Error) was 69.24 ± 3.12, 68.69 ± 3.3 and 66.1±2.59 when for the VR, audio-based, and screen-based instructions respectively.&#xD;Significance: This multi-faceted exploration provides evidence to inform MI- based BCI design and advocates the incorporation of different mediums into the design of MIBCI systems, experimental setups, and user studies. The influence of the medium used for cue presentation may be applied to develop more effective and inclusive MI applications in the realm of human-computer interaction and rehabilitation.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142134933","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Mechanical and thermal stimulation for studying the somatosensory system: a review on devices and methods. 用于研究躯体感觉系统的机械和热刺激:设备和方法综述。
Journal of neural engineering Pub Date : 2024-09-03 DOI: 10.1088/1741-2552/ad716d
M Sperduti, N L Tagliamonte, F Taffoni, E Guglielmelli, L Zollo
{"title":"Mechanical and thermal stimulation for studying the somatosensory system: a review on devices and methods.","authors":"M Sperduti, N L Tagliamonte, F Taffoni, E Guglielmelli, L Zollo","doi":"10.1088/1741-2552/ad716d","DOIUrl":"10.1088/1741-2552/ad716d","url":null,"abstract":"<p><p>The somatosensory system is widely studied to understand its functioning mechanisms. Multiple tests, based on different devices and methods, have been performed not only on humans but also on animals and<i>ex-vivo</i>models. Depending on the nature of the sample under analysis and on the scientific aims of interest, several solutions for experimental stimulation and for investigations on sensation or pain have been adopted. In this review paper, an overview of the available devices and methods has been reported, also analyzing the representative values adopted during literature experiments. Among the various physical stimulations used to study the somatosensory system, we focused only on mechanical and thermal ones. Based on the analysis of their main features and on literature studies, we pointed out the most suitable solution for humans, rodents, and<i>ex-vivo</i>models and investigation aims (sensation and pain).</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142010142","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A simplified adversarial architecture for cross-subject silent speech recognition using electromyography. 利用肌电图进行跨主体无声语音识别的简化对抗架构
Journal of neural engineering Pub Date : 2024-09-03 DOI: 10.1088/1741-2552/ad7321
Qiang Cui, Xingyu Zhang, Yakun Zhang, Changyan Zheng, Liang Xie, Ye Yan, Edmond Q Wu, Erwei Yin
{"title":"A simplified adversarial architecture for cross-subject silent speech recognition using electromyography.","authors":"Qiang Cui, Xingyu Zhang, Yakun Zhang, Changyan Zheng, Liang Xie, Ye Yan, Edmond Q Wu, Erwei Yin","doi":"10.1088/1741-2552/ad7321","DOIUrl":"10.1088/1741-2552/ad7321","url":null,"abstract":"<p><p><i>Objective</i>. The decline in the performance of electromyography (EMG)-based silent speech recognition is widely attributed to disparities in speech patterns, articulation habits, and individual physiology among speakers. Feature alignment by learning a discriminative network that resolves domain offsets across speakers is an effective method to address this problem. The prevailing adversarial network with a branching discriminator specializing in domain discrimination renders insufficiently direct contribution to categorical predictions of the classifier.<i>Approach</i>. To this end, we propose a simplified discrepancy-based adversarial network with a streamlined end-to-end structure for EMG-based cross-subject silent speech recognition. Highly aligned features across subjects are obtained by introducing a Nuclear-norm Wasserstein discrepancy metric on the back end of the classification network, which could be utilized for both classification and domain discrimination. Given the low-level and implicitly noisy nature of myoelectric signals, we devise a cascaded adaptive rectification network as the front-end feature extraction network, adaptively reshaping the intermediate feature map with automatically learnable channel-wise thresholds. The resulting features effectively filter out domain-specific information between subjects while retaining domain-invariant features critical for cross-subject recognition.<i>Main results</i>. A series of sentence-level classification experiments with 100 Chinese sentences demonstrate the efficacy of our method, achieving an average accuracy of 89.46% tested on 40 new subjects by training with data from 60 subjects. Especially, our method achieves a remarkable 10.07% improvement compared to the state-of-the-art model when tested on 10 new subjects with 20 subjects employed for training, surpassing its result even with three times training subjects.<i>Significance</i>. Our study demonstrates an improved classification performance of the proposed adversarial architecture using cross-subject myoelectric signals, providing a promising prospect for EMG-based speech interactive application.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142047658","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Predicting cognitive load with EEG using Riemannian geometry-based features. 利用基于黎曼几何特征的脑电图预测认知负荷。
Journal of neural engineering Pub Date : 2024-09-03 DOI: 10.1088/1741-2552/ad680b
Iris Kremer, Wissam Halimi, Andy Walshe, Moran Cerf, Pablo Mainar
{"title":"Predicting cognitive load with EEG using Riemannian geometry-based features.","authors":"Iris Kremer, Wissam Halimi, Andy Walshe, Moran Cerf, Pablo Mainar","doi":"10.1088/1741-2552/ad680b","DOIUrl":"10.1088/1741-2552/ad680b","url":null,"abstract":"<p><p><i>Objective</i>. We show that electroencephalography (EEG)-based cognitive load (CL) prediction using Riemannian geometry features outperforms existing models. The performance is estimated using Riemannian Procrustes Analysis (RPA) with a test set of subjects unseen during training.<i>Approach</i>. Performance is evaluated by using the Minimum Distance to Riemannian Mean model trained on CL classification. The baseline performance is established using spatial covariance matrices of the signal as features. Various novel features are explored and analyzed in depth, including spatial covariance and correlation matrices computed on the EEG signal and its first-order derivative. Furthermore, each RPA step effect on the performance is investigated, and the generalization performance of RPA is compared against a few different generalization methods.<i>Main results</i>. Performances are greatly improved by using the spatial covariance matrix of the first-order derivative of the signal as features. Furthermore, this work highlights both the importance and efficiency of RPA for CL prediction: it achieves good generalizability with little amounts of calibration data and largely outperforms all the comparison methods.<i>Significance</i>. CL prediction using RPA for generalizability across subjects is an approach worth exploring further, especially for real-world applications where calibration time is limited. Furthermore, the feature exploration uncovers new, promising features that can be used and further experimented within any Riemannian geometry setting.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141768377","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Emotion recognition of EEG signals based on contrastive learning graph convolutional model. 基于对比学习图卷积模型的脑电信号情感识别。
Journal of neural engineering Pub Date : 2024-08-29 DOI: 10.1088/1741-2552/ad7060
Yiling Zhang, Yuan Liao, Wei Chen, Xiruo Zhang, Liya Huang
{"title":"Emotion recognition of EEG signals based on contrastive learning graph convolutional model.","authors":"Yiling Zhang, Yuan Liao, Wei Chen, Xiruo Zhang, Liya Huang","doi":"10.1088/1741-2552/ad7060","DOIUrl":"10.1088/1741-2552/ad7060","url":null,"abstract":"<p><p><i>Objective.</i>Electroencephalogram (EEG) signals offer invaluable insights into the complexities of emotion generation within the brain. Yet, the variability in EEG signals across individuals presents a formidable obstacle for empirical implementations. Our research addresses these challenges innovatively, focusing on the commonalities within distinct subjects' EEG data.<i>Approach.</i>We introduce a novel approach named Contrastive Learning Graph Convolutional Network (CLGCN). This method captures the distinctive features and crucial channel nodes related to individuals' emotional states. Specifically, CLGCN merges the dual benefits of CL's synchronous multisubject data learning and the GCN's proficiency in deciphering brain connectivity matrices. Understanding multifaceted brain functions and their information interchange processes is realized as CLGCN generates a standardized brain network learning matrix during a dataset's learning process.<i>Main results.</i>Our model underwent rigorous testing on the Database for Emotion Analysis using Physiological Signals (DEAP) and SEED datasets. In the five-fold cross-validation used for dependent subject experimental setting, it achieved an accuracy of 97.13% on the DEAP dataset and surpassed 99% on the SEED and SEED_IV datasets. In the incremental learning experiments with the SEED dataset, merely 5% of the data was sufficient to fine-tune the model, resulting in an accuracy of 92.8% for the new subject. These findings validate the model's efficacy.<i>Significance.</i>This work combines CL with GCN, improving the accuracy of decoding emotional states from EEG signals and offering valuable insights into uncovering the underlying mechanisms of emotional processes in the brain.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141997105","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Epileptic network identification: insights from dynamic mode decomposition of sEEG data. 癫痫网络识别:动态模式分解 sEEG 数据的启示。
Journal of neural engineering Pub Date : 2024-08-29 DOI: 10.1088/1741-2552/ad705f
Alejandro Nieto Ramos, Balu Krishnan, Andreas V Alexopoulos, William Bingaman, Imad Najm, Juan C Bulacio, Demitre Serletis
{"title":"Epileptic network identification: insights from dynamic mode decomposition of sEEG data.","authors":"Alejandro Nieto Ramos, Balu Krishnan, Andreas V Alexopoulos, William Bingaman, Imad Najm, Juan C Bulacio, Demitre Serletis","doi":"10.1088/1741-2552/ad705f","DOIUrl":"10.1088/1741-2552/ad705f","url":null,"abstract":"<p><p><i>Objective.</i>For medically-refractory epilepsy patients, stereoelectroencephalography (sEEG) is a surgical method using intracranial electrode recordings to identify brain networks participating in early seizure organization and propagation (i.e. the epileptogenic zone, EZ). If identified, surgical EZ treatment via resection, ablation or neuromodulation can lead to seizure-freedom. To date, quantification of sEEG data, including its visualization and interpretation, remains a clinical and computational challenge. Given elusiveness of physical laws or governing equations modelling complex brain dynamics, data science offers unique insight into identifying unknown patterns within high-dimensional sEEG data. We apply here an unsupervised data-driven algorithm, dynamic mode decomposition (DMD), to sEEG recordings from five focal epilepsy patients (three with temporal lobe, and two with cingulate epilepsy), who underwent subsequent resective or ablative surgery and became seizure free.<i>Approach.</i>DMD obtains a linear approximation of nonlinear data dynamics, generating coherent structures ('modes') defining important signal features, used to extract frequencies, growth rates and spatial structures. DMD was adapted to produce dynamic modal maps (DMMs) across frequency sub-bands, capturing onset and evolution of epileptiform dynamics in sEEG data. Additionally, we developed a static estimate of EZ-localized electrode contacts, termed the higher-frequency mode-based norm index (MNI). DMM and MNI maps for representative patient seizures were validated against clinical sEEG results and seizure-free outcomes following surgery.<i>Main results.</i>DMD was most informative at higher frequencies, i.e. gamma (including high-gamma) and beta range, successfully identifying EZ contacts. Combined interpretation of DMM/MNI plots best identified spatiotemporal evolution of mode-specific network changes, with strong concordance to sEEG results and outcomes across all five patients. The method identified network attenuation in other contacts not implicated in the EZ.<i>Significance.</i>This is the first application of DMD to sEEG data analysis, supporting integration of neuroengineering, mathematical and machine learning methods into traditional workflows for sEEG review and epilepsy surgical decision-making.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141997106","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Neural subspaces of imagined movements in parietal cortex remain stable over several years in humans. 人类顶叶皮层中想象运动的神经子空间在数年内保持稳定。
Journal of neural engineering Pub Date : 2024-08-28 DOI: 10.1088/1741-2552/ad6e19
L Bashford, I A Rosenthal, S Kellis, D Bjånes, K Pejsa, B W Brunton, R A Andersen
{"title":"Neural subspaces of imagined movements in parietal cortex remain stable over several years in humans.","authors":"L Bashford, I A Rosenthal, S Kellis, D Bjånes, K Pejsa, B W Brunton, R A Andersen","doi":"10.1088/1741-2552/ad6e19","DOIUrl":"10.1088/1741-2552/ad6e19","url":null,"abstract":"<p><p><i>Objective.</i>A crucial goal in brain-machine interfacing is the long-term stability of neural decoding performance, ideally without regular retraining. Long-term stability has only been previously demonstrated in non-human primate experiments and only in primary sensorimotor cortices. Here we extend previous methods to determine long-term stability in humans by identifying and aligning low-dimensional structures in neural data.<i>Approach.</i>Over a period of 1106 and 871 d respectively, two participants completed an imagined center-out reaching task. The longitudinal accuracy between all day pairs was assessed by latent subspace alignment using principal components analysis and canonical correlations analysis of multi-unit intracortical recordings in different brain regions (Brodmann Area 5, Anterior Intraparietal Area and the junction of the postcentral and intraparietal sulcus).<i>Main results.</i>We show the long-term stable representation of neural activity in subspaces of intracortical recordings from higher-order association areas in humans.<i>Significance.</i>These results can be practically applied to significantly expand the longevity and generalizability of brain-computer interfaces.Clinical TrialsNCT01849822, NCT01958086, NCT01964261.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11350602/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141972494","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Iterative alignment discovery of speech-associated neural activity. 语音相关神经活动的迭代排列发现。
Journal of neural engineering Pub Date : 2024-08-28 DOI: 10.1088/1741-2552/ad663c
Qinwan Rabbani, Samyak Shah, Griffin Milsap, Matthew Fifer, Hynek Hermansky, Nathan Crone
{"title":"Iterative alignment discovery of speech-associated neural activity.","authors":"Qinwan Rabbani, Samyak Shah, Griffin Milsap, Matthew Fifer, Hynek Hermansky, Nathan Crone","doi":"10.1088/1741-2552/ad663c","DOIUrl":"10.1088/1741-2552/ad663c","url":null,"abstract":"<p><p><i>Objective</i>. Brain-computer interfaces (BCIs) have the potential to preserve or restore speech in patients with neurological disorders that weaken the muscles involved in speech production. However, successful training of low-latency speech synthesis and recognition models requires alignment of neural activity with intended phonetic or acoustic output with high temporal precision. This is particularly challenging in patients who cannot produce audible speech, as ground truth with which to pinpoint neural activity synchronized with speech is not available.<i>Approach</i>. In this study, we present a new iterative algorithm for neural voice activity detection (nVAD) called iterative alignment discovery dynamic time warping (IAD-DTW) that integrates DTW into the loss function of a deep neural network (DNN). The algorithm is designed to discover the alignment between a patient's electrocorticographic (ECoG) neural responses and their attempts to speak during collection of data for training BCI decoders for speech synthesis and recognition.<i>Main results</i>. To demonstrate the effectiveness of the algorithm, we tested its accuracy in predicting the onset and duration of acoustic signals produced by able-bodied patients with intact speech undergoing short-term diagnostic ECoG recordings for epilepsy surgery. We simulated a lack of ground truth by randomly perturbing the temporal correspondence between neural activity and an initial single estimate for all speech onsets and durations. We examined the model's ability to overcome these perturbations to estimate ground truth. IAD-DTW showed no notable degradation (<1% absolute decrease in accuracy) in performance in these simulations, even in the case of maximal misalignments between speech and silence.<i>Significance</i>. IAD-DTW is computationally inexpensive and can be easily integrated into existing DNN-based nVAD approaches, as it pertains only to the final loss computation. This approach makes it possible to train speech BCI algorithms using ECoG data from patients who are unable to produce audible speech, including those with Locked-In Syndrome.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":"21 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11351572/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142083006","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信