Frontiers in Computational Neuroscience最新文献

筛选
英文 中文
An enhanced pattern detection and segmentation of brain tumors in MRI images using deep learning technique 利用深度学习技术增强核磁共振成像图像中脑肿瘤的模式检测和分割
IF 3.2 4区 医学
Frontiers in Computational Neuroscience Pub Date : 2024-06-26 DOI: 10.3389/fncom.2024.1418280
Lubna Kiran, Asim Zeb, Qazi Nida Ur Rehman, Taj Rahman, Muhammad Shehzad Khan, Shafiq Ahmad, Muhammad Irfan, Muhammad Naeem, Shamsul Huda, Haitham Mahmoud
{"title":"An enhanced pattern detection and segmentation of brain tumors in MRI images using deep learning technique","authors":"Lubna Kiran, Asim Zeb, Qazi Nida Ur Rehman, Taj Rahman, Muhammad Shehzad Khan, Shafiq Ahmad, Muhammad Irfan, Muhammad Naeem, Shamsul Huda, Haitham Mahmoud","doi":"10.3389/fncom.2024.1418280","DOIUrl":"https://doi.org/10.3389/fncom.2024.1418280","url":null,"abstract":"Neuroscience is a swiftly progressing discipline that aims to unravel the intricate workings of the human brain and mind. Brain tumors, ranging from non-cancerous to malignant forms, pose a significant diagnostic challenge due to the presence of more than 100 distinct types. Effective treatment hinges on the precise detection and segmentation of these tumors early. We introduce a cutting-edge deep-learning approach employing a binary convolutional neural network (BCNN) to address this. This method is employed to segment the 10 most prevalent brain tumor types and is a significant improvement over current models restricted to only segmenting four types. Our methodology begins with acquiring MRI images, followed by a detailed preprocessing stage where images undergo binary conversion using an adaptive thresholding method and morphological operations. This prepares the data for the next step, which is segmentation. The segmentation identifies the tumor type and classifies it according to its grade (Grade I to Grade IV) and differentiates it from healthy brain tissue. We also curated a unique dataset comprising 6,600 brain MRI images specifically for this study. The overall performance achieved by our proposed model is 99.36%. The effectiveness of our model is underscored by its remarkable performance metrics, achieving 99.40% accuracy, 99.32% precision, 99.45% recall, and a 99.28% F-Measure in segmentation tasks.","PeriodicalId":12363,"journal":{"name":"Frontiers in Computational Neuroscience","volume":"91 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141508684","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Frontiers | Purkinje cell models: past, present and future 前沿|浦肯野细胞模型:过去、现在和未来
IF 3.2 4区 医学
Frontiers in Computational Neuroscience Pub Date : 2024-06-24 DOI: 10.3389/fncom.2024.1426653
Elías Mateo Fernández Santoro, Arun Karim, Pascal Warnaar, Chris I. De Zeeuw, Aleksandra Badura, Mario Negrello
{"title":"Frontiers | Purkinje cell models: past, present and future","authors":"Elías Mateo Fernández Santoro, Arun Karim, Pascal Warnaar, Chris I. De Zeeuw, Aleksandra Badura, Mario Negrello","doi":"10.3389/fncom.2024.1426653","DOIUrl":"https://doi.org/10.3389/fncom.2024.1426653","url":null,"abstract":"The investigation of the dynamics of Purkinje cell (PC) activity is crucial to unravel the role of the cerebellum in motor control, learning and cognitive processes. Within the cerebellar cortex (CC), these neurons receive all the incoming sensory and motor information, transform it and generate the entire cerebellar output. The relatively homogenous and repetitive structure of the CC, common to all vertebrate species, suggests a single computation mechanism shared across all PCs. While PC models have been developed since the 70′s, a comprehensive review of contemporary models is currently lacking. Here, we provide an overview of PC models, ranging from the ones focused on single cell intracellular PC dynamics, through complex models which include synaptic and extrasynaptic inputs. We review how PC models can reproduce physiological activity of the neuron, including firing patterns, current and multistable dynamics, plateau potentials, calcium signaling, intrinsic and synaptic plasticity and input/output computations. We consider models focusing both on somatic and on dendritic computations. Our review provides a critical performance analysis of PC models with respect to known physiological data. We expect our synthesis to be useful in guiding future development of computational models that capture real-life PC dynamics in the context of cerebellar computations.","PeriodicalId":12363,"journal":{"name":"Frontiers in Computational Neuroscience","volume":"21 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141568416","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Hybrid deep spatial and statistical feature fusion for accurate MRI brain tumor classification 混合深度空间和统计特征融合,实现精确的磁共振成像脑肿瘤分类
IF 3.2 4区 医学
Frontiers in Computational Neuroscience Pub Date : 2024-06-24 DOI: 10.3389/fncom.2024.1423051
Saeed Iqbal, Adnan N. Qureshi, Musaed Alhussein, Khursheed Aurangzeb, Imran Arshad Choudhry, Muhammad Shahid Anwar
{"title":"Hybrid deep spatial and statistical feature fusion for accurate MRI brain tumor classification","authors":"Saeed Iqbal, Adnan N. Qureshi, Musaed Alhussein, Khursheed Aurangzeb, Imran Arshad Choudhry, Muhammad Shahid Anwar","doi":"10.3389/fncom.2024.1423051","DOIUrl":"https://doi.org/10.3389/fncom.2024.1423051","url":null,"abstract":"The classification of medical images is crucial in the biomedical field, and despite attempts to address the issue, significant challenges persist. To effectively categorize medical images, collecting and integrating statistical information that accurately describes the image is essential. This study proposes a unique method for feature extraction that combines deep spatial characteristics with handmade statistical features. The approach involves extracting statistical radiomics features using advanced techniques, followed by a novel handcrafted feature fusion method inspired by the ResNet deep learning model. A new feature fusion framework (FusionNet) is then used to reduce image dimensionality and simplify computation. The proposed approach is tested on MRI images of brain tumors from the BraTS dataset, and the results show that it outperforms existing methods regarding classification accuracy. The study presents three models, including a handcrafted-based model and two CNN models, which completed the binary classification task. The recommended hybrid approach achieved a high F1 score of 96.12 ± 0.41, precision of 97.77 ± 0.32, and accuracy of 97.53 ± 0.24, indicating that it has the potential to serve as a valuable tool for pathologists.","PeriodicalId":12363,"journal":{"name":"Frontiers in Computational Neuroscience","volume":"8 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141508685","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Translational symmetry in convolutions with localized kernels causes an implicit bias toward high frequency adversarial examples 具有局部核的卷积中的平移对称性会导致对高频对抗性示例的隐含偏见
IF 3.2 4区 医学
Frontiers in Computational Neuroscience Pub Date : 2024-06-20 DOI: 10.3389/fncom.2024.1387077
Josue O. Caro, Yilong Ju, Ryan Pyle, Sourav Dey, Wieland Brendel, Fabio Anselmi, Ankit B. Patel
{"title":"Translational symmetry in convolutions with localized kernels causes an implicit bias toward high frequency adversarial examples","authors":"Josue O. Caro, Yilong Ju, Ryan Pyle, Sourav Dey, Wieland Brendel, Fabio Anselmi, Ankit B. Patel","doi":"10.3389/fncom.2024.1387077","DOIUrl":"https://doi.org/10.3389/fncom.2024.1387077","url":null,"abstract":"Adversarial attacks are still a significant challenge for neural networks. Recent efforts have shown that adversarial perturbations typically contain high-frequency features, but the root cause of this phenomenon remains unknown. Inspired by theoretical work on linear convolutional models, we hypothesize that <jats:italic>translational symmetry in convolutional operations</jats:italic> together with <jats:italic>localized kernels implicitly bias the learning of high-frequency features</jats:italic>, and that this is one of the main causes of <jats:italic>high frequency adversarial examples</jats:italic>. To test this hypothesis, we analyzed the impact of different choices of linear and <jats:italic>non-linear</jats:italic> architectures on the implicit bias of the learned features and adversarial perturbations, in spatial and frequency domains. We find that, independently of the training dataset, convolutional operations have higher frequency adversarial attacks compared to other architectural parameterizations, and that this phenomenon is exacerbated with stronger locality of the kernel (kernel size) end depth of the model. The explanation for the kernel size dependence involves the Fourier Uncertainty Principle: a spatially-limited filter (local kernel in the space domain) cannot also be frequency-limited (local in the frequency domain). Using larger convolution kernel sizes or avoiding convolutions (e.g., by using Vision Transformers or MLP-style architectures) significantly reduces this high-frequency bias. Looking forward, our work strongly suggests that understanding and controlling the implicit bias of architectures will be essential for achieving adversarial robustness.","PeriodicalId":12363,"journal":{"name":"Frontiers in Computational Neuroscience","volume":"86 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141508686","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A novel multi-feature fusion attention neural network for the recognition of epileptic EEG signals. 用于识别癫痫脑电信号的新型多特征融合注意力神经网络。
IF 2.1 4区 医学
Frontiers in Computational Neuroscience Pub Date : 2024-06-19 eCollection Date: 2024-01-01 DOI: 10.3389/fncom.2024.1393122
Congshan Sun, Cong Xu, Hongwei Li, Hongjian Bo, Lin Ma, Haifeng Li
{"title":"A novel multi-feature fusion attention neural network for the recognition of epileptic EEG signals.","authors":"Congshan Sun, Cong Xu, Hongwei Li, Hongjian Bo, Lin Ma, Haifeng Li","doi":"10.3389/fncom.2024.1393122","DOIUrl":"10.3389/fncom.2024.1393122","url":null,"abstract":"<p><p>Epilepsy is a common chronic brain disorder. Detecting epilepsy by observing electroencephalography (EEG) is the main method neurologists use, but this method is time-consuming. EEG signals are non-stationary, nonlinear, and often highly noisy, so it remains challenging to recognize epileptic EEG signals more accurately and automatically. This paper proposes a novel classification system of epileptic EEG signals for single-channel EEG based on the attention network that integrates time-frequency and nonlinear dynamic features. The proposed system has three novel modules. The first module constructs the Hilbert spectrum (HS) with high time-frequency resolution into a two-channel parallel convolutional network. The time-frequency features are fully extracted by complementing the high-dimensional features of the two branches. The second module constructs a grayscale recurrence plot (GRP) that contains more nonlinear dynamic features than traditional RP, fed into the residual-connected convolution module for effective learning of nonlinear dynamic features. The third module is the feature fusion module based on a self-attention mechanism to assign optimal weights to different types of features and further enhance the information extraction capability of the system. Therefore, the system is named HG-SANet. The results of several classification tasks on the Bonn EEG database and the Bern-Barcelona EEG database show that the HG-SANet can effectively capture the contribution degree of the extracted features from different domains, significantly enhance the expression ability of the model, and improve the accuracy of the recognition of epileptic EEG signals. The HG-SANet can improve the diagnosis and treatment efficiency of epilepsy and has broad application prospects in the fields of brain disease diagnosis.</p>","PeriodicalId":12363,"journal":{"name":"Frontiers in Computational Neuroscience","volume":"18 ","pages":"1393122"},"PeriodicalIF":2.1,"publicationDate":"2024-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11219577/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141497603","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Residual and bidirectional LSTM for epileptic seizure detection. 用于癫痫发作检测的残差和双向 LSTM。
IF 2.1 4区 医学
Frontiers in Computational Neuroscience Pub Date : 2024-06-17 eCollection Date: 2024-01-01 DOI: 10.3389/fncom.2024.1415967
Wei Zhao, Wen-Feng Wang, Lalit Mohan Patnaik, Bao-Can Zhang, Su-Jun Weng, Shi-Xiao Xiao, De-Zhi Wei, Hai-Feng Zhou
{"title":"Residual and bidirectional LSTM for epileptic seizure detection.","authors":"Wei Zhao, Wen-Feng Wang, Lalit Mohan Patnaik, Bao-Can Zhang, Su-Jun Weng, Shi-Xiao Xiao, De-Zhi Wei, Hai-Feng Zhou","doi":"10.3389/fncom.2024.1415967","DOIUrl":"10.3389/fncom.2024.1415967","url":null,"abstract":"<p><p>Electroencephalogram (EEG) plays a pivotal role in the detection and analysis of epileptic seizures, which affects over 70 million people in the world. Nonetheless, the visual interpretation of EEG signals for epilepsy detection is laborious and time-consuming. To tackle this open challenge, we introduce a straightforward yet efficient hybrid deep learning approach, named ResBiLSTM, for detecting epileptic seizures using EEG signals. Firstly, a one-dimensional residual neural network (ResNet) is tailored to adeptly extract the local spatial features of EEG signals. Subsequently, the acquired features are input into a bidirectional long short-term memory (BiLSTM) layer to model temporal dependencies. These output features are further processed through two fully connected layers to achieve the final epileptic seizure detection. The performance of ResBiLSTM is assessed on the epileptic seizure datasets provided by the University of Bonn and Temple University Hospital (TUH). The ResBiLSTM model achieves epileptic seizure detection accuracy rates of 98.88-100% in binary and ternary classifications on the Bonn dataset. Experimental outcomes for seizure recognition across seven epilepsy seizure types on the TUH seizure corpus (TUSZ) dataset indicate that the ResBiLSTM model attains a classification accuracy of 95.03% and a weighted F1 score of 95.03% with 10-fold cross-validation. These findings illustrate that ResBiLSTM outperforms several recent deep learning state-of-the-art approaches.</p>","PeriodicalId":12363,"journal":{"name":"Frontiers in Computational Neuroscience","volume":"18 ","pages":"1415967"},"PeriodicalIF":2.1,"publicationDate":"2024-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11215953/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141476309","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Synergy quality assessment of muscle modules for determining learning performance using a realistic musculoskeletal model 利用逼真的肌肉骨骼模型对肌肉模块进行协同质量评估,以确定学习成绩
IF 3.2 4区 医学
Frontiers in Computational Neuroscience Pub Date : 2024-05-30 DOI: 10.3389/fncom.2024.1355855
Akito Fukunishi, Kyo Kutsuzawa, Dai Owaki, Mitsuhiro Hayashibe
{"title":"Synergy quality assessment of muscle modules for determining learning performance using a realistic musculoskeletal model","authors":"Akito Fukunishi, Kyo Kutsuzawa, Dai Owaki, Mitsuhiro Hayashibe","doi":"10.3389/fncom.2024.1355855","DOIUrl":"https://doi.org/10.3389/fncom.2024.1355855","url":null,"abstract":"How our central nervous system efficiently controls our complex musculoskeletal system is still debated. The muscle synergy hypothesis is proposed to simplify this complex system by assuming the existence of functional neural modules that coordinate several muscles. Modularity based on muscle synergies can facilitate motor learning without compromising task performance. However, the effectiveness of modularity in motor control remains debated. This ambiguity can, in part, stem from overlooking that the performance of modularity depends on the mechanical aspects of modules of interest, such as the torque the modules exert. To address this issue, this study introduces two criteria to evaluate the quality of module sets based on commonly used performance metrics in motor learning studies: the accuracy of torque production and learning speed. One evaluates the regularity in the direction of mechanical torque the modules exert, while the other evaluates the evenness of its magnitude. For verification of our criteria, we simulated motor learning of torque production tasks in a realistic musculoskeletal system of the upper arm using feed-forward neural networks while changing the control conditions. We found that the proposed criteria successfully explain the tendency of learning performance in various control conditions. These result suggest that regularity in the direction of and evenness in magnitude of mechanical torque of utilized modules are significant factor for determining learning performance. Although the criteria were originally conceived for an error-based learning scheme, the approach to pursue which set of modules is better for motor control can have significant implications in other studies of modularity in general.","PeriodicalId":12363,"journal":{"name":"Frontiers in Computational Neuroscience","volume":"24 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141189235","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
DT-SCNN: dual-threshold spiking convolutional neural network with fewer operations and memory access for edge applications DT-SCNN:双阈值尖峰卷积神经网络,运算和内存访问更少,适用于边缘应用
IF 3.2 4区 医学
Frontiers in Computational Neuroscience Pub Date : 2024-05-30 DOI: 10.3389/fncom.2024.1418115
Fuming Lei, Xu Yang, Jian Liu, Runjiang Dou, Nanjian Wu
{"title":"DT-SCNN: dual-threshold spiking convolutional neural network with fewer operations and memory access for edge applications","authors":"Fuming Lei, Xu Yang, Jian Liu, Runjiang Dou, Nanjian Wu","doi":"10.3389/fncom.2024.1418115","DOIUrl":"https://doi.org/10.3389/fncom.2024.1418115","url":null,"abstract":"The spiking convolutional neural network (SCNN) is a kind of spiking neural network (SNN) with high accuracy for visual tasks and power efficiency on neuromorphic hardware, which is attractive for edge applications. However, it is challenging to implement SCNNs on resource-constrained edge devices because of the large number of convolutional operations and membrane potential (Vm) storage needed. Previous works have focused on timestep reduction, network pruning, and network quantization to realize SCNN implementation on edge devices. However, they overlooked similarities between spiking feature maps (SFmaps), which contain significant redundancy and cause unnecessary computation and storage. This work proposes a dual-threshold spiking convolutional neural network (DT-SCNN) to decrease the number of operations and memory access by utilizing similarities between SFmaps. The DT-SCNN employs dual firing thresholds to derive two similar SFmaps from one Vm map, reducing the number of convolutional operations and decreasing the volume of Vms and convolutional weights by half. We propose a variant spatio-temporal back propagation (STBP) training method with a two-stage strategy to train DT-SCNNs to decrease the inference timestep to 1. The experimental results show that the dual-thresholds mechanism achieves a 50% reduction in operations and data storage for the convolutional layers compared to conventional SCNNs while achieving not more than a 0.4% accuracy loss on the CIFAR10, MNIST, and Fashion MNIST datasets. Due to the lightweight network and single timestep inference, the DT-SCNN has the least number of operations compared to previous works, paving the way for low-latency and power-efficient edge applications.","PeriodicalId":12363,"journal":{"name":"Frontiers in Computational Neuroscience","volume":"15 10 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141189272","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Simulated dynamical transitions in a heterogeneous marmoset pFC cluster 模拟异构狨猴 pFC 集群的动态转变
IF 3.2 4区 医学
Frontiers in Computational Neuroscience Pub Date : 2024-05-28 DOI: 10.3389/fncom.2024.1398898
Bernard A. Pailthorpe
{"title":"Simulated dynamical transitions in a heterogeneous marmoset pFC cluster","authors":"Bernard A. Pailthorpe","doi":"10.3389/fncom.2024.1398898","DOIUrl":"https://doi.org/10.3389/fncom.2024.1398898","url":null,"abstract":"Network analysis of the marmoset cortical connectivity data indicates a significant 3D cluster in and around the pre-frontal cortex. A multi-node, heterogeneous neural mass model of this six-node cluster was constructed. Its parameters were informed by available experimental and simulation data so that each neural mass oscillated in a characteristic frequency band. Nodes were connected with directed, weighted links derived from the marmoset structural connectivity data. Heterogeneity arose from the different link weights and model parameters for each node. Stimulation of the cluster with an incident pulse train modulated in the standard frequency bands induced a variety of dynamical state transitions that lasted in the range of 5–10 s, suggestive of timescales relevant to short-term memory. A short gamma burst rapidly reset the beta-induced transition. The theta-induced transition state showed a spontaneous, delayed reset to the resting state. An additional, continuous gamma wave stimulus induced a new beating oscillatory state. Longer or repeated gamma bursts were phase-aligned with the beta oscillation, delivering increasing energy input and causing shorter transition times. The relevance of these results to working memory is yet to be established, but they suggest interesting opportunities.","PeriodicalId":12363,"journal":{"name":"Frontiers in Computational Neuroscience","volume":"11 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141167607","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Information bottleneck-based Hebbian learning rule naturally ties working memory and synaptic updates 基于信息瓶颈的希比学习规则将工作记忆和突触更新自然地联系在一起
IF 3.2 4区 医学
Frontiers in Computational Neuroscience Pub Date : 2024-05-16 DOI: 10.3389/fncom.2024.1240348
Kyle Daruwalla, Mikko Lipasti
{"title":"Information bottleneck-based Hebbian learning rule naturally ties working memory and synaptic updates","authors":"Kyle Daruwalla, Mikko Lipasti","doi":"10.3389/fncom.2024.1240348","DOIUrl":"https://doi.org/10.3389/fncom.2024.1240348","url":null,"abstract":"Deep neural feedforward networks are effective models for a wide array of problems, but training and deploying such networks presents a significant energy cost. Spiking neural networks (SNNs), which are modeled after biologically realistic neurons, offer a potential solution when deployed correctly on neuromorphic computing hardware. Still, many applications train SNNs <jats:italic>offline</jats:italic>, and running network training directly on neuromorphic hardware is an ongoing research problem. The primary hurdle is that back-propagation, which makes training such artificial deep networks possible, is biologically implausible. Neuroscientists are uncertain about how the brain would propagate a precise error signal backward through a network of neurons. Recent progress addresses part of this question, e.g., the weight transport problem, but a complete solution remains intangible. In contrast, novel learning rules based on the information bottleneck (IB) train each layer of a network independently, circumventing the need to propagate errors across layers. Instead, propagation is implicit due the layers' feedforward connectivity. These rules take the form of a three-factor Hebbian update a global error signal modulates local synaptic updates within each layer. Unfortunately, the global signal for a given layer requires processing multiple samples concurrently, and the brain only sees a single sample at a time. We propose a new three-factor update rule where the global signal correctly captures information across samples via an auxiliary memory network. The auxiliary network can be trained <jats:italic>a priori</jats:italic> independently of the dataset being used with the primary network. We demonstrate comparable performance to baselines on image classification tasks. Interestingly, unlike back-propagation-like schemes where there is no link between learning and memory, our rule presents a direct connection between working memory and synaptic updates. To the best of our knowledge, this is the first rule to make this link explicit. We explore these implications in initial experiments examining the effect of memory capacity on learning performance. Moving forward, this work suggests an alternate view of learning where each layer balances memory-informed compression against task performance. This view naturally encompasses several key aspects of neural computation, including memory, efficiency, and locality.","PeriodicalId":12363,"journal":{"name":"Frontiers in Computational Neuroscience","volume":"33 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-05-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141058716","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信