Proceedings of the 7th Annual Neuro-inspired Computational Elements Workshop on - NICE '19最新文献

筛选
英文 中文
Synaptic plasticity in an artificial Hebbian network exhibiting continuous, unsupervised, rapid learning 人工Hebbian网络的突触可塑性表现出连续、无监督、快速的学习
J. C. Scott, Thomas F. Hayes, A. Ozcan, W. Wilcke
{"title":"Synaptic plasticity in an artificial Hebbian network exhibiting continuous, unsupervised, rapid learning","authors":"J. C. Scott, Thomas F. Hayes, A. Ozcan, W. Wilcke","doi":"10.1145/3320288.3320292","DOIUrl":"https://doi.org/10.1145/3320288.3320292","url":null,"abstract":"CAL (Context Aware Learning) is an artificial Hebbian network that simulates neurological structure and processes. Hebb's rules for synapse creation and weight update permit CAL to learn rapidly, from few examples, continuously and without supervision. This paper describes recent, neurologically inspired, modifications to the algorithms that lead to faster learning and to greater accuracy of prediction. The importance of plasticity, both structural and in synaptic weights, is illustrated. A mechanism to limit the plasticity of the most relevant synapses leads to minimal forgetting of previously learned sequences.","PeriodicalId":250150,"journal":{"name":"Proceedings of the 7th Annual Neuro-inspired Computational Elements Workshop on - NICE '19","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132485624","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Spatiotemporal Sequence Memory for Prediction using Deep Sparse Coding 基于深度稀疏编码的时空序列记忆预测
Edward Kim, E. Lawson, Keith Sullivan, Garrett T. Kenyon
{"title":"Spatiotemporal Sequence Memory for Prediction using Deep Sparse Coding","authors":"Edward Kim, E. Lawson, Keith Sullivan, Garrett T. Kenyon","doi":"10.1145/3320288.3320295","DOIUrl":"https://doi.org/10.1145/3320288.3320295","url":null,"abstract":"Our brains are, \"prediction machines\", where we are continuously comparing our surroundings with predictions from internal models generated by our brains. This is demonstrated by observing our basic low level sensory systems and how they predict environmental changes as we move through space and time. Indeed, even at higher cognitive levels, we are able to do prediction. We can predict how the laws of physics affect people, places, and things and even predict the end of someone's sentence. In our work, we sought to create an artificial model that is able to mimic early, low level biological predictive behavior in a computer vision system. Our predictive vision model uses spatiotemporal sequence memories learned from deep sparse coding. This model is implemented using a biologically inspired architecture: one that utilizes sequence memories, lateral inhibition, and top-down feedback in a generative framework. Our model learns the causes of the data in a completely unsupervised manner, by simply observing and learning about the world. Spatiotemporal features are learned by minimizing a reconstruction error convolved over space and time, and can subsequently be used for recognition, classification, and future video prediction. Our experiments show that we are able to accurately predict what will happen in the future; furthermore, we can use our predictions to detect anomalous, unexpected events in both synthetic and real video sequences.","PeriodicalId":250150,"journal":{"name":"Proceedings of the 7th Annual Neuro-inspired Computational Elements Workshop on - NICE '19","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133768480","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Shortest Path and Neighborhood Subgraph Extraction on a Spiking Memristive Neuromorphic Implementation 尖峰记忆神经形态实现的最短路径和邻域子图提取
Catherine D. Schuman, Kathleen E. Hamilton, T. Mintz, Md Musabbir Adnan, B. W. Ku, S. Lim, G. Rose
{"title":"Shortest Path and Neighborhood Subgraph Extraction on a Spiking Memristive Neuromorphic Implementation","authors":"Catherine D. Schuman, Kathleen E. Hamilton, T. Mintz, Md Musabbir Adnan, B. W. Ku, S. Lim, G. Rose","doi":"10.1145/3320288.3320290","DOIUrl":"https://doi.org/10.1145/3320288.3320290","url":null,"abstract":"Spiking neuromorphic computers (SNCs) are promising as a post Moore's law technology partly because of their potential for very low power computation. SNCs have primarily been demonstrated on machine learning and neural network applications, but they can also be used for applications beyond machine learning that can leverage SNC properties such as massively parallel computation and collocated processing and memory. Here, we demonstrate two graph problems (shortest path and neighborhood subgraph extraction) that can be solved using SNCs. We discuss the approach for mapping these applications to an SNC. We also estimate the performance of a memristive SNC for these applications on three real-world graphs.","PeriodicalId":250150,"journal":{"name":"Proceedings of the 7th Annual Neuro-inspired Computational Elements Workshop on - NICE '19","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124648797","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 25
Acquisition and Representation of Spatio-Temporal Signals in Polychronizing Spiking Neural Networks 多时变脉冲神经网络中时空信号的获取与表征
Felix Wang, William M. Severa, Fred Rothganger
{"title":"Acquisition and Representation of Spatio-Temporal Signals in Polychronizing Spiking Neural Networks","authors":"Felix Wang, William M. Severa, Fred Rothganger","doi":"10.1145/3320288.3320291","DOIUrl":"https://doi.org/10.1145/3320288.3320291","url":null,"abstract":"The ability of an intelligent agent to process complex signals such as those found in audio or video depends heavily on the nature of the internal representation of the relevant information. This work explores the mechanisms underlying this process by investigating theories inspired by the function of the neocortex. In particular, we focus on the phenomenon of polychronization, which describes the self-organization in a spiking neural network resulting from the interplay between network structure, driven spiking activity, and synaptic plasticity. What emerges are groups of neurons that exhibit reproducible, time-locked patterns of spiking activity. We propose that this representation is well suited to spatio-temporal signal processing, as it naturally resembles patterns found in real-world signals. We explore the computational properties of this approach and demonstrate the ability of a simple polychronizing network to learn different spatio-temporal signals.","PeriodicalId":250150,"journal":{"name":"Proceedings of the 7th Annual Neuro-inspired Computational Elements Workshop on - NICE '19","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125748689","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A Pulse-gated, Neural Implementation of the Backpropagation Algorithm 反向传播算法的脉冲门控神经实现
A. Sornborger, L. Tao, J. Snyder, Anatoly Zlotnik
{"title":"A Pulse-gated, Neural Implementation of the Backpropagation Algorithm","authors":"A. Sornborger, L. Tao, J. Snyder, Anatoly Zlotnik","doi":"10.1145/3320288.3320305","DOIUrl":"https://doi.org/10.1145/3320288.3320305","url":null,"abstract":"For some time, it has been thought that backpropagation of errors could not be implemented in biophysiologically realistic neural circuits. This belief was largely due to either 1) the need for symmetric replication of feedback and feedforward weights, 2) the need for differing forms of activation between forward and backward propagating sweeps, and 3) the need for a separate network for error gradient computation and storage, on the one hand, or 4) nonphysiological backpropagation through the forward propagating neurons themselves, on the other. In this paper, we present spiking neuron mechanisms for gating pulses to maintain short-term memories, controlling forward inference and backward error propagation, and coordinating learning of feedback and feedforward weights. These neural mechanisms are synthesized into a new backpropagation algorithm for neuromorphic circuits.","PeriodicalId":250150,"journal":{"name":"Proceedings of the 7th Annual Neuro-inspired Computational Elements Workshop on - NICE '19","volume":"70 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127348134","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Low-Power Deep Learning Inference using the SpiNNaker Neuromorphic Platform 基于SpiNNaker神经形态平台的低功耗深度学习推理
C. Vineyard, Ryan Dellana, J. Aimone, Fred Rothganger, William M. Severa
{"title":"Low-Power Deep Learning Inference using the SpiNNaker Neuromorphic Platform","authors":"C. Vineyard, Ryan Dellana, J. Aimone, Fred Rothganger, William M. Severa","doi":"10.1145/3320288.3320300","DOIUrl":"https://doi.org/10.1145/3320288.3320300","url":null,"abstract":"With the successes deep neural networks have achieved across a range of applications, researchers have been exploring computational architectures to more efficiently execute their operation. In addition to the prevalent role of graphics processing units (GPUs), many accelerator architectures have emerged. Neuromorphic is one such particular approach which takes inspiration from the brain to guide the computational principles of the architecture including varying levels of biological realism. In this paper we present results on using the SpiNNaker neuromorphic platform (48-chip model) for deep learning neural network inference. We use the Sandia National Laboratories developed Whetstone spiking deep learning library to train deep multi-layer perceptrons and convolutional neural networks suitable for the spiking substrate on the neural hardware architecture. By using the massively parallel nature of SpiNNaker, we are able to achieve, under certain network topologies, substantial network tiling and consequentially impressive inference throughput. Such high-throughput systems may have eventual application in remote sensing applications where large images need to be chipped, scanned, and processed quickly. Additionally, we explore complex topologies that push the limits of the SpiNNaker routing hardware and investigate how that impacts mapping software-implemented networks to on-hardware instantiations.","PeriodicalId":250150,"journal":{"name":"Proceedings of the 7th Annual Neuro-inspired Computational Elements Workshop on - NICE '19","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131472594","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Neuromorphic Computing for Autonomous Mobility in Natural Environments 自然环境下自主移动的神经形态计算
M. O. Khyam, D. Alexandre, Ananya Bhardwaj, Ruihao Wang, R. Müller
{"title":"Neuromorphic Computing for Autonomous Mobility in Natural Environments","authors":"M. O. Khyam, D. Alexandre, Ananya Bhardwaj, Ruihao Wang, R. Müller","doi":"10.1145/3320288.3320297","DOIUrl":"https://doi.org/10.1145/3320288.3320297","url":null,"abstract":"Certain bat species (horseshoe bats, Rhinolophidae) can navigate, avoid obstacles, and pursue prey in dense vegetation with exceptionally capable and efficient biosonar systems that operate in complete darkness and process biosonar echoes with brain masses as low as 0.2 g. Hence, they provide an opportunity to develop a novel integrated sensor system to enable autonomous navigation capabilities in small drones operating in complex natural environments. To explore this, we have investigated the biosonar system of Horseshoe bats from engineering, neuroscience, and signal processing perspectives, with the goal of developing a biomimetic system for small drones so that they can navigate in complex natural environments. To achieve this, a biomimetic sonar head capable of mimicking the peripheral dynamics seen in the biosonar of horseshoe bats has been used to collect a large data set of echoes (220,000) from natural forests. Then, these echoes were passed through a prototype brain-inspired signal processing chain that simulates the complete auditory process from input sound stimulus to the neural spike response. It should be possible to implement an integrated biomimetic/brain-inspired prototype system on a single chip (e.g., like prior neuromorphic implementations of auditory and vision systems). Such a single-chip implementation would make it possible to miniaturize the \"brain\" of an autonomous drone and serve to expand the use of autonomous small drones to numerous applications.","PeriodicalId":250150,"journal":{"name":"Proceedings of the 7th Annual Neuro-inspired Computational Elements Workshop on - NICE '19","volume":"63 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129865454","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Binding of Sparse Distributed Representations in Hierarchical Temporal Memory 分层时间存储器中稀疏分布表示的绑定
Luke G Boudreau, D. Kudithipudi
{"title":"Binding of Sparse Distributed Representations in Hierarchical Temporal Memory","authors":"Luke G Boudreau, D. Kudithipudi","doi":"10.1145/3320288.3320299","DOIUrl":"https://doi.org/10.1145/3320288.3320299","url":null,"abstract":"Hierarchical Temporal Memory is a brain inspired theory of intelligence, which emulates the homogeneous structure and connectivity of the pyramidal neurons in the mammalian neocortex. Similar to the neocortex, Hierarchical Temporal Memory processes spatiotemporal information to produce an internal representation of objects in the world. A fundamental component in Hierarchical Temporal Memory is the spatial pooler, which is responsible for processing feedforward sensory inputs into sparse distributed representations. In this work, we apply an explicit binary binding vector operation from vector symbolic architectures to HTM's sparse distributed representations through local inhibition. We demonstrate that the binding operation can be used as the basis for a content addressable memory, which has the potential for storage and retrieval of sparse distributed representations. Furthermore, the bound vectors and their semantic relationships are visualized through dimensionality reduction techniques and a uniqueness matrix.","PeriodicalId":250150,"journal":{"name":"Proceedings of the 7th Annual Neuro-inspired Computational Elements Workshop on - NICE '19","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128138674","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Current-Mode Memristor Crossbars for Neuromorphic Computing 用于神经形态计算的电流模式记忆电阻横栅
Cory E. Merkel
{"title":"Current-Mode Memristor Crossbars for Neuromorphic Computing","authors":"Cory E. Merkel","doi":"10.1145/3320288.3320298","DOIUrl":"https://doi.org/10.1145/3320288.3320298","url":null,"abstract":"Motivated by advantages of current-mode design, this paper explores the implementation of weight matrices in neuromemristive systems via current-mode memristor crossbar circuits. After deriving theoretical results for the range and distribution of weights in the current-mode design, it is shown that any weight matrix based on voltage-mode crossbars can be mapped to a current-mode crossbar if the voltage-mode weights are carefully bounded. Then, a modified gradient descent rule is derived for the current-mode design that can be used to perform backpropagation training. Behavioral simulations on the MNIST dataset indicate that both voltage and current-mode designs are able to achieve similar accuracy and have similar defect tolerance. However, analysis of trained weight distributions reveals that current-mode and voltage-mode designs may use different feature representations.","PeriodicalId":250150,"journal":{"name":"Proceedings of the 7th Annual Neuro-inspired Computational Elements Workshop on - NICE '19","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127238515","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书