{"title":"Composing neural algorithms with Fugu","authors":"J. Aimone, William M. Severa, C. Vineyard","doi":"10.1145/3354265.3354268","DOIUrl":"https://doi.org/10.1145/3354265.3354268","url":null,"abstract":"Neuromorphic hardware architectures represent a growing family of potential post-Moore's Law Era platforms. Largely due to event-driving processing inspired by the human brain, these computer platforms can offer significant energy benefits compared to traditional von Neumann processors. Unfortunately there still remains considerable difficulty in successfully programming, configuring and deploying neuromorphic systems. We present the Fugu framework as an answer to this need. Rather than necessitating a developer attain intricate knowledge of how to program and exploit spiking neural dynamics to utilize the potential benefits of neuromorphic computing, Fugu is designed to provide a higher level abstraction as a hardware-independent mechanism for linking a variety of scalable spiking neural algorithms from a variety of sources. Individual kernels linked together provide sophisticated processing through compositionality. Fugu is intended to be suitable for a wide-range of neuromorphic applications, including machine learning, scientific computing, and more brain-inspired neural algorithms. Ultimately, we hope the community adopts this and other open standardization attempts allowing for free exchange and easy implementations of the ever-growing list of spiking neural algorithms.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128000296","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Neuromorphic Acceleration for Approximate Bayesian Inference on Neural Networks via Permanent Dropout","authors":"Nathan Wycoff, Prasanna Balaprakash, Fangfang Xia","doi":"10.1145/3354265.3354274","DOIUrl":"https://doi.org/10.1145/3354265.3354274","url":null,"abstract":"As neural networks have begun performing increasingly critical tasks for society ranging from driving cars to identifying candidates for drug development, the value of their ability to perform uncertainty quantification (UQ) in their predictions has risen commensurately. Permanent dropout, a popular method for neural network UQ, involves injecting stochasticity into the inference phase of the model and creating many predictions for each of the test data. This shifts the computational and energy burden of deep neural networks from the training phase to the inference phase. Recent work has demonstrated near-lossless conversion of classical deep neural networks to their spiking counterparts. We use these results to demonstrate the feasibility of conducting the inference phase with permanent dropout on spiking neural networks, mitigating the technique's computational and energy burden, which is essential for its use at scale or on edge platforms. We demonstrate the proposed approach via the Nengo spiking neural simulator on a combination drug therapy dataset for cancer treatment, where UQ is critical. Our results indicate that the spiking approximation gives a predictive distribution practically indistinguishable from that given by the classical network.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"112 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121429650","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Four Simulators of the DANNA Neuromorphic Computing Architecture","authors":"A. Disney, J. Plank, Mark E. Dean","doi":"10.1145/3229884.3229893","DOIUrl":"https://doi.org/10.1145/3229884.3229893","url":null,"abstract":"DANNA is a computing architecture, designed in 2014 to meld features of recurrent, spiking, plastic neuromorphic computing systems with very efficient hardware implementations. Its hardware design and FPGA implementation preceded any software support or simulation. Therefore, the development of simulators for DANNA had multiple, and sometimes conflicting goals. In this paper, we describe four separate simulators for DANNA, including their motivations and details of their implementations. We present a performance evaluation, and conclude with lessons learned. We intend this work to be useful to researchers involved in the co-design of novel hardware and software systems.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"85 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123043005","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sumedha Gandharava Dahl, Robert C. Ivans, K. D. Cantley
{"title":"Modeling Memristor Radiation Interaction Events and the Effect on Neuromorphic Learning Circuits","authors":"Sumedha Gandharava Dahl, Robert C. Ivans, K. D. Cantley","doi":"10.1145/3229884.3229885","DOIUrl":"https://doi.org/10.1145/3229884.3229885","url":null,"abstract":"An ideal memristor model is modified to include the effects of radiation interactions with the device. Modeling is done in Cadence Virtuoso design suite using Verilog-A. Simulations include the effect of radiation events that could change the state of device or can ionize the device to create e-h+ pairs or change the off-state resistance of the device. Combination of these events occurring simultaneously is also studied. Simulation results are compared with the experimental results published in existing research papers. Finally, transient simulation of a three-input, two-output spiking electronic neural network with memristive synapses is performed. Varying amounts of energy deposited by radiation are modeled, and it is observed that radiation exposure dramatically alters the synaptic weight evolution.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124982989","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Towards adaptive spiking label propagation","authors":"Kathleen E. Hamilton, Catherine D. Schuman","doi":"10.1145/3229884.3229897","DOIUrl":"https://doi.org/10.1145/3229884.3229897","url":null,"abstract":"Graph algorithms are a new class of applications for neuromorphic hardware. Rather than adapting deep learning and standard neural network approaches to a low-precision spiking environment, we use spiking neurons to analyze undirected graphs (e.g., the underlying modular structure). While fully connected spin glass implementations of spiking label propagation have shown promising results on graphs with dense communities, identifying sparse communities remains difficult. This work focuses on steps towards an adaptive spike-based implementations of label propagation, utilizing sparse embeddings and synaptic plasticity. Sparser embeddings reduce the number of inhibitory connections, and synaptic plasticity is used to simultaneously amplify spike responses between neurons in the same community, while impeding spike responses across different communities. We present results on identifying communities in sparse graphs with very small communities.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128028137","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Saccadic Predictive Vision Model with a Fovea","authors":"Michael Hazoglou, Todd Hylton","doi":"10.1145/3229884.3229886","DOIUrl":"https://doi.org/10.1145/3229884.3229886","url":null,"abstract":"We propose a model that emulates saccades, the rapid movements of the eye, called the Error Saccade Model, based on the prediction error of the Predictive Vision Model (PVM). The Error Saccade Model carries out movements of the model's field of view to regions with the highest prediction error. Comparisons of the Error Saccade Model on Predictive Vision Models with and without a fovea show that a fovea-like structure in the input level of the PVM improves the Error Saccade Model's ability to pursue detailed objects in its view. We hypothesize that the improvement is due to poorer resolution in the periphery causing higher prediction error when an object passes, triggering a saccade to the next location.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128437178","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
John J. M. Reynolds, J. Plank, Catherine D. Schuman, Grant Bruer, A. Disney, Mark E. Dean, G. Rose
{"title":"A Comparison of Neuromorphic Classification Tasks","authors":"John J. M. Reynolds, J. Plank, Catherine D. Schuman, Grant Bruer, A. Disney, Mark E. Dean, G. Rose","doi":"10.1145/3229884.3229896","DOIUrl":"https://doi.org/10.1145/3229884.3229896","url":null,"abstract":"A variety of neural network models and machine learning techniques have arisen over the past decade, and their successes with image classification have been stunning. With other classification tasks, selecting and configuring a neural network solution is not straightforward. In this paper, we evaluate and compare a variety of neural network models, trained by a variety of machine learning techniques, on a variety of classification tasks. While Deep Learning typically exhibits the best classification accuracy, we note the promise of Reservoir Computing, and evolutionary optimization on spiking neural networks. In many cases, these technologies perform as well as, or better than Deep Learning, and the resulting networks are much smaller than their Deep Learning counterparts.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114213915","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Dynamical Systems Approach to Neuromorphic Computation of Conditional Probabilities","authors":"Nigel Stepp, Aruna Jammalamadaka","doi":"10.1145/3229884.3229891","DOIUrl":"https://doi.org/10.1145/3229884.3229891","url":null,"abstract":"Here we describe a spiking neural network model for obtaining the conditional probability between two random variables from the synaptic weight between two corresponding neurons. Our method does not aim to mimic biologically plausible processes in the brain, but instead aims to replace slow Bayesian updating algorithms with highly parallel, simple computations by taking inspiration from Spike Timing Dependent Plasticity (STDP), a naturally occurring phenomena of neuronal synapses. The neuronal network we develop can operate in two different modes to both learn the joint distribution of variables, and read out conditional probabilities based on partial input. Furthermore, it relies on integer-valued neurons and synapses, making it amenable to hardware-based implementations. We demonstrate this capability of our novel probabilistic computation unit by encoding synthetically generated input data streams into spike trains and letting the synaptic weight of interest converge to the correct conditional probability.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115277268","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Learning Accuracy Analysis of Memristor-based Nonlinear Computing Module on Long Short-term Memory","authors":"Hongyu An, M. Al-Mamun, M. Orlowski, Y. Yi","doi":"10.1145/3229884.3229889","DOIUrl":"https://doi.org/10.1145/3229884.3229889","url":null,"abstract":"To accelerate the training efficiency of neural network-based machine learning, a memristor-based nonlinear computing module is designed and analyzed. Nonlinear computing operation is widely needed in neuromorphic computing and deep learning. The proposed nonlinear computing module can potentially realize a monotonic nonlinear function by successively placing memristors in a series combing with a simple amplifier. The proposed module is evaluated and optimized through the Long Short-term Memory with the digit number recognition application. The proposed nonlinear computing module can reduce the chip area from microscale to nanoscale, and potentially enhance the computing efficiency to O(1) while guaranteeing accuracy. Furthermore, the impact of the resistance variation of memristor switching on the training accuracy is simulated and analyzed using Long Short-term Memory as a benchmark.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126289171","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Proceedings of the International Conference on Neuromorphic Systems","authors":"","doi":"10.1145/3229884","DOIUrl":"https://doi.org/10.1145/3229884","url":null,"abstract":"","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132695077","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}