Md. Shahanur Alam, B. Fernando, Yassine Jaoudi, C. Yakopcic, Raqibul Hasan, M. Tarek, Taha, G. Subramanyam
{"title":"Memristor Based Autoencoder for Unsupervised Real-Time Network Intrusion and Anomaly Detection","authors":"Md. Shahanur Alam, B. Fernando, Yassine Jaoudi, C. Yakopcic, Raqibul Hasan, M. Tarek, Taha, G. Subramanyam","doi":"10.1145/3354265.3354267","DOIUrl":"https://doi.org/10.1145/3354265.3354267","url":null,"abstract":"Custom low power hardware for real-time network security and anomaly detection are in great demand, as these would allow for efficient security in battery-powered network devices. This paper presents a memristor based system for real-time intrusion detection, as well as an anomaly detection based on autoencoders. Intrusion detection is based on a single autoencoder, and the overall detection accuracy of this system is 92.91% with a malicious packet detection accuracy of 98.89%. The system described in this paper is also capable of using two autoencoders to perform anomaly detection using real-time online learning. Using this system, we show that anomalous data is flagged by the system, but over time the system stops flagging a particular datatype if its presence is abundant. Utilizing memristors in these designs allows us to present extreme low power systems for intrusion and anomaly detection, while sacrificing little accuracy.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116296676","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Segmented Attractor Network for Neuromorphic Associative Learning","authors":"Alexander Jones, R. Jha, A. Jacob, Cory E. Merkel","doi":"10.1145/3354265.3354284","DOIUrl":"https://doi.org/10.1145/3354265.3354284","url":null,"abstract":"This work describes a segmented attractor network that records memories across different sets of information. Unlike typical attractor networks that can associate any given inputs with one another, the attractor network presented here tracks information across multiple sets where each set possesses one or more features. Hyperparameter analysis is performed on the network's recall capability by altering factors such as the network's size, the number of memories within the network, the amount of information required to perform recall, and the amount of feedback a synapse can provide. The analysis done shows an improved hit rate when increasing the features per set and allows the network to obtain a memory capacity higher than other standard attractor networks.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117059228","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Y. Watkins, A. Thresher, Peter F. Schultz, Andreas Wild, A. Sornborger, Garrett T. Kenyon
{"title":"Unsupervised Dictionary Learning via a Spiking Locally Competitive Algorithm","authors":"Y. Watkins, A. Thresher, Peter F. Schultz, Andreas Wild, A. Sornborger, Garrett T. Kenyon","doi":"10.1145/3354265.3354276","DOIUrl":"https://doi.org/10.1145/3354265.3354276","url":null,"abstract":"A new class of neuromorphic processors promises to provide fast and power-efficient execution of spiking neural networks with on-chip synaptic plasticity. This efficiency derives in part from the fine-grained parallelism as well as event-driven communication mediated by spatially and temporally sparse spike messages. Another source of efficiency arises from the close spatial proximity between synapses and the sites where their weights are applied and updated. This proximity of compute and memory elements drastically reduces expensive data movements but imposes the constraint that only local operations can be efficiently performed, similar to constraints present in biological neural circuits. Efficient weight update operations should therefore only depend on information available locally at each synapse as non-local operations that involve copying, taking a transpose, or normalizing an entire weight matrix are not efficiently supported by present neuromorphic architectures. Moreover, spikes are typically non-negative events, which imposes additional constraints on how local weight update operations can be performed. The Locally Competitive Algorithm (LCA) is a dynamical sparse solver that uses only local computations between non-spiking leaky integrator neurons, allowing for massively parallel implementations on compatible neuromorphic architectures such as Intel's Loihi research chip. It has been previously demonstrated that non-spiking LCA can be used to learn dictionaries of convolutional kernels in an unsupervised manner from raw, unlabeled input, although only by employing non-local computation and signed non-spiking outputs. Here, we show how unsupervised dictionary learning with spiking LCA (S-LCA) can be implemented using only local computation and unsigned spike events, providing a promising strategy for constructing self-organizing neuromorphic chips.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132123267","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Edward Kim, Jessica Yarnall, Priya Shah, Garrett T. Kenyon
{"title":"A Neuromorphic Sparse Coding Defense to Adversarial Images","authors":"Edward Kim, Jessica Yarnall, Priya Shah, Garrett T. Kenyon","doi":"10.1145/3354265.3354277","DOIUrl":"https://doi.org/10.1145/3354265.3354277","url":null,"abstract":"Adversarial images are a class of images that have been slightly altered by very specific noise to change the way a deep learning neural network classifies the image. In many cases, this particular noise is imperceptible to the human vision system and thus presents a vulnerability of significant concern to the machine learning and artificial intelligence community. Research towards mitigating this type of attack has taken many forms, one of which is to filter or post process the image before classifying the image with a deep neural network. Techniques such as smoothing, filtering, and compression have been used with varying levels of success. In our work, we explored the use of a neuromorphic software and hardware approach as a protection against adversarial image attack. The algorithm governing our neuromorphic approach is based upon sparse coding. Our sparse coding approach is solved using a dynamic system of equations that models biological low level vision. Our quantitative and qualitative results show that a sparse coding reconstruction is remarkably invariant to changes in sparsity and reconstruction error with respect to classification accuracy. Furthermore, our approach is able to maintain low reconstruction errors without sacrificing classification performance.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114412423","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
K. Yue, Xiaoyu Wang, Jay Jadav, Akshay Vartak, A. C. Parker
{"title":"Analog Neurons that Signal with Spiking Frequencies","authors":"K. Yue, Xiaoyu Wang, Jay Jadav, Akshay Vartak, A. C. Parker","doi":"10.1145/3354265.3354273","DOIUrl":"https://doi.org/10.1145/3354265.3354273","url":null,"abstract":"Neuron circuits that signal via spiking frequencies are described here. Biomimetic circuits including a frequency-sensitive adaptive synapse, voltage-dependent axon hillock, and STDP learning logic are proposed in this paper. The circuit functions are discussed in detail with HSPICE simulations. This work explores a possible nonlinear autonomous learning component in neuromorphic systems through introducing a band-pass frequency filter-like synapse that could learn to detect the appropriate frequency via the reward process.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128696679","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Benchmarking Event-Driven Neuromorphic Architectures","authors":"C. Vineyard, Sam Green, William M. Severa, Ç. Koç","doi":"10.1145/3354265.3354278","DOIUrl":"https://doi.org/10.1145/3354265.3354278","url":null,"abstract":"Neuromorphic architectures are represented by a broad class of hardware, with artificial neural network (ANN) architectures at one extreme and event-driven spiking architectures at another. Algorithms and applications efficiently processed by one neuromorphic architecture may be unsuitable for another, but it is challenging to compare various neuromorphic architectures among themselves and with traditional computer architectures. In this position paper, we take inspiration from architectural characterizations in scientific computing and motivate the need for neuromorphic architecture comparison techniques, outline relevant performance metrics and analysis tools, and describe cognitive workloads to meaningfully exercise neuromorphic architectures. Additionally, we propose a simulation-based framework for benchmarking a wide range of neuromorphic workloads. While this work is applicable to neuromorphic development in general, we focus on event-driven architectures, as they offer both unique performance characteristics and evaluation challenges.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130363776","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Maximilian Liehr, Jubin Hazra, K. Beckmann, W. Olin-Ammentorp, N. Cady, Ryan Weiss, Sagarvarma Sayyaparaju, G. Rose, J. V. Nostrand
{"title":"Fabrication and Performance of Hybrid ReRAM-CMOS Circuit Elements for Dynamic Neural Networks","authors":"Maximilian Liehr, Jubin Hazra, K. Beckmann, W. Olin-Ammentorp, N. Cady, Ryan Weiss, Sagarvarma Sayyaparaju, G. Rose, J. V. Nostrand","doi":"10.1145/3354265.3354271","DOIUrl":"https://doi.org/10.1145/3354265.3354271","url":null,"abstract":"In neuromorphic applications, resistive memory solutions (implemented as Resistive Random Access Memory or ReRAM) have significant potential in emulating the desired two-terminal synaptic functionality of real synapses. One of the unique features for the demonstrated ReRAM devices includes conductance modulation, which allows for the implementation of the synaptic weight between neuronal elements. In this paper, we illustrate the multi-resistance level switching capabilities of our unique ReRAM-CMOS hybrid system, which is a demonstration vehicle for implementation of a memristive Dynamic Adaptive Neural Network Array, also known as mrDANNA. Discrete resistance levels have been achieved through application of varying gate voltage and discrete electric pulses in the order of nanoseconds.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"46 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122747703","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sumedha Gandharava Dahl, Robert C. Ivans, K. D. Cantley
{"title":"Learning Behavior of Memristor-Based Neuromorphic Circuits in the Presence of Radiation","authors":"Sumedha Gandharava Dahl, Robert C. Ivans, K. D. Cantley","doi":"10.1145/3354265.3354272","DOIUrl":"https://doi.org/10.1145/3354265.3354272","url":null,"abstract":"In this paper, a feed-forward spiking neural network with memristive synapses is designed to learn a spatio-temporal pattern representing the 25-pixel character 'B' by separating correlated and uncorrelated afferents. The network uses spike-timing-dependent plasticity (STDP) learning behavior, which is implemented using biphasic neuron spikes. A TiO2 memristor non-linear drift model is used to simulate synaptic behavior in the neuromorphic circuit. The network uses a many-to-one topology with 25 pre-synaptic neurons (afferent) each connected to a memristive synapse and one postsynaptic neuron. The memristor model is modified to include the experimentally observed effect of state-altering radiation. During the learning process, irradiation of the memristors alters their conductance state, and the effect on circuit learning behavior is determined. Radiation is observed to generally increase the synaptic weight of the memristive devices, making the network connections more conductive and less stable. However, the network appears to relearn the pattern when radiation ceases but does take longer to resolve the correlation and pattern. Network recovery time is proportional to flux, intensity, and duration of the radiation. Further, at lower but continuous radiation exposure, (flux 1x1010 cm-2s-1 and below), the circuit resolves the pattern successfully for up to 100 s.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121469698","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Low-Power Domino Logic Architecture for Memristor-Based Neuromorphic Computing","authors":"Cory E. Merkel, A. Nikam","doi":"10.1145/3354265.3354282","DOIUrl":"https://doi.org/10.1145/3354265.3354282","url":null,"abstract":"We propose a domino logic architecture for memristor-based neuromorphic computing. The design uses the delay of memristor RC circuits to represent synaptic computations and a simple binary neuron activation function. Synchronization schemes are proposed for communicating information between neural network layers, and a simple linear power model is developed to estimate the design's energy efficiency for a particular network size. Results indicate that the proposed architecture can achieve 0.61 fJ per classification per component (neurons and synapses) and outperforms other designs in terms of energy per % accuracy.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124309913","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sandeep Madireddy, A. Yanguas-Gil, Prasanna Balaprakash
{"title":"Neuromorphic Architecture Optimization for Task-Specific Dynamic Learning","authors":"Sandeep Madireddy, A. Yanguas-Gil, Prasanna Balaprakash","doi":"10.1145/3354265.3354270","DOIUrl":"https://doi.org/10.1145/3354265.3354270","url":null,"abstract":"The ability to learn and adapt in real time is a central feature of biological systems. Neuromorphic architectures demonstrating such versatility can greatly enhance our ability to efficiently process information at the edge. A key challenge, however, is to understand which learning rules are best suited for specific tasks and how the relevant hyperparameters can be fine-tuned. In this work, we introduce a conceptual framework in which the learning process is integrated into the network itself. This allows us to cast meta-learning as a mathematical optimization problem. We employ DeepHyper, a scalable, asynchronous model-based search, to simultaneously optimize the choice of meta-learning rules and their hyperparameters. We demonstrate our approach with two different datasets, MNIST and FashionMNIST, using a network architecture inspired by the learning center of the insect brain. Our results show that optimal learning rules can be dataset-dependent even within similar tasks. This dependency demonstrates the importance of introducing versatility and flexibility in the learning algorithms. It also illuminates experimental findings in insect neuroscience that have shown a heterogeneity of learning rules within the insect mushroom body.","PeriodicalId":225636,"journal":{"name":"Proceedings of the International Conference on Neuromorphic Systems","volume":"97 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114934427","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}