The bioinspired traffic sign classifier

Abstract Objectives In this paper the research on developing convolutional spiking neural networks for traffic signs classification is presented. Unlike classical ones, spiking networks reflect the behaviour of biological neurons much more closely, by taking into account the time dimension and event-based operation. Spiking networks running on dedicated neuromorphic platforms, such as Intel Loihi, can operate with greater energy efficiency, hence they are an interesting approach for embedded solutions. Methods For convolutional spiking neural networks' design and simulation, Nengo and NengoDL libraries for Python language were used. Numerous experiments using the Leaky-Integrate-and-Fire (LIF) neuron model were conducted. The training results, with different augmentation methods and number of time steps for input image presentation were compared. Results Finally, an accuracy of up to 97% on the test set was achieved, depending on the number of time steps the input was presented to the SNN. Conclusions The proposed experiments show that using simple convolutional spiking neural network, one can achieve accuracy comparable to the classical network with the same architecture and trained on the same dataset. At the same time, running on dedicated neuromorphic hardware, such solution should be characterized by low latency and low energy consumption.