{"title":"Early Image Termination Technique During STDP Training of Spiking Neural Network","authors":"Dongwoo Lew, Jongsun Park","doi":"10.1109/ISOCC50952.2020.9333081","DOIUrl":null,"url":null,"abstract":"Spiking Neural Network (SNN) is a breed of neural networks that seek to achieve low energy and power by more closely mimicking biological brains. SNNs are often trained using lightweight unsupervised learning such as Spike Time Dependent Plasticity (STDP). However, STDP is prone to redundant time steps during training since STDP cannot determine current image needs further training or not. To reduce redundant time steps and lower energy costs during STDP training, we propose a novel technique that terminates training upon an image preemptively. The proposed technique reduces time steps by 44% with accuracy drop of 0.91% on MNIST.","PeriodicalId":270577,"journal":{"name":"2020 International SoC Design Conference (ISOCC)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 International SoC Design Conference (ISOCC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISOCC50952.2020.9333081","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2
Abstract
Spiking Neural Network (SNN) is a breed of neural networks that seek to achieve low energy and power by more closely mimicking biological brains. SNNs are often trained using lightweight unsupervised learning such as Spike Time Dependent Plasticity (STDP). However, STDP is prone to redundant time steps during training since STDP cannot determine current image needs further training or not. To reduce redundant time steps and lower energy costs during STDP training, we propose a novel technique that terminates training upon an image preemptively. The proposed technique reduces time steps by 44% with accuracy drop of 0.91% on MNIST.
脉冲神经网络(SNN)是一种通过更接近地模仿生物大脑来实现低能量和低功率的神经网络。snn通常使用轻量级无监督学习(如Spike Time Dependent Plasticity, STDP)进行训练。然而,STDP在训练过程中容易产生冗余的时间步长,因为STDP不能确定当前图像是否需要进一步训练。为了减少STDP训练过程中的冗余时间步和降低能量成本,我们提出了一种基于图像预先终止训练的新技术。该技术在MNIST上减少了44%的时间步长,精度下降了0.91%。