Early Image Termination Technique During STDP Training of Spiking Neural Network

Dongwoo Lew, Jongsun Park
{"title":"Early Image Termination Technique During STDP Training of Spiking Neural Network","authors":"Dongwoo Lew, Jongsun Park","doi":"10.1109/ISOCC50952.2020.9333081","DOIUrl":null,"url":null,"abstract":"Spiking Neural Network (SNN) is a breed of neural networks that seek to achieve low energy and power by more closely mimicking biological brains. SNNs are often trained using lightweight unsupervised learning such as Spike Time Dependent Plasticity (STDP). However, STDP is prone to redundant time steps during training since STDP cannot determine current image needs further training or not. To reduce redundant time steps and lower energy costs during STDP training, we propose a novel technique that terminates training upon an image preemptively. The proposed technique reduces time steps by 44% with accuracy drop of 0.91% on MNIST.","PeriodicalId":270577,"journal":{"name":"2020 International SoC Design Conference (ISOCC)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 International SoC Design Conference (ISOCC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISOCC50952.2020.9333081","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

Abstract

Spiking Neural Network (SNN) is a breed of neural networks that seek to achieve low energy and power by more closely mimicking biological brains. SNNs are often trained using lightweight unsupervised learning such as Spike Time Dependent Plasticity (STDP). However, STDP is prone to redundant time steps during training since STDP cannot determine current image needs further training or not. To reduce redundant time steps and lower energy costs during STDP training, we propose a novel technique that terminates training upon an image preemptively. The proposed technique reduces time steps by 44% with accuracy drop of 0.91% on MNIST.
脉冲神经网络STDP训练中的早期图像终止技术
脉冲神经网络(SNN)是一种通过更接近地模仿生物大脑来实现低能量和低功率的神经网络。snn通常使用轻量级无监督学习(如Spike Time Dependent Plasticity, STDP)进行训练。然而,STDP在训练过程中容易产生冗余的时间步长,因为STDP不能确定当前图像是否需要进一步训练。为了减少STDP训练过程中的冗余时间步和降低能量成本,我们提出了一种基于图像预先终止训练的新技术。该技术在MNIST上减少了44%的时间步长,精度下降了0.91%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信