A Novel Homeostasis Method to Improve the Learning Efficiency of Spiking Neural Networks

Lianhua Qu, Lei Wang, Shuo Tian, Ziyang Kang, Shiming Li, Weixia Xu
{"title":"A Novel Homeostasis Method to Improve the Learning Efficiency of Spiking Neural Networks","authors":"Lianhua Qu, Lei Wang, Shuo Tian, Ziyang Kang, Shiming Li, Weixia Xu","doi":"10.1109/IWOFC48002.2019.9078442","DOIUrl":null,"url":null,"abstract":"Spiking neural networks (SNNs) trained by spike timing dependent plasticity (STDP) is a promising computing paradigm for unsupervised artificial intelligence systems. During the learning procedure of SNNs trained by STDP, homeostasis method is always implemented to mitigate the inhomogeneity induced by inputs and initial synapse weights. If homeostasis is not achieved effectively, the learning efficiency will be affected due to unbalanced training of neurons in the same layer. In this paper, we propose a novel homeostasis method and carry out software simulations to evaluate the learning efficiency and performance of the proposed method compared with two classical SNN learning algorithms. Simulation results on the task of digital recognition of MNIST dataset show that, our proposed method can achieve a ~2 times higher learning efficiency while maintaining comparable performance.","PeriodicalId":266774,"journal":{"name":"2019 IEEE International Workshop on Future Computing (IWOFC","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 IEEE International Workshop on Future Computing (IWOFC","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IWOFC48002.2019.9078442","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Spiking neural networks (SNNs) trained by spike timing dependent plasticity (STDP) is a promising computing paradigm for unsupervised artificial intelligence systems. During the learning procedure of SNNs trained by STDP, homeostasis method is always implemented to mitigate the inhomogeneity induced by inputs and initial synapse weights. If homeostasis is not achieved effectively, the learning efficiency will be affected due to unbalanced training of neurons in the same layer. In this paper, we propose a novel homeostasis method and carry out software simulations to evaluate the learning efficiency and performance of the proposed method compared with two classical SNN learning algorithms. Simulation results on the task of digital recognition of MNIST dataset show that, our proposed method can achieve a ~2 times higher learning efficiency while maintaining comparable performance.
一种提高脉冲神经网络学习效率的动态平衡新方法
利用脉冲时间依赖可塑性(STDP)训练的脉冲神经网络(SNNs)是一种很有前途的无监督人工智能计算范式。在STDP训练的snn学习过程中,总是采用稳态方法来缓解输入和初始突触权值引起的非均匀性。如果不能有效地实现内稳态,则会由于同一层神经元的不平衡训练而影响学习效率。在本文中,我们提出了一种新的动态平衡方法,并通过软件仿真来评估该方法与两种经典SNN学习算法的学习效率和性能。对MNIST数据集数字识别任务的仿真结果表明,该方法在保持相当性能的前提下,学习效率提高了2倍。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信