{"title":"A Novel Homeostasis Method to Improve the Learning Efficiency of Spiking Neural Networks","authors":"Lianhua Qu, Lei Wang, Shuo Tian, Ziyang Kang, Shiming Li, Weixia Xu","doi":"10.1109/IWOFC48002.2019.9078442","DOIUrl":null,"url":null,"abstract":"Spiking neural networks (SNNs) trained by spike timing dependent plasticity (STDP) is a promising computing paradigm for unsupervised artificial intelligence systems. During the learning procedure of SNNs trained by STDP, homeostasis method is always implemented to mitigate the inhomogeneity induced by inputs and initial synapse weights. If homeostasis is not achieved effectively, the learning efficiency will be affected due to unbalanced training of neurons in the same layer. In this paper, we propose a novel homeostasis method and carry out software simulations to evaluate the learning efficiency and performance of the proposed method compared with two classical SNN learning algorithms. Simulation results on the task of digital recognition of MNIST dataset show that, our proposed method can achieve a ~2 times higher learning efficiency while maintaining comparable performance.","PeriodicalId":266774,"journal":{"name":"2019 IEEE International Workshop on Future Computing (IWOFC","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 IEEE International Workshop on Future Computing (IWOFC","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IWOFC48002.2019.9078442","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Spiking neural networks (SNNs) trained by spike timing dependent plasticity (STDP) is a promising computing paradigm for unsupervised artificial intelligence systems. During the learning procedure of SNNs trained by STDP, homeostasis method is always implemented to mitigate the inhomogeneity induced by inputs and initial synapse weights. If homeostasis is not achieved effectively, the learning efficiency will be affected due to unbalanced training of neurons in the same layer. In this paper, we propose a novel homeostasis method and carry out software simulations to evaluate the learning efficiency and performance of the proposed method compared with two classical SNN learning algorithms. Simulation results on the task of digital recognition of MNIST dataset show that, our proposed method can achieve a ~2 times higher learning efficiency while maintaining comparable performance.