Takutoshi Nakayama, Takashi Matsumoto, H. Takase, H. Kawanaka, S. Tsuruoka
{"title":"抑制spikeprop中的冗余尖峰——去除冗余延迟的局部应用","authors":"Takutoshi Nakayama, Takashi Matsumoto, H. Takase, H. Kawanaka, S. Tsuruoka","doi":"10.1109/ICETET.2015.39","DOIUrl":null,"url":null,"abstract":"SpikeProp, which is proposed by Booij, is a kind of spiking neural networks. It can learn the timing of output spikes, but cannot adjust the number of output spikes. To enable SpikeProp to perform time series signal processing, our research group has discussed a learning algorithm for SpikeProp without redundant output spikes. The method consists of two techniques: adaptive weight decay (AWD) and removing redundant delays (RD). As a part of these researches, we discuss a method to locally application of removing redundant time delays in this article. Since AWD works differently on each part of network, RD should not be applied uniformity. By simple experiments, we showed that only RD between input layer and hidden layer is enough for performance.","PeriodicalId":127139,"journal":{"name":"2015 7th International Conference on Emerging Trends in Engineering & Technology (ICETET)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2015-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Surpress Redundant Spikes in SpikeProp-Locally Application of Removing Redundant Delays\",\"authors\":\"Takutoshi Nakayama, Takashi Matsumoto, H. Takase, H. Kawanaka, S. Tsuruoka\",\"doi\":\"10.1109/ICETET.2015.39\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"SpikeProp, which is proposed by Booij, is a kind of spiking neural networks. It can learn the timing of output spikes, but cannot adjust the number of output spikes. To enable SpikeProp to perform time series signal processing, our research group has discussed a learning algorithm for SpikeProp without redundant output spikes. The method consists of two techniques: adaptive weight decay (AWD) and removing redundant delays (RD). As a part of these researches, we discuss a method to locally application of removing redundant time delays in this article. Since AWD works differently on each part of network, RD should not be applied uniformity. By simple experiments, we showed that only RD between input layer and hidden layer is enough for performance.\",\"PeriodicalId\":127139,\"journal\":{\"name\":\"2015 7th International Conference on Emerging Trends in Engineering & Technology (ICETET)\",\"volume\":\"17 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2015-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2015 7th International Conference on Emerging Trends in Engineering & Technology (ICETET)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICETET.2015.39\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2015 7th International Conference on Emerging Trends in Engineering & Technology (ICETET)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICETET.2015.39","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Surpress Redundant Spikes in SpikeProp-Locally Application of Removing Redundant Delays
SpikeProp, which is proposed by Booij, is a kind of spiking neural networks. It can learn the timing of output spikes, but cannot adjust the number of output spikes. To enable SpikeProp to perform time series signal processing, our research group has discussed a learning algorithm for SpikeProp without redundant output spikes. The method consists of two techniques: adaptive weight decay (AWD) and removing redundant delays (RD). As a part of these researches, we discuss a method to locally application of removing redundant time delays in this article. Since AWD works differently on each part of network, RD should not be applied uniformity. By simple experiments, we showed that only RD between input layer and hidden layer is enough for performance.