Zhengqing Zhong, Yunpeng Tuo, Haibing Wang, Tengxiao Wang, Junxian He, Sihao Chen, Min Tian, Cong Shi
{"title":"基于双模集成与火神经元的可配置片上尖峰编码网络","authors":"Zhengqing Zhong, Yunpeng Tuo, Haibing Wang, Tengxiao Wang, Junxian He, Sihao Chen, Min Tian, Cong Shi","doi":"10.1109/ITNEC56291.2023.10081991","DOIUrl":null,"url":null,"abstract":"For edge intelligence applications, this work proposes a tiny spike encoding network embedded with high-speed on-chip encoding capability, which applies the proposed dual-mode Integrate & Fire (IF) neuron model to support different coding schemes. The proposed encoding network was prototyped on a Zynq-7020 FPGA device, with an on-chip encoding speed as high as 2127 frame/s, while dissipating only 69 mW under a 250 MHz clock frequency. Our spiking neural network hardware encoder adopts an eight-core architecture for parallel computing to improve processing speed, supporting three well-known coding schemes, i.e. rate coding, burst coding and time-to-firstspike (TTFS) coding. To verify the performance of different coding schemes realized by our hardware encoder, the widely used MNIST and Fashion-MNIST datasets were selected as benchmark. After encoding, all spiking addressevent representation (AER) data were sent to a two-layer fully connected network with BP-STDP learning rule for training and inference, which was completed on PC software. Finally, three coding schemes (rate coding, burst coding and time-to-first-spike coding) all achieved comparably high classification accuracies on MNIST and Fashion-MNIST datasets (95.87%, 92.23% and 88.22% on MNIST, 83.79%, 82.71% and 73.79% on Fashion-MNIST, respectively).","PeriodicalId":218770,"journal":{"name":"2023 IEEE 6th Information Technology,Networking,Electronic and Automation Control Conference (ITNEC)","volume":"107 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Configurable On-Chip Spike Encoding Network Based on Dual-Mode Integrate & Fire Neurons\",\"authors\":\"Zhengqing Zhong, Yunpeng Tuo, Haibing Wang, Tengxiao Wang, Junxian He, Sihao Chen, Min Tian, Cong Shi\",\"doi\":\"10.1109/ITNEC56291.2023.10081991\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"For edge intelligence applications, this work proposes a tiny spike encoding network embedded with high-speed on-chip encoding capability, which applies the proposed dual-mode Integrate & Fire (IF) neuron model to support different coding schemes. The proposed encoding network was prototyped on a Zynq-7020 FPGA device, with an on-chip encoding speed as high as 2127 frame/s, while dissipating only 69 mW under a 250 MHz clock frequency. Our spiking neural network hardware encoder adopts an eight-core architecture for parallel computing to improve processing speed, supporting three well-known coding schemes, i.e. rate coding, burst coding and time-to-firstspike (TTFS) coding. To verify the performance of different coding schemes realized by our hardware encoder, the widely used MNIST and Fashion-MNIST datasets were selected as benchmark. After encoding, all spiking addressevent representation (AER) data were sent to a two-layer fully connected network with BP-STDP learning rule for training and inference, which was completed on PC software. Finally, three coding schemes (rate coding, burst coding and time-to-first-spike coding) all achieved comparably high classification accuracies on MNIST and Fashion-MNIST datasets (95.87%, 92.23% and 88.22% on MNIST, 83.79%, 82.71% and 73.79% on Fashion-MNIST, respectively).\",\"PeriodicalId\":218770,\"journal\":{\"name\":\"2023 IEEE 6th Information Technology,Networking,Electronic and Automation Control Conference (ITNEC)\",\"volume\":\"107 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-02-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 IEEE 6th Information Technology,Networking,Electronic and Automation Control Conference (ITNEC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ITNEC56291.2023.10081991\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE 6th Information Technology,Networking,Electronic and Automation Control Conference (ITNEC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ITNEC56291.2023.10081991","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
对于边缘智能应用,本工作提出了一种嵌入高速片上编码能力的微小尖峰编码网络,该网络应用所提出的双模集成与发射(IF)神经元模型来支持不同的编码方案。所提出的编码网络在Zynq-7020 FPGA器件上原型化,片上编码速度高达2127帧/秒,而在250 MHz时钟频率下功耗仅为69 mW。我们的尖峰神经网络硬件编码器采用八核并行计算架构,提高处理速度,支持三种众所周知的编码方案,即速率编码、突发编码和首次尖峰时间(TTFS)编码。为了验证硬件编码器实现的不同编码方案的性能,选择了广泛使用的MNIST和Fashion-MNIST数据集作为基准。编码后,所有峰值地址表示(AER)数据发送到BP-STDP学习规则的二层全连通网络中进行训练和推理,并在PC软件上完成。最后,三种编码方案(rate编码、burst编码和time- for -first spike编码)在MNIST和Fashion-MNIST数据集上的分类准确率分别为95.87%、92.23%和88.22%,在Fashion-MNIST上分别为83.79%、82.71%和73.79%。
A Configurable On-Chip Spike Encoding Network Based on Dual-Mode Integrate & Fire Neurons
For edge intelligence applications, this work proposes a tiny spike encoding network embedded with high-speed on-chip encoding capability, which applies the proposed dual-mode Integrate & Fire (IF) neuron model to support different coding schemes. The proposed encoding network was prototyped on a Zynq-7020 FPGA device, with an on-chip encoding speed as high as 2127 frame/s, while dissipating only 69 mW under a 250 MHz clock frequency. Our spiking neural network hardware encoder adopts an eight-core architecture for parallel computing to improve processing speed, supporting three well-known coding schemes, i.e. rate coding, burst coding and time-to-firstspike (TTFS) coding. To verify the performance of different coding schemes realized by our hardware encoder, the widely used MNIST and Fashion-MNIST datasets were selected as benchmark. After encoding, all spiking addressevent representation (AER) data were sent to a two-layer fully connected network with BP-STDP learning rule for training and inference, which was completed on PC software. Finally, three coding schemes (rate coding, burst coding and time-to-first-spike coding) all achieved comparably high classification accuracies on MNIST and Fashion-MNIST datasets (95.87%, 92.23% and 88.22% on MNIST, 83.79%, 82.71% and 73.79% on Fashion-MNIST, respectively).