SC-PLR: An Approximate Spiking Neural Network Accelerator With On-Chip Predictive Learning Rule

Wei Liu;Shanlin Xiao;Yue Liu;Zhiyi Yu
{"title":"SC-PLR: An Approximate Spiking Neural Network Accelerator With On-Chip Predictive Learning Rule","authors":"Wei Liu;Shanlin Xiao;Yue Liu;Zhiyi Yu","doi":"10.1109/TBCAS.2024.3385235","DOIUrl":null,"url":null,"abstract":"The brain's ability to anticipate future events is crucial for intelligent behavior. However, when deploying the capability to edge devices, there are huge challenges in terms of resources and power consumption. The main obstacle is the state-of-the-art neuromorphic hardware with Spike Timing Dependent Plasticity (STDP) learning rule requires significant computation for synaptic weight updates and memory to store intermediate synaptic weights. In this paper, we proposed an approximate Spiking Neural Network (SNN) accelerator with on-chip Predictive Learning Rule (PLR), which is a biological behavior observed in the brain, named SC-PLR. In SC-PLR, the principles of predictive processing are extended to enable neurons to learn temporal sequences and anticipate future events with minimum synaptic weight updates, while stochastic computing is leveraged to balance the hardware cost, energy efficiency, and accuracy. Simulation results demonstrate that PLR-based SNNs effectively enable adaptive and anticipatory behavior in robotics and decision-making scenarios. Additionally, FPGA implementation results show that the proposed SC-PLR outperforms state-of-the-art STDP-based SNN designs in terms of resources and power consumption. Specifically, our design achieves significant resource savings, including 77.3% Look-Up Table (LUT), 79.4% Flip-Flop (FF), and 56.4% Block RAM (BRAM) resources, and power consumption reduction by 32%.\n<xref><sup>1</sup></xref>\n<fn><label><sup>1</sup></label><p>The code is available at <uri>https://github.com/lucy-weizi/SC-PLR</uri>.</p></fn>","PeriodicalId":94031,"journal":{"name":"IEEE transactions on biomedical circuits and systems","volume":"18 5","pages":"1156-1165"},"PeriodicalIF":0.0000,"publicationDate":"2024-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on biomedical circuits and systems","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10492616/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

The brain's ability to anticipate future events is crucial for intelligent behavior. However, when deploying the capability to edge devices, there are huge challenges in terms of resources and power consumption. The main obstacle is the state-of-the-art neuromorphic hardware with Spike Timing Dependent Plasticity (STDP) learning rule requires significant computation for synaptic weight updates and memory to store intermediate synaptic weights. In this paper, we proposed an approximate Spiking Neural Network (SNN) accelerator with on-chip Predictive Learning Rule (PLR), which is a biological behavior observed in the brain, named SC-PLR. In SC-PLR, the principles of predictive processing are extended to enable neurons to learn temporal sequences and anticipate future events with minimum synaptic weight updates, while stochastic computing is leveraged to balance the hardware cost, energy efficiency, and accuracy. Simulation results demonstrate that PLR-based SNNs effectively enable adaptive and anticipatory behavior in robotics and decision-making scenarios. Additionally, FPGA implementation results show that the proposed SC-PLR outperforms state-of-the-art STDP-based SNN designs in terms of resources and power consumption. Specifically, our design achieves significant resource savings, including 77.3% Look-Up Table (LUT), 79.4% Flip-Flop (FF), and 56.4% Block RAM (BRAM) resources, and power consumption reduction by 32%. 1

The code is available at https://github.com/lucy-weizi/SC-PLR.

SC-PLR:具有片上预测学习规则的近似尖峰神经网络加速器
大脑预测未来事件的能力对于智能行为至关重要。然而,在边缘设备上部署这种能力时,在资源和功耗方面面临巨大挑战。主要障碍在于,采用尖峰时序相关可塑性(STDP)学习规则的最先进神经形态硬件需要大量计算来更新突触权重,并需要内存来存储中间突触权重。在本文中,我们提出了一种具有片上预测学习规则(PLR)的近似尖峰神经网络(SNN)加速器,这是一种在大脑中观察到的生物行为,被命名为 SC-PLR。在 SC-PLR 中,预测处理的原理得到了扩展,使神经元能够以最小的突触权重更新来学习时间序列和预测未来事件,同时利用随机计算来平衡硬件成本、能效和准确性。仿真结果表明,基于 PLR 的 SNN 能够有效地在机器人和决策场景中实现自适应和预测行为。此外,FPGA 实现结果表明,所提出的 SC-PLR 在资源和功耗方面优于最先进的基于 STDP 的 SNN 设计。具体来说,我们的设计节省了大量资源,包括 77.3% 的查找表(LUT)、79.4% 的触发器(FF)和 56.4% 的块 RAM(BRAM)资源,功耗降低了 32%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信