Bi-sigmoid spike-timing dependent plasticity learning rule for magnetic tunnel junction-based SNN

Salah Daddinounou, Elena-Ioana Vatajelu
{"title":"Bi-sigmoid spike-timing dependent plasticity learning rule for magnetic tunnel junction-based SNN","authors":"Salah Daddinounou, Elena-Ioana Vatajelu","doi":"10.3389/fnins.2024.1387339","DOIUrl":null,"url":null,"abstract":"In this study, we explore spintronic synapses composed of several Magnetic Tunnel Junctions (MTJs), leveraging their attractive characteristics such as endurance, nonvolatility, stochasticity, and energy efficiency for hardware implementation of unsupervised neuromorphic systems. Spiking Neural Networks (SNNs) running on dedicated hardware are suitable for edge computing and IoT devices where continuous online learning and energy efficiency are important characteristics. We focus in this work on synaptic plasticity by conducting comprehensive electrical simulations to optimize the MTJ-based synapse design and find the accurate neuronal pulses that are responsible for the Spike Timing Dependent Plasticity (STDP) behavior. Most proposals in the literature are based on hardware-independent algorithms that require the network to store the spiking history to be able to update the weights accordingly. In this work, we developed a new learning rule, the Bi-Sigmoid STDP (B2STDP), which originates from the physical properties of MTJs. This rule enables immediate synaptic plasticity based on neuronal activity, leveraging in-memory computing. Finally, the integration of this learning approach within an SNN framework leads to a 91.71% accuracy in unsupervised image classification, demonstrating the potential of MTJ-based synapses for effective online learning in hardware-implemented SNNs.","PeriodicalId":509131,"journal":{"name":"Frontiers in Neuroscience","volume":"50 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in Neuroscience","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3389/fnins.2024.1387339","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

In this study, we explore spintronic synapses composed of several Magnetic Tunnel Junctions (MTJs), leveraging their attractive characteristics such as endurance, nonvolatility, stochasticity, and energy efficiency for hardware implementation of unsupervised neuromorphic systems. Spiking Neural Networks (SNNs) running on dedicated hardware are suitable for edge computing and IoT devices where continuous online learning and energy efficiency are important characteristics. We focus in this work on synaptic plasticity by conducting comprehensive electrical simulations to optimize the MTJ-based synapse design and find the accurate neuronal pulses that are responsible for the Spike Timing Dependent Plasticity (STDP) behavior. Most proposals in the literature are based on hardware-independent algorithms that require the network to store the spiking history to be able to update the weights accordingly. In this work, we developed a new learning rule, the Bi-Sigmoid STDP (B2STDP), which originates from the physical properties of MTJs. This rule enables immediate synaptic plasticity based on neuronal activity, leveraging in-memory computing. Finally, the integration of this learning approach within an SNN framework leads to a 91.71% accuracy in unsupervised image classification, demonstrating the potential of MTJ-based synapses for effective online learning in hardware-implemented SNNs.
基于磁隧道结的 SNN 的双西格码尖峰计时可塑性学习规则
在这项研究中,我们探索了由多个磁隧道结(MTJ)组成的自旋电子突触,利用它们的耐久性、非波动性、随机性和能效等诱人特性来实现无监督神经形态系统的硬件实施。在专用硬件上运行的尖峰神经网络(SNN)适用于边缘计算和物联网设备,在这些设备中,持续在线学习和能效是其重要特征。在这项工作中,我们将重点放在突触可塑性上,通过进行全面的电学模拟来优化基于 MTJ 的突触设计,并找到导致尖峰时序相关可塑性(STDP)行为的精确神经元脉冲。文献中的大多数建议都是基于独立于硬件的算法,要求网络存储尖峰历史,以便能够相应地更新权重。在这项工作中,我们从 MTJ 的物理特性出发,开发出了一种新的学习规则--Bi-Sigmoid STDP(B2STDP)。该规则可根据神经元的活动,利用内存计算实现即时的突触可塑性。最后,将这种学习方法集成到 SNN 框架中,在无监督图像分类中取得了 91.71% 的准确率,证明了基于 MTJ 的突触在硬件实现的 SNN 中进行有效在线学习的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信