MRAM-Based CiM Architecture for Backpropagation-Free Training of Neural Networks Using DFA and DRTP

IF 1.9 3区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC
IEEE Transactions on Magnetics Pub Date : 2026-10-01 Epub Date: 2026-06-17 DOI:10.1109/TMAG.2026.3704393
Hemkant Nehete;Amit Monga;Sandeep Soni;Tharun Kumar Reddy Bollu;Balasubramanian Raman
{"title":"MRAM-Based CiM Architecture for Backpropagation-Free Training of Neural Networks Using DFA and DRTP","authors":"Hemkant Nehete;Amit Monga;Sandeep Soni;Tharun Kumar Reddy Bollu;Balasubramanian Raman","doi":"10.1109/TMAG.2026.3704393","DOIUrl":null,"url":null,"abstract":"Conventional backpropagation’s (BP) sequential nature limits its efficiency on compute-in-memory (CiM) architectures. To address this challenge, this work proposes the first CiM accelerator framework for training neural networks using direct feedback alignment (DFA) and direct random target propagation (DRTP) implemented on magnetoresistive random access memory (MRAM)-based CiM crossbars. By exploiting the inherent parallelism of these learning rules, the proposed design enables concurrent error propagation and weight-gradient computation for all layers. A CiM-aware mapping strategy is developed for forward computation, error projection, and gradient evaluation on crossbar arrays, along with hierarchical organization and pipelining to improve hardware utilization. The architecture is evaluated across fully connected and convolutional neural networks. Results show an average of 36% and 50% improvement in area and energy efficiency compared to BP-based training, while pipelining further reduces iteration latency and improves throughput. In particular, DRTP enables inter-iteration pipelining and achieves more than 100% higher throughput than BP in spin-orbit torque (SOT)-MRAM-based CiM architectures, demonstrating an efficient approach for scalable and energy-efficient on-chip neural network training.","PeriodicalId":13405,"journal":{"name":"IEEE Transactions on Magnetics","volume":"62 10","pages":"3401007-3401007"},"PeriodicalIF":1.9000,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Magnetics","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/11569065/","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/6/17 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Conventional backpropagation’s (BP) sequential nature limits its efficiency on compute-in-memory (CiM) architectures. To address this challenge, this work proposes the first CiM accelerator framework for training neural networks using direct feedback alignment (DFA) and direct random target propagation (DRTP) implemented on magnetoresistive random access memory (MRAM)-based CiM crossbars. By exploiting the inherent parallelism of these learning rules, the proposed design enables concurrent error propagation and weight-gradient computation for all layers. A CiM-aware mapping strategy is developed for forward computation, error projection, and gradient evaluation on crossbar arrays, along with hierarchical organization and pipelining to improve hardware utilization. The architecture is evaluated across fully connected and convolutional neural networks. Results show an average of 36% and 50% improvement in area and energy efficiency compared to BP-based training, while pipelining further reduces iteration latency and improves throughput. In particular, DRTP enables inter-iteration pipelining and achieves more than 100% higher throughput than BP in spin-orbit torque (SOT)-MRAM-based CiM architectures, demonstrating an efficient approach for scalable and energy-efficient on-chip neural network training.
基于mram的基于DFA和DRTP的神经网络无反向传播训练CiM体系
传统反向传播(BP)的顺序特性限制了其在内存计算(CiM)体系结构中的效率。为了解决这一挑战,本工作提出了第一个CiM加速器框架,用于使用直接反馈校准(DFA)和直接随机目标传播(DRTP)在基于磁阻随机存取存储器(MRAM)的CiM横条上实现的训练神经网络。通过利用这些学习规则固有的并行性,所提出的设计可以实现所有层的并发误差传播和权重梯度计算。针对交叉杆阵列的前向计算、误差投影和梯度评估,提出了一种具有cim感知的映射策略,并结合分层组织和流水线来提高硬件利用率。该架构在全连接和卷积神经网络上进行评估。结果显示,与基于bp的训练相比,在面积和能源效率方面平均提高了36%和50%,而流水线进一步减少了迭代延迟并提高了吞吐量。特别是,DRTP实现了迭代之间的流水线,并且在基于自旋轨道扭矩(SOT)- mram的CiM架构中实现了比BP高100%以上的吞吐量,展示了一种可扩展和节能的片上神经网络训练的有效方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Magnetics
IEEE Transactions on Magnetics 工程技术-工程:电子与电气
CiteScore
4.00
自引率
14.30%
发文量
565
审稿时长
4.1 months
期刊介绍: Science and technology related to the basic physics and engineering of magnetism, magnetic materials, applied magnetics, magnetic devices, and magnetic data storage. The IEEE Transactions on Magnetics publishes scholarly articles of archival value as well as tutorial expositions and critical reviews of classical subjects and topics of current interest.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书