Hop-CIM: An all-digital two-level approximate SRAM-CIM macro for high energy-efficient HNN acceleration with data-aware early exit and column-wise partial-sum reuse
IF 2.5 3区 工程技术Q3 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE
Shunqin Cai , Liukai Xu , Wentao Liu , Dengfeng Wang , Keqing Ouyang , Jinyu Wang , Weizhong Wu , Qiang Huang , Zhi Li , Yanan Sun
{"title":"Hop-CIM: An all-digital two-level approximate SRAM-CIM macro for high energy-efficient HNN acceleration with data-aware early exit and column-wise partial-sum reuse","authors":"Shunqin Cai , Liukai Xu , Wentao Liu , Dengfeng Wang , Keqing Ouyang , Jinyu Wang , Weizhong Wu , Qiang Huang , Zhi Li , Yanan Sun","doi":"10.1016/j.vlsi.2025.102525","DOIUrl":null,"url":null,"abstract":"<div><div>Hopfield Neural Networks (HNNs) have emerged as a promising paradigm for image restoration tasks with the inner associative memory properties to corrupted image reconstruction. However, traditional HNN accelerators relying on full-precision vector-matrix multiplication (VMM) operations introduce significant computational redundancy, as the binary state updates process of HNNs depend solely on the sign of VMM results rather than their precise values. To address this inefficiency, Hop-CIM, an all-digital approximate SRAM-based computing-in-memory (SRAM-CIM) macro, is proposed for energy-efficient HNN acceleration. The key innovation points of the proposed Hop-CIM include: (1) a two-level approximation strategy that fully exploits the error-tolerant characteristics of HNNs, (2) a data-aware threshold-based early exit mechanism during tile-by-tile partial-sum accumulation, and (3) a partial-sum reuse method with column-wise weight matrix compression. The combined effect of (2) and (3) reduces the redundant multiply-and-accumulate (MAC) operations by 55.7 %. Experimental results demonstrate that under 28 nm technology node, the proposed Hop-CIM macro delivers 1591<em>TOPS/W</em> energy efficiency with 1-bit/1-bit input/weight quantization, outperforming the traditional full-precision SRAM-CIM design with 1-bit/3-bit input/weight quantization and the approximate SRAM-CIM design with 1-bit/1-bit input/weight quantization by 7.72x and 2.48x, respectively. In addition, Hop-CIM achieves 0.944 in structural similarity index measure (<em>SSIM</em>) for 28 × 28 image restoration.</div></div>","PeriodicalId":54973,"journal":{"name":"Integration-The Vlsi Journal","volume":"105 ","pages":"Article 102525"},"PeriodicalIF":2.5000,"publicationDate":"2025-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Integration-The Vlsi Journal","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0167926025001828","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
引用次数: 0
Abstract
Hopfield Neural Networks (HNNs) have emerged as a promising paradigm for image restoration tasks with the inner associative memory properties to corrupted image reconstruction. However, traditional HNN accelerators relying on full-precision vector-matrix multiplication (VMM) operations introduce significant computational redundancy, as the binary state updates process of HNNs depend solely on the sign of VMM results rather than their precise values. To address this inefficiency, Hop-CIM, an all-digital approximate SRAM-based computing-in-memory (SRAM-CIM) macro, is proposed for energy-efficient HNN acceleration. The key innovation points of the proposed Hop-CIM include: (1) a two-level approximation strategy that fully exploits the error-tolerant characteristics of HNNs, (2) a data-aware threshold-based early exit mechanism during tile-by-tile partial-sum accumulation, and (3) a partial-sum reuse method with column-wise weight matrix compression. The combined effect of (2) and (3) reduces the redundant multiply-and-accumulate (MAC) operations by 55.7 %. Experimental results demonstrate that under 28 nm technology node, the proposed Hop-CIM macro delivers 1591TOPS/W energy efficiency with 1-bit/1-bit input/weight quantization, outperforming the traditional full-precision SRAM-CIM design with 1-bit/3-bit input/weight quantization and the approximate SRAM-CIM design with 1-bit/1-bit input/weight quantization by 7.72x and 2.48x, respectively. In addition, Hop-CIM achieves 0.944 in structural similarity index measure (SSIM) for 28 × 28 image restoration.
期刊介绍:
Integration''s aim is to cover every aspect of the VLSI area, with an emphasis on cross-fertilization between various fields of science, and the design, verification, test and applications of integrated circuits and systems, as well as closely related topics in process and device technologies. Individual issues will feature peer-reviewed tutorials and articles as well as reviews of recent publications. The intended coverage of the journal can be assessed by examining the following (non-exclusive) list of topics:
Specification methods and languages; Analog/Digital Integrated Circuits and Systems; VLSI architectures; Algorithms, methods and tools for modeling, simulation, synthesis and verification of integrated circuits and systems of any complexity; Embedded systems; High-level synthesis for VLSI systems; Logic synthesis and finite automata; Testing, design-for-test and test generation algorithms; Physical design; Formal verification; Algorithms implemented in VLSI systems; Systems engineering; Heterogeneous systems.