{"title":"AttnACQ: Attentioned-AutoCorrelation-Based Query for Hyperdimensional Associative Memory","authors":"Tianyang Yu;Bi Wu;Ke Chen;Gong Zhang;Weiqiang Liu","doi":"10.1109/TCSII.2024.3434562","DOIUrl":null,"url":null,"abstract":"The low power and latency of hyperdimensional associative memory (HAM) promotes hyperdimensional computing (HDC)’s efficiency. However, overheads of HAM can be hardly further reduced, since HAM needs to store all class hypervectors, and complete the similarity calculation between them and the input sample hypervector. To address this issue, an attentioned-autocorrelation based query method called AttnACQ is proposed to avoid the storage and operations corresponding to class hypervectors. Furthermore, levearging SOT-MRAM’s ultra-low read/write delay, a high-efficient HAM matching to AttnACQ is proposed. Experiments show that this AttnACQ boosted HAM saves more than 95% area and 50% latency.","PeriodicalId":13101,"journal":{"name":"IEEE Transactions on Circuits and Systems II: Express Briefs","volume":"71 12","pages":"4984-4988"},"PeriodicalIF":4.0000,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Circuits and Systems II: Express Briefs","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10612822/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
The low power and latency of hyperdimensional associative memory (HAM) promotes hyperdimensional computing (HDC)’s efficiency. However, overheads of HAM can be hardly further reduced, since HAM needs to store all class hypervectors, and complete the similarity calculation between them and the input sample hypervector. To address this issue, an attentioned-autocorrelation based query method called AttnACQ is proposed to avoid the storage and operations corresponding to class hypervectors. Furthermore, levearging SOT-MRAM’s ultra-low read/write delay, a high-efficient HAM matching to AttnACQ is proposed. Experiments show that this AttnACQ boosted HAM saves more than 95% area and 50% latency.
期刊介绍:
TCAS II publishes brief papers in the field specified by the theory, analysis, design, and practical implementations of circuits, and the application of circuit techniques to systems and to signal processing. Included is the whole spectrum from basic scientific theory to industrial applications. The field of interest covered includes:
Circuits: Analog, Digital and Mixed Signal Circuits and Systems
Nonlinear Circuits and Systems, Integrated Sensors, MEMS and Systems on Chip, Nanoscale Circuits and Systems, Optoelectronic
Circuits and Systems, Power Electronics and Systems
Software for Analog-and-Logic Circuits and Systems
Control aspects of Circuits and Systems.