组合学习策略提高尖峰神经形态系统能效的潜力

Ali Shiri Sichani, Sai Kankatala
{"title":"组合学习策略提高尖峰神经形态系统能效的潜力","authors":"Ali Shiri Sichani, Sai Kankatala","doi":"arxiv-2408.07150","DOIUrl":null,"url":null,"abstract":"Ensuring energy-efficient design in neuromorphic computing systems\nnecessitates a tailored architecture combined with algorithmic approaches. This\nmanuscript focuses on enhancing brain-inspired perceptual computing machines\nthrough a novel combined learning approach for Convolutional Spiking Neural\nNetworks (CSNNs). CSNNs present a promising alternative to traditional\npower-intensive and complex machine learning methods like backpropagation,\noffering energy-efficient spiking neuron processing inspired by the human\nbrain. The proposed combined learning method integrates Pair-based Spike\nTiming-Dependent Plasticity (PSTDP) and power law-dependent\nSpike-timing-dependent plasticity (STDP) to adjust synaptic efficacies,\nenabling the utilization of stochastic elements like memristive devices to\nenhance energy efficiency and improve perceptual computing accuracy. By\nreducing learning parameters while maintaining accuracy, these systems consume\nless energy and have reduced area overhead, making them more suitable for\nhardware implementation. The research delves into neuromorphic design\narchitectures, focusing on CSNNs to provide a general framework for\nenergy-efficient computing hardware. Various CSNN architectures are evaluated\nto assess how less trainable parameters can maintain acceptable accuracy in\nperceptual computing systems, positioning them as viable candidates for\nneuromorphic architecture. Comparisons with previous work validate the\nachievements and methodology of the proposed architecture.","PeriodicalId":501347,"journal":{"name":"arXiv - CS - Neural and Evolutionary Computing","volume":"28 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The Potential of Combined Learning Strategies to Enhance Energy Efficiency of Spiking Neuromorphic Systems\",\"authors\":\"Ali Shiri Sichani, Sai Kankatala\",\"doi\":\"arxiv-2408.07150\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Ensuring energy-efficient design in neuromorphic computing systems\\nnecessitates a tailored architecture combined with algorithmic approaches. This\\nmanuscript focuses on enhancing brain-inspired perceptual computing machines\\nthrough a novel combined learning approach for Convolutional Spiking Neural\\nNetworks (CSNNs). CSNNs present a promising alternative to traditional\\npower-intensive and complex machine learning methods like backpropagation,\\noffering energy-efficient spiking neuron processing inspired by the human\\nbrain. The proposed combined learning method integrates Pair-based Spike\\nTiming-Dependent Plasticity (PSTDP) and power law-dependent\\nSpike-timing-dependent plasticity (STDP) to adjust synaptic efficacies,\\nenabling the utilization of stochastic elements like memristive devices to\\nenhance energy efficiency and improve perceptual computing accuracy. By\\nreducing learning parameters while maintaining accuracy, these systems consume\\nless energy and have reduced area overhead, making them more suitable for\\nhardware implementation. The research delves into neuromorphic design\\narchitectures, focusing on CSNNs to provide a general framework for\\nenergy-efficient computing hardware. Various CSNN architectures are evaluated\\nto assess how less trainable parameters can maintain acceptable accuracy in\\nperceptual computing systems, positioning them as viable candidates for\\nneuromorphic architecture. Comparisons with previous work validate the\\nachievements and methodology of the proposed architecture.\",\"PeriodicalId\":501347,\"journal\":{\"name\":\"arXiv - CS - Neural and Evolutionary Computing\",\"volume\":\"28 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-08-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Neural and Evolutionary Computing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2408.07150\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Neural and Evolutionary Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2408.07150","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

要确保神经形态计算系统的高能效设计,就必须将量身定制的架构与算法方法相结合。这篇手稿的重点是通过针对卷积尖峰神经网络(CSNN)的新型组合学习方法来增强大脑启发的感知计算机器。卷积尖峰神经网络(CSNN)是反向传播(backpropagation)等传统耗能且复杂的机器学习方法的一种有前途的替代方法,它提供了受人脑启发的高能效尖峰神经元处理方法。所提出的组合学习方法整合了基于配对的尖峰计时可塑性(PSTDP)和基于幂律的尖峰计时可塑性(STDP)来调整突触效率,从而能够利用随机元素(如记忆器件)来提高能效和感知计算精度。通过在保持准确性的同时降低学习参数,这些系统无需消耗能源,并减少了面积开销,因此更适合硬件实施。该研究深入研究了神经形态设计架构,重点关注 CSNN,为高能效计算硬件提供了一个通用框架。研究评估了各种 CSNN 架构,以评估在感知计算系统中,如何利用较少的可训练参数来保持可接受的准确性,从而将它们定位为神经形态架构的可行候选方案。与以前工作的比较验证了所提架构的成就和方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
The Potential of Combined Learning Strategies to Enhance Energy Efficiency of Spiking Neuromorphic Systems
Ensuring energy-efficient design in neuromorphic computing systems necessitates a tailored architecture combined with algorithmic approaches. This manuscript focuses on enhancing brain-inspired perceptual computing machines through a novel combined learning approach for Convolutional Spiking Neural Networks (CSNNs). CSNNs present a promising alternative to traditional power-intensive and complex machine learning methods like backpropagation, offering energy-efficient spiking neuron processing inspired by the human brain. The proposed combined learning method integrates Pair-based Spike Timing-Dependent Plasticity (PSTDP) and power law-dependent Spike-timing-dependent plasticity (STDP) to adjust synaptic efficacies, enabling the utilization of stochastic elements like memristive devices to enhance energy efficiency and improve perceptual computing accuracy. By reducing learning parameters while maintaining accuracy, these systems consume less energy and have reduced area overhead, making them more suitable for hardware implementation. The research delves into neuromorphic design architectures, focusing on CSNNs to provide a general framework for energy-efficient computing hardware. Various CSNN architectures are evaluated to assess how less trainable parameters can maintain acceptable accuracy in perceptual computing systems, positioning them as viable candidates for neuromorphic architecture. Comparisons with previous work validate the achievements and methodology of the proposed architecture.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信