Photonic Spiking Neural Networks with Highly Efficient Training Protocols for Ultrafast Neuromorphic Computing Systems

IF 2.2 Q3 COMPUTER SCIENCE, CYBERNETICS
Dafydd Owen-Newns, Joshua Robertson, Matěj Hejda, Antonio Hurtado
{"title":"Photonic Spiking Neural Networks with Highly Efficient Training Protocols for Ultrafast Neuromorphic Computing Systems","authors":"Dafydd Owen-Newns, Joshua Robertson, Matěj Hejda, Antonio Hurtado","doi":"10.34133/icomputing.0031","DOIUrl":null,"url":null,"abstract":"Photonic technologies offer great prospects for novel, ultrafast, energy-efficient, and hardware-friendly neuromorphic (brain-like) computing platforms. Moreover, neuromorphic photonic approaches based on ubiquitous, technology-mature, and low-cost vertical-cavity surface-emitting lasers (VCSELs) (devices found in fiber-optic transmitters, mobile phones, and automotive sensors) are of particular interest. Given that VCSELs have shown the ability to realize neuronal optical spiking responses (at ultrafast GHz rates), their use in spike-based information-processing systems has been proposed. In this study, spiking neural network (SNN) operation, based on a hardware-friendly photonic system of just one VCSEL, is reported alongside a novel binary weight “significance” training scheme that fully capitalizes on the discrete nature of the optical spikes used by the SNN to process input information. The VCSEL-based photonic SNN was tested with a highly complex multivariate classification task (MADELON) before its performance was compared using a traditional least-squares training method and an alternative novel binary weighting scheme. Excellent classification accuracies of >94% were achieved by both training methods, exceeding the benchmark performance of the dataset in a fraction of the processing time. The newly reported training scheme also dramatically reduces the training set size requirements and the number of trained nodes (≤1% of the total network node count). This VCSEL-based photonic SNN, in combination with the reported “significance” weighting scheme, therefore grants ultrafast spike-based optical processing highly reduced training requirements and hardware complexity for potential application in future neuromorphic systems and artificial intelligence applications.","PeriodicalId":45291,"journal":{"name":"International Journal of Intelligent Computing and Cybernetics","volume":null,"pages":null},"PeriodicalIF":2.2000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Intelligent Computing and Cybernetics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.34133/icomputing.0031","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, CYBERNETICS","Score":null,"Total":0}
引用次数: 1

Abstract

Photonic technologies offer great prospects for novel, ultrafast, energy-efficient, and hardware-friendly neuromorphic (brain-like) computing platforms. Moreover, neuromorphic photonic approaches based on ubiquitous, technology-mature, and low-cost vertical-cavity surface-emitting lasers (VCSELs) (devices found in fiber-optic transmitters, mobile phones, and automotive sensors) are of particular interest. Given that VCSELs have shown the ability to realize neuronal optical spiking responses (at ultrafast GHz rates), their use in spike-based information-processing systems has been proposed. In this study, spiking neural network (SNN) operation, based on a hardware-friendly photonic system of just one VCSEL, is reported alongside a novel binary weight “significance” training scheme that fully capitalizes on the discrete nature of the optical spikes used by the SNN to process input information. The VCSEL-based photonic SNN was tested with a highly complex multivariate classification task (MADELON) before its performance was compared using a traditional least-squares training method and an alternative novel binary weighting scheme. Excellent classification accuracies of >94% were achieved by both training methods, exceeding the benchmark performance of the dataset in a fraction of the processing time. The newly reported training scheme also dramatically reduces the training set size requirements and the number of trained nodes (≤1% of the total network node count). This VCSEL-based photonic SNN, in combination with the reported “significance” weighting scheme, therefore grants ultrafast spike-based optical processing highly reduced training requirements and hardware complexity for potential application in future neuromorphic systems and artificial intelligence applications.
超高速神经形态计算系统中具有高效训练协议的光子脉冲神经网络
光子技术为新型、超快、节能、硬件友好的神经形态(类脑)计算平台提供了巨大的前景。此外,基于无处不在、技术成熟、低成本的垂直腔面发射激光器(VCSELs)(光纤发射器、移动电话和汽车传感器中的设备)的神经形态光子方法尤其令人感兴趣。鉴于vcsel已经显示出实现神经元光尖峰响应(超快GHz速率)的能力,已经提出将其用于基于尖峰的信息处理系统。在本研究中,基于仅一个VCSEL的硬件友好光子系统的尖峰神经网络(SNN)运行,以及一种新的二元权重“显著性”训练方案,该方案充分利用了SNN用于处理输入信息的光学尖峰的离散性质。利用高度复杂的多元分类任务(MADELON)对基于vcsel的光子SNN进行了测试,然后使用传统的最小二乘训练方法和一种新的替代二元加权方案对其性能进行了比较。两种训练方法的分类准确率都达到了>94%,在一小部分处理时间内超过了数据集的基准性能。新报道的训练方案还显著降低了训练集的大小要求和训练节点的数量(≤网络总节点数的1%)。这种基于vcsel的光子SNN,结合报道的“显著性”加权方案,因此为未来神经形态系统和人工智能应用的潜在应用提供了基于超快尖峰的光学处理,大大降低了训练要求和硬件复杂性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
6.80
自引率
4.70%
发文量
26
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信