{"title":"Contrastive Learning in Memristor-based Neuromorphic Systems","authors":"Cory Merkel, Alexander Ororbia","doi":"arxiv-2409.10887","DOIUrl":null,"url":null,"abstract":"Spiking neural networks, the third generation of artificial neural networks,\nhave become an important family of neuron-based models that sidestep many of\nthe key limitations facing modern-day backpropagation-trained deep networks,\nincluding their high energy inefficiency and long-criticized biological\nimplausibility. In this work, we design and investigate a proof-of-concept\ninstantiation of contrastive-signal-dependent plasticity (CSDP), a neuromorphic\nform of forward-forward-based, backpropagation-free learning. Our experimental\nsimulations demonstrate that a hardware implementation of CSDP is capable of\nlearning simple logic functions without the need to resort to complex gradient\ncalculations.","PeriodicalId":501517,"journal":{"name":"arXiv - QuanBio - Neurons and Cognition","volume":"18 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - QuanBio - Neurons and Cognition","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.10887","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Spiking neural networks, the third generation of artificial neural networks,
have become an important family of neuron-based models that sidestep many of
the key limitations facing modern-day backpropagation-trained deep networks,
including their high energy inefficiency and long-criticized biological
implausibility. In this work, we design and investigate a proof-of-concept
instantiation of contrastive-signal-dependent plasticity (CSDP), a neuromorphic
form of forward-forward-based, backpropagation-free learning. Our experimental
simulations demonstrate that a hardware implementation of CSDP is capable of
learning simple logic functions without the need to resort to complex gradient
calculations.