{"title":"基于 Memristor 的神经形态系统中的对比学习","authors":"Cory Merkel, Alexander Ororbia","doi":"arxiv-2409.10887","DOIUrl":null,"url":null,"abstract":"Spiking neural networks, the third generation of artificial neural networks,\nhave become an important family of neuron-based models that sidestep many of\nthe key limitations facing modern-day backpropagation-trained deep networks,\nincluding their high energy inefficiency and long-criticized biological\nimplausibility. In this work, we design and investigate a proof-of-concept\ninstantiation of contrastive-signal-dependent plasticity (CSDP), a neuromorphic\nform of forward-forward-based, backpropagation-free learning. Our experimental\nsimulations demonstrate that a hardware implementation of CSDP is capable of\nlearning simple logic functions without the need to resort to complex gradient\ncalculations.","PeriodicalId":501517,"journal":{"name":"arXiv - QuanBio - Neurons and Cognition","volume":"18 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Contrastive Learning in Memristor-based Neuromorphic Systems\",\"authors\":\"Cory Merkel, Alexander Ororbia\",\"doi\":\"arxiv-2409.10887\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Spiking neural networks, the third generation of artificial neural networks,\\nhave become an important family of neuron-based models that sidestep many of\\nthe key limitations facing modern-day backpropagation-trained deep networks,\\nincluding their high energy inefficiency and long-criticized biological\\nimplausibility. In this work, we design and investigate a proof-of-concept\\ninstantiation of contrastive-signal-dependent plasticity (CSDP), a neuromorphic\\nform of forward-forward-based, backpropagation-free learning. Our experimental\\nsimulations demonstrate that a hardware implementation of CSDP is capable of\\nlearning simple logic functions without the need to resort to complex gradient\\ncalculations.\",\"PeriodicalId\":501517,\"journal\":{\"name\":\"arXiv - QuanBio - Neurons and Cognition\",\"volume\":\"18 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - QuanBio - Neurons and Cognition\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.10887\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - QuanBio - Neurons and Cognition","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.10887","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Contrastive Learning in Memristor-based Neuromorphic Systems
Spiking neural networks, the third generation of artificial neural networks,
have become an important family of neuron-based models that sidestep many of
the key limitations facing modern-day backpropagation-trained deep networks,
including their high energy inefficiency and long-criticized biological
implausibility. In this work, we design and investigate a proof-of-concept
instantiation of contrastive-signal-dependent plasticity (CSDP), a neuromorphic
form of forward-forward-based, backpropagation-free learning. Our experimental
simulations demonstrate that a hardware implementation of CSDP is capable of
learning simple logic functions without the need to resort to complex gradient
calculations.