Atomically bio-plausible neuron toward complex neuromorphic applications

Brain-X Pub Date : 2023-12-10 DOI:10.1002/brx2.44
Song Hao, Yanfang Niu, Shancheng Han
{"title":"Atomically bio-plausible neuron toward complex neuromorphic applications","authors":"Song Hao,&nbsp;Yanfang Niu,&nbsp;Shancheng Han","doi":"10.1002/brx2.44","DOIUrl":null,"url":null,"abstract":"<p>Neuromorphic computing, benefitting from its integration of computing with memory, enables highly efficient parallel-computing capabilities. While artificial intelligence chips are expensive due to their large area and power consumption, neuromorphic devices have shown energy efficiency and compatibility with complementary metal-oxide-semiconductor transistor technology.<span><sup>1</sup></span> Complex neuronal circuits with feedforward and feedback topologies are the foundation for nonlinear information integration and processing in the human brain. In addition, the nonlinear integration of neuronal signals as the basic functions of the human brain's nervous system is also essential to implement machine learning. However, artificial neurons still face the challenge of nonlinearly integrating feedforward and feedback signals. It is crucial to develop bio-plausible neurons capable of those functions, including nonlinearity and integration of excitatory and inhibitory postsynaptic signals. Writing in Nature Nanotechnology, G. S. Syed and coworkers recently reported a major step toward bio-plausible optomemristive feedback neurons, enabling the simultaneous existence of separate feedforward and feedback paths within a neural network.<span><sup>2</sup></span></p><p>The authors designed a delicate capacitor-like device with a 2D vertical heterostructure in which WS<sub>2</sub>/MoS<sub>2</sub> and graphene served as the neuronal membrane and soma (Figure 1B), respectively. Generally, trapped electrons and holes in the WS<sub>2</sub>/MoS<sub>2</sub> heterostructure recombine upon a positive back gate voltage (Figure 1A). The conductance state of p-doped graphene would further increase, representing an excitatory operation. In this work, the electron-hole carriers in the WS<sub>2</sub>/MoS<sub>2</sub> heterostructure are easily separated upon illumination (Figure 1C), and the electrons are injected into graphene. The Fermi-level movement toward the Dirac point decreases the conductance of graphene, having an inhibitory effect. Specifically, graphene's gradual conductance change can be separately modulated through electrical and optical means (Figure 1D), mimicking excitatory and inhibitory functionalities. 2D memristors have been investigated to emulate leaky-integrate-and-fire feedforward neurons.<span><sup>3</sup></span> The synergistic effect of both input signals mimics a competitive neuron and enables the simultaneous existence of separate feedforward and feedback paths within the neural network.</p><p>The winner-take-all (WTA) neural network is a critical computational model for artificial neural networks, which can be used to implement unsupervised competitive learning and cooperative learning. The traditional memristors make it difficult to separately process feedforward and feedback neuronal signals, necessitating peripheral circuits or software to mimic inhibition behavior. The developed optomemristive feedback neuron can respond to both electrical and optical stimulation and broadcast inhibitory signals on neighboring neurons and nonlinear integrated neuronal signals. Therefore, the authors further created a WTA neural network to demonstrate its superiority (Figure 1E) in which WTA neurons comprise the output layer of the neural network, acting as a rectifier activation function. The WTA neural networks implement the neuronal signal accumulation and activation tasks and demonstrate the potential for unsupervised competitive learning and cooperative learning.</p><p>It has been demonstrated that 2D materials facilitate the construction of multi-terminal memtransistors for complex neuromorphic functions.<span><sup>4</sup></span> Neuromorphic perception devices such as the artificial retina could be emulated by leveraging their excellent photoresponsivity.<span><sup>5</sup></span> This work greatly advances the hardware implementation of bio-plausible neuromorphic devices and highlights important routes to solve complex tasks by developing WTA neuronal networks. The charge trapping effect is essential to realizing the negative photoresponsivity of 2D materials and the ability to process feedback neuronal signals. Treating the SiO<sub>2</sub>/Si substrate or directly depositing the Al<sub>2</sub>O<sub>3</sub> layer are two common approaches to introduce the trapping effect, which is an efficient way to realize negative photoresponsivity toward optomemristive feedback neurons. The unique device structure and vdW heterostructure innovation are also responsible for those fascinating properties.</p><p>The spatiotemporal complexity of the human brain cortex and its neural networks is the basis for the higher intelligence of humans. Despite the progress made in this work, there is a vast gap between neuromorphic computing and the human brain due to their differences, including structure, working mechanisms, and scale. In addition, we consider that a brain-like design in terms of working mechanisms, device connectivity complexity, and scale is an effective and even necessary way to achieve complex neuromorphic applications. Memristive devices with neuron-like structures and memristive mechanisms are greatly needed to faithfully emulate biological neuron functions.</p><p><b>Song Hao</b>: Conceptualization, Formal analysis, Funding acquisition, Project administration, Validation, Writing—review and editing; <b>Yanfang Niu</b>: Data curation, Funding acquisition, Resources, Writing—review and editing; <b>Shancheng Han</b>: Data curation, Writing—original draft.</p><p>The authors declare no conflicts of interest.</p><p>Ethics approval was not needed for this study.</p>","PeriodicalId":94303,"journal":{"name":"Brain-X","volume":"1 4","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/brx2.44","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Brain-X","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/brx2.44","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Neuromorphic computing, benefitting from its integration of computing with memory, enables highly efficient parallel-computing capabilities. While artificial intelligence chips are expensive due to their large area and power consumption, neuromorphic devices have shown energy efficiency and compatibility with complementary metal-oxide-semiconductor transistor technology.1 Complex neuronal circuits with feedforward and feedback topologies are the foundation for nonlinear information integration and processing in the human brain. In addition, the nonlinear integration of neuronal signals as the basic functions of the human brain's nervous system is also essential to implement machine learning. However, artificial neurons still face the challenge of nonlinearly integrating feedforward and feedback signals. It is crucial to develop bio-plausible neurons capable of those functions, including nonlinearity and integration of excitatory and inhibitory postsynaptic signals. Writing in Nature Nanotechnology, G. S. Syed and coworkers recently reported a major step toward bio-plausible optomemristive feedback neurons, enabling the simultaneous existence of separate feedforward and feedback paths within a neural network.2

The authors designed a delicate capacitor-like device with a 2D vertical heterostructure in which WS2/MoS2 and graphene served as the neuronal membrane and soma (Figure 1B), respectively. Generally, trapped electrons and holes in the WS2/MoS2 heterostructure recombine upon a positive back gate voltage (Figure 1A). The conductance state of p-doped graphene would further increase, representing an excitatory operation. In this work, the electron-hole carriers in the WS2/MoS2 heterostructure are easily separated upon illumination (Figure 1C), and the electrons are injected into graphene. The Fermi-level movement toward the Dirac point decreases the conductance of graphene, having an inhibitory effect. Specifically, graphene's gradual conductance change can be separately modulated through electrical and optical means (Figure 1D), mimicking excitatory and inhibitory functionalities. 2D memristors have been investigated to emulate leaky-integrate-and-fire feedforward neurons.3 The synergistic effect of both input signals mimics a competitive neuron and enables the simultaneous existence of separate feedforward and feedback paths within the neural network.

The winner-take-all (WTA) neural network is a critical computational model for artificial neural networks, which can be used to implement unsupervised competitive learning and cooperative learning. The traditional memristors make it difficult to separately process feedforward and feedback neuronal signals, necessitating peripheral circuits or software to mimic inhibition behavior. The developed optomemristive feedback neuron can respond to both electrical and optical stimulation and broadcast inhibitory signals on neighboring neurons and nonlinear integrated neuronal signals. Therefore, the authors further created a WTA neural network to demonstrate its superiority (Figure 1E) in which WTA neurons comprise the output layer of the neural network, acting as a rectifier activation function. The WTA neural networks implement the neuronal signal accumulation and activation tasks and demonstrate the potential for unsupervised competitive learning and cooperative learning.

It has been demonstrated that 2D materials facilitate the construction of multi-terminal memtransistors for complex neuromorphic functions.4 Neuromorphic perception devices such as the artificial retina could be emulated by leveraging their excellent photoresponsivity.5 This work greatly advances the hardware implementation of bio-plausible neuromorphic devices and highlights important routes to solve complex tasks by developing WTA neuronal networks. The charge trapping effect is essential to realizing the negative photoresponsivity of 2D materials and the ability to process feedback neuronal signals. Treating the SiO2/Si substrate or directly depositing the Al2O3 layer are two common approaches to introduce the trapping effect, which is an efficient way to realize negative photoresponsivity toward optomemristive feedback neurons. The unique device structure and vdW heterostructure innovation are also responsible for those fascinating properties.

The spatiotemporal complexity of the human brain cortex and its neural networks is the basis for the higher intelligence of humans. Despite the progress made in this work, there is a vast gap between neuromorphic computing and the human brain due to their differences, including structure, working mechanisms, and scale. In addition, we consider that a brain-like design in terms of working mechanisms, device connectivity complexity, and scale is an effective and even necessary way to achieve complex neuromorphic applications. Memristive devices with neuron-like structures and memristive mechanisms are greatly needed to faithfully emulate biological neuron functions.

Song Hao: Conceptualization, Formal analysis, Funding acquisition, Project administration, Validation, Writing—review and editing; Yanfang Niu: Data curation, Funding acquisition, Resources, Writing—review and editing; Shancheng Han: Data curation, Writing—original draft.

The authors declare no conflicts of interest.

Ethics approval was not needed for this study.

Abstract Image

面向复杂神经形态应用的原子仿生神经元
神经形态计算得益于计算与内存的整合,可实现高效的并行计算能力。人工智能芯片由于面积大、功耗高而价格昂贵,而神经形态设备则显示出了能源效率和与互补金属氧化物半导体晶体管技术的兼容性。1 具有前馈和反馈拓扑结构的复杂神经元电路是人脑非线性信息整合与处理的基础。此外,神经元信号的非线性整合作为人脑神经系统的基本功能,对于实现机器学习也至关重要。然而,人工神经元仍然面临着前馈和反馈信号非线性整合的挑战。开发能够实现这些功能(包括非线性和整合兴奋性和抑制性突触后信号)的仿生神经元至关重要。G. S. Syed 及其同事最近在《自然-纳米技术》(Nature Nanotechnology)杂志上撰文指出,他们向生物仿真光敏反馈神经元迈出了重要一步,使神经网络中同时存在独立的前馈和反馈路径2 。一般来说,WS2/MoS2 异质结构中的俘获电子和空穴会在正背栅电压下重新结合(图 1A)。掺杂 p 的石墨烯的传导状态会进一步增加,这代表了一种激发操作。在这项工作中,WS2/MoS2 异质结构中的电子-空穴载流子在光照下很容易分离(图 1C),电子被注入石墨烯。费米级向狄拉克点的移动会降低石墨烯的电导,从而产生抑制作用。具体来说,石墨烯的电导渐变可通过电学和光学手段分别调制(图 1D),从而模拟兴奋和抑制功能。3 两种输入信号的协同效应模拟了竞争性神经元,使神经网络中同时存在独立的前馈和反馈路径。赢家通吃(WTA)神经网络是人工神经网络的重要计算模型,可用于实现无监督竞争学习和合作学习。传统的忆阻器难以单独处理前馈和反馈神经元信号,因此需要外围电路或软件来模拟抑制行为。所开发的光敏忆阻器反馈神经元能对电刺激和光刺激做出反应,并向邻近神经元播发抑制信号和非线性综合神经元信号。因此,作者进一步创建了一个 WTA 神经网络来证明其优越性(图 1E),其中 WTA 神经元组成神经网络的输出层,充当整流激活函数。WTA 神经网络实现了神经元信号积累和激活任务,并展示了无监督竞争学习和合作学习的潜力。已有研究表明,二维材料有助于构建多端忆晶体管,以实现复杂的神经形态功能。电荷捕获效应对于实现二维材料的负光致发光性和处理反馈神经元信号的能力至关重要。处理 SiO2/Si 衬底或直接沉积 Al2O3 层是引入捕获效应的两种常用方法,这也是实现光敏反馈神经元负光致发光性的有效途径。人脑皮层及其神经网络的时空复杂性是人类拥有更高智力的基础。尽管这项工作取得了进展,但由于神经形态计算与人脑在结构、工作机制和规模等方面的差异,两者之间仍存在巨大差距。此外,我们认为,在工作机制、设备连接复杂性和规模方面采用类脑设计是实现复杂神经形态应用的有效甚至必要途径。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信