Taiyi Chen;Yu Huang;Pei Zhou;Penghua Mu;Shuiying Xiang;V. N. Chizhevsky;Nianqiang Li
{"title":"Receptive Field-Based All-Optical Spiking Neural Network for Image Processing","authors":"Taiyi Chen;Yu Huang;Pei Zhou;Penghua Mu;Shuiying Xiang;V. N. Chizhevsky;Nianqiang Li","doi":"10.1109/JQE.2023.3325227","DOIUrl":null,"url":null,"abstract":"We report on a novel structure of a receptive field (RF)-based multi-layer all-optical neural network using a micropillar laser with a saturable absorber (SA) for image processing. From the perspective of biological vision, the realization of image processing based on the RF provides the biological rationality for the machine vision implemented by the spiking neural network (SNN). By exploiting the fast physical mechanisms of gain and absorption in the SA laser, the photonic spike-timing-dependent plasticity (STDP) curves are achieved to train the weights. Here, the source image pixels are mapped into the temporal information of spike trains injected into the neural network through the temporal coding method called time-to-first-spike encoding. Different source images are processed and tested by the proposed photonic SNN. Simulation results show that our proposed system can process not only simple binary images but also complex color images under the adjustment of STDP rules. When considering the robustness, we demonstrate the tolerance of the image segmentation to the time jitter. These results indicate that our proposed photonic SNN can achieve high-resolution processing of complex source images. Additionally, the time-multiplexing technique can be further adopted to simplify the RF structure, which is expected to reduce the complexity of the whole system, thus facilitating physical applications. Our work offers the prospect for a high-speed photonic spiking platform for image processing.","PeriodicalId":13200,"journal":{"name":"IEEE Journal of Quantum Electronics","volume":"60 1","pages":"1-11"},"PeriodicalIF":2.2000,"publicationDate":"2023-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Quantum Electronics","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10288163/","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
We report on a novel structure of a receptive field (RF)-based multi-layer all-optical neural network using a micropillar laser with a saturable absorber (SA) for image processing. From the perspective of biological vision, the realization of image processing based on the RF provides the biological rationality for the machine vision implemented by the spiking neural network (SNN). By exploiting the fast physical mechanisms of gain and absorption in the SA laser, the photonic spike-timing-dependent plasticity (STDP) curves are achieved to train the weights. Here, the source image pixels are mapped into the temporal information of spike trains injected into the neural network through the temporal coding method called time-to-first-spike encoding. Different source images are processed and tested by the proposed photonic SNN. Simulation results show that our proposed system can process not only simple binary images but also complex color images under the adjustment of STDP rules. When considering the robustness, we demonstrate the tolerance of the image segmentation to the time jitter. These results indicate that our proposed photonic SNN can achieve high-resolution processing of complex source images. Additionally, the time-multiplexing technique can be further adopted to simplify the RF structure, which is expected to reduce the complexity of the whole system, thus facilitating physical applications. Our work offers the prospect for a high-speed photonic spiking platform for image processing.
期刊介绍:
The IEEE Journal of Quantum Electronics is dedicated to the publication of manuscripts reporting novel experimental or theoretical results in the broad field of the science and technology of quantum electronics. The Journal comprises original contributions, both regular papers and letters, describing significant advances in the understanding of quantum electronics phenomena or the demonstration of new devices, systems, or applications. Manuscripts reporting new developments in systems and applications must emphasize quantum electronics principles or devices. The scope of JQE encompasses the generation, propagation, detection, and application of coherent electromagnetic radiation having wavelengths below one millimeter (i.e., in the submillimeter, infrared, visible, ultraviolet, etc., regions). Whether the focus of a manuscript is a quantum-electronic device or phenomenon, the critical factor in the editorial review of a manuscript is the potential impact of the results presented on continuing research in the field or on advancing the technological base of quantum electronics.