Harshvardhan Uppaluru, Zoe Templin, Mohammed Rafeeq Khan, Md Omar Faruque, Feng Zhao, Jinhui Wang
{"title":"256-level honey memristor-based in-memory neuromorphic system","authors":"Harshvardhan Uppaluru, Zoe Templin, Mohammed Rafeeq Khan, Md Omar Faruque, Feng Zhao, Jinhui Wang","doi":"10.1049/ell2.70029","DOIUrl":"https://doi.org/10.1049/ell2.70029","url":null,"abstract":"<p>Promising synaptic behaviour has been exhibited by memristors based on natural organic materials. Such memristor-based neuromorphic systems offer notable benefits, including environmental sustainability, low production and disposal costs, non-volatile storage capability, and bio/Complementary Metal-Oxide-Semiconductor (CMOS) compatibility. Here, a 256-level honey memristor-based neuromorphic system is experimentally evaluated for image recognition. In detail, first, 256-level honey memristors are manufactured and tested based on in-house technology; next, the non-linear characteristics and inherent variation of honey memristor devices, which lead to imprecise weight updates and limit the inference accuracy, are investigated. Experimental results indicate that the inference accuracy of the 256-level honey memristor-based neuromorphic system is greater than 88% without cycle-to-cycle variations and 87% with cycle-to-cycle variations for different optimization algorithms. The overall performance of optimization algorithms with and without variation is compared in terms of energy and latency, where the momentum algorithm consistently outperforms the rest of the algorithms. This 256-level honey memristor is a promising alternative enabling sustainable neuromorphic systems, encouraging further research into natural organic materials for neuromorphic computing.</p>","PeriodicalId":11556,"journal":{"name":"Electronics Letters","volume":"60 17","pages":""},"PeriodicalIF":0.7,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ell2.70029","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142231102","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Heming Zhang, S Peter Goedegebuure, Li Ding, David DeNardo, Ryan C Fields, Yixin Chen, Philip Payne, Fuhai Li
{"title":"M3NetFlow: A novel multi-scale multi-hop graph AI model for integrative multi-omic data analysis.","authors":"Heming Zhang, S Peter Goedegebuure, Li Ding, David DeNardo, Ryan C Fields, Yixin Chen, Philip Payne, Fuhai Li","doi":"10.1101/2023.06.15.545130","DOIUrl":"10.1101/2023.06.15.545130","url":null,"abstract":"<p><p>Multi-omic data-driven studies, characterizing complex disease signaling system from multiple levels, are at the forefront of precision medicine and healthcare. The integration and interpretation of multi-omic data are essential for identifying molecular targets and deciphering core signaling pathways of complex diseases. However, it remains an open problem due the large number of biomarkers and complex interactions among them. In this study, we propose a novel Multi-scale Multi-hop Multi-omic graph model, <i>M3NetFlow</i>, to facilitate generic multi-omic data analysis to rank targets and infer core signaling flows/pathways. To evaluate M3NetFlow, we applied it in two independent multi-omic case studies: 1) uncovering mechanisms of synergistic drug combination response (defined as anchor-target guided learning), and 2) identifying biomarkers and pathways of Alzheimer 's disease (AD). The evaluation and comparison results showed <i>M3NetFlow</i> achieves the best prediction accuracy (accurate), and identifies a set of essential targets and core signaling pathways (interpretable). The model can be directly applied to other multi-omic data-driven studies. The code is publicly accessible at: https://github.com/FuhaiLiAiLab/M3NetFlow.</p>","PeriodicalId":11556,"journal":{"name":"Electronics Letters","volume":"30 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11398409/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80591026","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A lightweight transformer with linear self-attention for defect recognition","authors":"Yuwen Zhai, Xinyu Li, Liang Gao, Yiping Gao","doi":"10.1049/ell2.13292","DOIUrl":"https://doi.org/10.1049/ell2.13292","url":null,"abstract":"<p>Visual defect recognition techniques based on deep learning models are crucial for modern industrial quality inspection. The backbone, serving as the primary feature extraction component of the defect recognition model, has not been thoroughly exploited. High-performance vision transformer (ViT) is less adopted due to high computational complexity and limitations of computational resources and storage hardware in industrial scenarios. This paper presents LSA-Former, a lightweight transformer architectural backbone that integrates the benefits of convolution and ViT. LSA-Former proposes a novel self-attention with linear computational complexity, enabling it to capture local and global semantic features with fewer parameters. LSA-Former is pre-trained on ImageNet-1K and surpasses state-of-the-art methods. LSA-Former is employed as the backbone for various detectors, evaluated specifically on the PCB defect detection task. The proposed method reduces at least 18M parameters and exceeds the baseline by more than 2.2 mAP.</p>","PeriodicalId":11556,"journal":{"name":"Electronics Letters","volume":"60 17","pages":""},"PeriodicalIF":0.7,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ell2.13292","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142169953","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hao Niu, Fengming Luo, Bo Yuan, Yi Zhang, Jianyong Wang
{"title":"Efficient visual transformer transferring from neural ODE perspective","authors":"Hao Niu, Fengming Luo, Bo Yuan, Yi Zhang, Jianyong Wang","doi":"10.1049/ell2.70015","DOIUrl":"https://doi.org/10.1049/ell2.70015","url":null,"abstract":"<p>Recently, the Visual Image Transformer (ViT) has revolutionized various domains in computer vision. The transfer of pre-trained ViT models on large-scale datasets has proven to be a promising method for downstream tasks. However, traditional transfer methods introduce numerous additional parameters in transformer blocks, posing new challenges in learning downstream tasks. This article proposes an efficient transfer method from the perspective of neural Ordinary Differential Equations (ODEs) to address this issue. On the one hand, the residual connections in the transformer layers can be interpreted as the numerical integration of differential equations. Therefore, the transformer block can be described as two explicit Euler method equations. By dynamically learning the step size in the explicit Euler equation, a highly lightweight method for transferring the transformer block is obtained. On the other hand, a new learnable neural memory ODE block is proposed by taking inspiration from the self-inhibition mechanism in neural systems. It increases the diversity of dynamical behaviours of the neurons to transfer the head block efficiently and enhances non-linearity simultaneously. Experimental results in image classification demonstrate that the proposed approach can effectively transfer ViT models and outperform state-of-the-art methods.</p>","PeriodicalId":11556,"journal":{"name":"Electronics Letters","volume":"60 17","pages":""},"PeriodicalIF":0.7,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ell2.70015","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142169948","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Sparse representation for massive MIMO satellite channel based on joint dictionary learning","authors":"Qing yang Guan, Shuang Wu","doi":"10.1049/ell2.70021","DOIUrl":"https://doi.org/10.1049/ell2.70021","url":null,"abstract":"<p>A constrained joint dictionary learning (CJDL) algorithm for high-precision channel representation in massive multiple input multiple output (MIMO) satellite systems is proposed. Furthermore, taking into account the angular reciprocity of massive MIMO satellite systems, joint dictionary learning can establish a common support basis for both uplink and downlink. Previous deterministic dictionary has utilized deterministic basis, such as discrete Fourier transform (DFT) or orthogonal DFT (ODFT) basis, which tend to represent noise interference as part of channel characteristics. Furthermore, this deterministic dictionary is not able to adapt to dynamic communication environments. However, dictionary learning has shown the potential to significantly improve the accuracy of channel representation. Nevertheless, current research on training dictionary lacks analysis regarding constraints and boundary requirements, resulting in a suboptimal basis. To address this issue, conditional constraints associated with joint dictionary for channel representation are analysed. To screen for optimal basis, the joint dictionary is subject to constraints, including uplink and downlink constraints. Furthermore, the authors aim to quantify the maximum boundary of joint dictionary learning. Additionally, a joint dictionary updating method with singular value decomposition under constraint boundary conditions is proposed. Simulation results demonstrate that the proposed CJDL algorithm provides a more accurate and robust channel representation.</p>","PeriodicalId":11556,"journal":{"name":"Electronics Letters","volume":"60 17","pages":""},"PeriodicalIF":0.7,"publicationDate":"2024-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ell2.70021","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142158542","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Low-complexity algorithms for generating frequency hopping sequences with good aperiodic hamming correlation property","authors":"Shifu Yang, Zhe Xu, Kaichuang Jiang, Xing Liu","doi":"10.1049/ell2.70006","DOIUrl":"https://doi.org/10.1049/ell2.70006","url":null,"abstract":"<p>In this letter, novel methods for quickly generating frequency hopping (FH) sequences with good out-of-phase peak aperiodic Hamming auto-correlation (PAHAC) property are proposed. Compared with brute-force search algorithm, the proposed algorithms have an obvious advantage on their time complexity. Results show that the algorithms can generate FH sequences with optimal/quasi-optimal PAHAC performance in all tested cases.</p>","PeriodicalId":11556,"journal":{"name":"Electronics Letters","volume":"60 17","pages":""},"PeriodicalIF":0.7,"publicationDate":"2024-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ell2.70006","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142158543","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Wireless quantum optical communications with uncorrelated scattering multipath reception","authors":"Peter Jung, Guido Horst Bruck","doi":"10.1049/ell2.70022","DOIUrl":"https://doi.org/10.1049/ell2.70022","url":null,"abstract":"<p>Wireless quantum optical communications over multipath channels with uncorrelated scattering still seem to be an open issue, although classical optical transmission was already considered, however, neglecting Bose–Einstein distributed thermal noise photons, leading to results that cannot be applied here. A viable way forward is proposed.</p>","PeriodicalId":11556,"journal":{"name":"Electronics Letters","volume":"60 17","pages":""},"PeriodicalIF":0.7,"publicationDate":"2024-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ell2.70022","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142158541","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A novel security-based adaptive reconfigurable intelligent surfaces assisted clustering strategy","authors":"Yue Tian, Xiaofan Zheng","doi":"10.1049/ell2.70008","DOIUrl":"https://doi.org/10.1049/ell2.70008","url":null,"abstract":"<p>Reconfigurable intelligent surfaces (RISs) have attracted a great deal of interest due to the potential contributions to the next-generation wireless networks. This letter proposes an enhancement to the physical layer security (PLS) of a multi-hop RIS-assisted underwater optical wireless communication (UOWC) system. Owing to the complexity of the underwater environment, a security-based adaptive RIS (SA-RIS) clustering strategy, which aims to reflect optical signals among clusters to improve the performance of the overall system, is evaluated. By combining the underwater channel model, the closed-form expressions of probability density function (PDF) and cumulative distribution function (CDF) are derived. Moreover, by increasing the numbers of RIS clusters, the performance metrics such as secrecy outage probability (SOP) and average secrecy capacity (ASC) are evaluated under different scenarios. The obtained results demonstrated that, in contrast to the case without preventing the eavesdropper, the proposed strategy in evasion scenarios could improve the SOP significantly. It can be concluded that the system secrecy performances are further improved by assigning different RIS clusters with proper channel quality.</p>","PeriodicalId":11556,"journal":{"name":"Electronics Letters","volume":"60 17","pages":""},"PeriodicalIF":0.7,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ell2.70008","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142137827","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jie Li, Kun Wang, Zhiyuan Li, Bingchen Zhang, Yirong Wu
{"title":"Tomographic SAR imaging via generative adversarial neural network with cascaded U-Net architecture","authors":"Jie Li, Kun Wang, Zhiyuan Li, Bingchen Zhang, Yirong Wu","doi":"10.1049/ell2.13211","DOIUrl":"https://doi.org/10.1049/ell2.13211","url":null,"abstract":"<p>Tomographic synthetic aperture radar is an advanced multi-channel interferometric technique for retrieving 3-D spatial information. It can be regarded as an inherently sparse reconstruction problem and can be solved using compressive sensing algorithms. However, the performances are limited by the number of acquisitions and suffer from computational burdens in practice. This paper proposes a novel method based on deep learning, which is carried out and optimized in an end-to-end manner by the generative adversarial neural networks. The proposed method applies the cascaded U-Net architectures to achieve the reconstruction of full-channel synthetic aperture radar images and the refinement of obtained tomographic results, respectively. The proposed network is trained using simulated data and validate the technique on simulated and real data. The tests show promising results with the limited number of acquisitions while reducing the computation time.</p>","PeriodicalId":11556,"journal":{"name":"Electronics Letters","volume":"60 17","pages":""},"PeriodicalIF":0.7,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ell2.13211","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142137830","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"STFormer: Spatio-temporal former for hand–object interaction recognition from egocentric RGB video","authors":"Jiao Liang, Xihan Wang, Jiayi Yang, Quanli Gao","doi":"10.1049/ell2.70010","DOIUrl":"https://doi.org/10.1049/ell2.70010","url":null,"abstract":"<p>In recent years, video-based hand–object interaction has received widespread attention from researchers. However, due to the complexity and occlusion of hand movements, hand–object interaction recognition based on RGB videos remains a highly challenging task. Here, an end-to-end spatio-temporal former (STFormer) network for understanding hand behaviour in interactions is proposed. The network consists of three modules: FlexiViT feature extraction, hand–object pose estimator, and interaction action classifier. The FlexiViT is used to extract multi-scale features from each image frame. The hand–object pose estimator is designed to predict 3D hand pose keypoints and object labels for each frame. The interaction action classifier is used to predict the interaction action categories for the entire video. The experimental results demonstrate that our approach achieves competitive recognition accuracies of 94.96% and 88.84% on two datasets, namely first-person hand action (FPHA) and 2 Hands and Objects (H2O).</p>","PeriodicalId":11556,"journal":{"name":"Electronics Letters","volume":"60 17","pages":""},"PeriodicalIF":0.7,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ell2.70010","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142142361","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}