Computational Intelligence最新文献

{"title":"Adaptive Synaptic Adjustment Mechanism to Improve Learning Performances of Spiking Neural Networks","authors":"Hyun-Jong Lee,&nbsp;Jae-Han Lim","doi":"10.1111/coin.70001","DOIUrl":"https://doi.org/10.1111/coin.70001","url":null,"abstract":"<div>\u0000 \u0000 <p>Spiking Neural Networks (SNNs) are currently attracting researchers' attention due to their efficiencies in various tasks. Spike-timing-dependent plasticity (STDP) is an unsupervised learning process that utilizes bio-plausibility based on the relative timing of pre/post-synaptic spikes of neurons. Integrated with STDP, SNNs perform well consuming less energy. However, it is hard to ensure that synaptic weights always converge to values guaranteeing accurate prediction because STDP does not change synaptic weights with supervision. To address this limitation, researchers have proposed mechanisms for inducing STDP to converge synaptic weights on the proper values referring to current synaptic weights. Thus, if the current weights fail to describe proper synaptic connections, they cannot induce STDP to update synaptic weights properly. To solve this problem, we propose an adaptive mechanism that helps STDP to converge synaptic weights directly based on input data features: Adaptive synaptic template (AST). AST leads synaptic weights to describe synaptic connections according to the data features. It prevents STDP from changing synaptic weights based on abnormal weights that fail to describe the proper synaptic connections. This is because it does not use the current synaptic weights that can disturb proper weight convergence. We integrate AST with an SNN and conduct experiments to compare it with a baseline (the SNN without AST) and benchmarks (previous works to improve STDP). Our experimental results show that the SNN using AST classifies various data sets with 6%–39% higher accuracy than the baseline and benchmarks.</p>\u0000 </div>","PeriodicalId":55228,"journal":{"name":"Computational Intelligence","volume":"40 5","pages":""},"PeriodicalIF":1.8,"publicationDate":"2024-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142449154","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Hybrid HAN-CNN with aspect term extraction for sentiment analysis using product review","authors":"P. C. D. Kalaivaani,&nbsp;K. Sathyarajasekaran,&nbsp;N. Krishnamoorthy,&nbsp;T. Kumaravel","doi":"10.1111/coin.12698","DOIUrl":"https://doi.org/10.1111/coin.12698","url":null,"abstract":"<p>In this article, an intensive sentiment analysis approach termed Hierarchical attention-convolutional neural network (HAN-CNN) has been proposed using product reviews. Firstly, the input product review is subjected to Bidirectional Encoder Representation from Transformers (BERT) tokenization, where the input data of each sentence are partitioned into little bits of words. Thereafter, Aspect Term Extraction (ATE) is carried out and feature extraction is completed utilizing some features. Finally, sentiment analysis is accomplished by the developed HAN-CNN, which is formed by combining a Hierarchical Attention Network (HAN) and a Convolutional Neural Network (CNN). Moreover, the proposed HAN-CNN achieved a greater performance with maximum accuracy, recall and F1-Score of 91.70%, 90.60% and 91.20%, respectively.</p>","PeriodicalId":55228,"journal":{"name":"Computational Intelligence","volume":"40 5","pages":""},"PeriodicalIF":1.8,"publicationDate":"2024-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142404132","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"TCSR: Self-attention with time and category for session-based recommendation","authors":"Xiaoyan Zhu,&nbsp;Yu Zhang,&nbsp;Jiaxuan Li,&nbsp;Jiayin Wang,&nbsp;Xin Lai","doi":"10.1111/coin.12695","DOIUrl":"https://doi.org/10.1111/coin.12695","url":null,"abstract":"<p>Session-based recommendation that uses sequence of items clicked by anonymous users to make recommendations has drawn the attention of many researchers, and a lot of approaches have been proposed. However, there are still problems that have not been well addressed: (1) Time information is either ignored or exploited with a fixed time span and granularity, which fails to understand the personalized interest transfer pattern of users with different clicking speeds; (2) Category information is either omitted or considered independent of the items, which defies the fact that the relationships between categories and items are helpful for the recommendation. To solve these problems, we propose a new session-based recommendation method, TCSR (self-attention with time and category for session-based recommendation). TCSR uses a non-linear normalized time embedding to perceive user interest transfer patterns on variable granularity and employs a heterogeneous SAN to make full use of both items and categories. Moreover, a cross-recommendation unit is adapted to adjust recommendations on the item and category sides. Extensive experiments on four real datasets show that TCSR significantly outperforms state-of-the-art approaches.</p>","PeriodicalId":55228,"journal":{"name":"Computational Intelligence","volume":"40 5","pages":""},"PeriodicalIF":1.8,"publicationDate":"2024-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142320613","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Multi-scale learning for fine-grained traffic flow-based travel time estimation prediction","authors":"Zain Ul Abideen,&nbsp;Xiaodong Sun,&nbsp;Chao Sun","doi":"10.1111/coin.12693","DOIUrl":"https://doi.org/10.1111/coin.12693","url":null,"abstract":"<p>In intelligent transportation systems (ITS), achieving accurate travel time estimation (TTE) is paramount, much like route planning. Precisely predicting travel time across different urban areas is vital, and an essential requirement for these privileges is having fine-grained knowledge of the city. In contrast to prior studies that are restricted to coarse-grained data, we broaden the scope of traffic flow forecasting to fine granularity, which provokes explicit challenges: (1) the prevalence of inter-grid transitions within fine-grained data introduces complexity in capturing spatial dependencies among grid cells on a global scale. (2) stemming from dynamic temporal dependencies. To address these challenges, we propose the multi-scaling hybrid model (MSHM) as a novel approach. Initially, a multi-directional convolutional layer is first used to acquire high-level depictions for each cell to retrieve the semantic attributes of the road network from local and global aspects. Next, we incorporate the characteristics of the road network and coarse-grained flow features to regularize the local and global spatial distribution modeling of road-relative traffic flow using an enhanced deep super-resolution (EDSR) technique. Benefiting from the EDSR method, our approach can generate high-quality fine-grained traffic flow maps. Furthermore, to continuously provide accurate TTE over time by leveraging well-designed multi-scale feature modeling, we incorporate a multi-scale feature expression of each road segment, capturing intricate details and important features at different scales to optimize the TTE. We conducted comprehensive trials on two real-world datasets, BJTaxi and NYCTaxi, aiming to achieve superior results compared to baseline methods.</p>","PeriodicalId":55228,"journal":{"name":"Computational Intelligence","volume":"40 5","pages":""},"PeriodicalIF":1.8,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142244401","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Detection of aberration in human behavior using shallow neural network over smartphone inertial sensors data","authors":"Sakshi,&nbsp;M. P. S. Bhatia,&nbsp;Pinaki Chakraborty","doi":"10.1111/coin.12699","DOIUrl":"https://doi.org/10.1111/coin.12699","url":null,"abstract":"<p>The integration of different Mobile Edge Computing (MEC) applications has significantly enhanced the realm of security and surveillance, with Human Activity Recognition (HAR) standing out as a crucial application. The diverse sensors found in smartphones have made it convenient for monitoring applications to gather and analyze data, rendering them valuable for HAR purposes. Moreover, MEC can be employed to automate surveillance, allowing intelligent monitoring of restricted areas to identify and respond to unwanted or suspicious activities. This research develops a system using motion sensors in smartphones to identify unusual human activities. People's smartphones were employed to monitor both suspicious and regular activities. Information was collected for various actions categorized as either suspicious or regular. When a person performs a certain action, the smartphone records a series of sensory data, analyse important patterns from the basic data, and then determines what the person is doing by combining information from different sensors. To prepare the data, information from different sensors was aligned to a shared timeline. In this study, we used a sliding window approach on synchronized data to feed sequences into LSTM and CNN models. These models, which include initial layers of LSTM and CNN, automatically find important patterns in the order of human activities. We combined SVM with the features extracted by the shallow Neural Network to make a mixed model that predicts suspicious activities. Lastly, we compared LSTM, CNN, and our new shallow mixed neural network using a new real-time dataset. The mixed model of CNN and SVM achieved an accuracy of 94.43%. Additionally, the sliding window method's effectiveness was confirmed with a 4.28% improvement in accuracy.</p>","PeriodicalId":55228,"journal":{"name":"Computational Intelligence","volume":"40 5","pages":""},"PeriodicalIF":1.8,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142244400","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"ProtienCNN-BLSTM: An efficient deep neural network with amino acid embedding-based model of protein sequence classification and biological analysis","authors":"Umesh Kumar Lilhore,&nbsp;Sarita Simaiya,&nbsp;Surjeet Dalal,&nbsp;Neetu Faujdar,&nbsp;Yogesh Kumar Sharma,&nbsp;K. B. V. Brahma Rao,&nbsp;V. V. R. Maheswara Rao,&nbsp;Shilpi Tomar,&nbsp;Ehab Ghith,&nbsp;Mehdi Tlija","doi":"10.1111/coin.12696","DOIUrl":"https://doi.org/10.1111/coin.12696","url":null,"abstract":"<p>Protein sequence classification needs to be performed quickly and accurately to progress bioinformatics advancements and the production of pharmaceutical products. Extensive comparisons between large databases of known proteins and unknown sequences are necessary in traditional protein classification methods, which can be time-consuming. This labour-intensive and slow manual matching and classification method depends on functional and biological commonalities. Protein classification is one of the many fields in which deep learning has recently revolutionized. The data on proteins are organized hierarchically and sequentially, and the most advanced algorithms, such as Deep Family-based Method (DeepFam) and Protein Convolutional Neural Network (ProtCNN), have shown promising results in classifying proteins into relative groups. On the other hand, these methods frequently refuse to acknowledge this fact. We propose a novel hybrid model called ProteinCNN-BLSTM to overcome these particular challenges. To produce more accurate protein sequence classification, it combines the techniques of amino acid embedding with bidirectional long short-term memory (BLSTM) and convolutional neural networks (CNNs). The CNN component is the most effective at capturing local features, while the BLSTM component is the most capable of modeling long-term dependencies across protein sequences. Through the process of amino acid embedding, sequences of proteins are transformed into numeric vectors, which significantly improves the precision of prediction and the representation of features. Using the standard protein samples PDB-14189 and PDB-2272, we analyzed the proposed ProteinCNN-BLSTM model and the existing deep-learning models. Compared to the existing models, such as CNN, LSTM, GCNs, CNN-LSTM, RNNs, GCN-RNN, DeepFam, and ProtCNN, the proposed model performed more accurately and better than the existing models.</p>","PeriodicalId":55228,"journal":{"name":"Computational Intelligence","volume":"40 4","pages":""},"PeriodicalIF":1.8,"publicationDate":"2024-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142041590","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Contextual classification of clinical records with bidirectional long short-term memory (Bi-LSTM) and bidirectional encoder representations from transformers (BERT) model","authors":"Jaya Zalte,&nbsp;Harshal Shah","doi":"10.1111/coin.12692","DOIUrl":"https://doi.org/10.1111/coin.12692","url":null,"abstract":"<p>Deep learning models have overcome traditional machine learning techniques for text classification domains in the field of natural language processing (NLP). Since, NLP is a branch of machine learning, used for interpreting language, classifying text of interest, and the same can be applied to analyse the medical clinical electronic health records. Medical text consists of lot of rich data which can altogether provide a good insight, by determining patterns from the clinical text data. In this paper, bidirectional-long short-term memory (Bi-LSTM), bi-LSTM attention and bidirectional encoder representations from transformers (BERT) base models are used to classify the text which are of privacy concern to a person and which should be extracted and can be tagged as sensitive. This text data which we might think not of privacy concern would majorly reveal a lot about the patient's integrity and personal life. Clinical data not only have patient demographic data but lot of hidden data which might go unseen and thus could arise privacy issues. Bi-LSTM with attention layer is also added on top to realize the importance of critical words which will be of great importance in terms of classification, we are able to achieve accuracy of about 92%. About 206,926 sentences are used out of which 80% are used for training and rest for testing we get accuracy of 90% approx. with Bi-LSTM alone. The same set of datasets is used for BERT model with accuracy of 93% approx.</p>","PeriodicalId":55228,"journal":{"name":"Computational Intelligence","volume":"40 4","pages":""},"PeriodicalIF":1.8,"publicationDate":"2024-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142041588","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Edge reconstruction and feature enhancement-driven architecture for blind super-resolution in medical imaging systems","authors":"Yinghua Li,&nbsp;Yue Liu,&nbsp;Jian Xu,&nbsp;Hongyun Chu,&nbsp;Jinglu He,&nbsp;Shengchuan Zhang,&nbsp;Ying Liu","doi":"10.1111/coin.12690","DOIUrl":"https://doi.org/10.1111/coin.12690","url":null,"abstract":"<p>In the field of single image super-resolution, the prevalent use of convolutional neural networks (CNN) typically assumes a simplistic bicubic downsampling model for image degradation. This assumption misaligns with the complex degradation processes encountered in medical imaging, leading to a performance gap when these algorithms are applied to real medical scenarios. Addressing this critical discrepancy, our study introduces a novel degradation comparative learning framework meticulously designed for the nuanced degradation characteristics of medical images within the Internet of Medical Things (IoMT). Unlike traditional CNN-based super-resolution approaches that homogeneously process image channels, our method acknowledges and leverages the disparity in informational content across channels. We present a blind image super-resolution technique, underpinned by edge reconstruction and an innovative image feature supplement module. This approach not only preserves but enriches texture details, crucial for the accurate analysis of medical images in the IoMT. Comparative evaluations of our model against existing blind super-resolution methods, utilizing both natural image testing datasets and medical images, demonstrate its superior performance. Notably, our approach exhibits remarkable proficiency in stably restoring various degraded super-resolution images, a critical requirement in the IoMT context. Experimental results demonstrate that our method is superior to the current state-of-the-art methods, marking a significant advancement in the field of medical image super-resolution.</p>","PeriodicalId":55228,"journal":{"name":"Computational Intelligence","volume":"40 4","pages":""},"PeriodicalIF":1.8,"publicationDate":"2024-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142041589","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Multi-class brain tumor classification system in MRI images using cascades neural network","authors":"A. Jayachandran,&nbsp;N. Anisha","doi":"10.1111/coin.12687","DOIUrl":"https://doi.org/10.1111/coin.12687","url":null,"abstract":"<p>Brain tumor segmentation from MRI is a challenging process that has positive ups and downs. The most crucial step for detection and treatment to save the patient's life is earlier diagnosis and classification of brain tumor (BT) with higher accuracy prediction. One of the deadliest cancers, malignant brain tumors is now the main cause of cancer-related death due to their extreme severity. To evaluate the tumors and help patients receive the appropriate treatment according to their classifications, it is essential to have a thorough understanding of brain diseases, such as classifying BT. In order to resolve the problem of low segmentation accuracy caused by an imbalance of model design and sample category in the process of brain tumor segmentation. In this research work, Multi-Dimensional Cascades Neural Network (MDCNet) is developed for multi-class BT classification. It is divided into two steps. In stage 1, an enhanced shallow-layer 3D locality net is used to conduct BT localization and rough segmentation on the preprocessed MRIs. It is also advised to use a unique circular inference module and parameter Dice loss to lower the uncertain probability and false positive border locations. In step 2, in order to compensate for mistakes and lost spatial information of a single view, morphological traits are investigated using a multi-view 2.5D net composed of three 2D refinement subnetworks. The suggested method outperforms the traditional model in segmentation, yielding an accuracy of 99.67%, 98.16%, and 99.76% for the three distinct datasets.</p>","PeriodicalId":55228,"journal":{"name":"Computational Intelligence","volume":"40 4","pages":""},"PeriodicalIF":1.8,"publicationDate":"2024-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141639564","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Learning multi-modal recurrent neural networks with target propagation","authors":"Nikolay Manchev,&nbsp;Michael Spratling","doi":"10.1111/coin.12691","DOIUrl":"https://doi.org/10.1111/coin.12691","url":null,"abstract":"<p>Modelling one-to-many type mappings in problems with a temporal component can be challenging. Backpropagation is not applicable to networks that perform discrete sampling and is also susceptible to gradient instabilities, especially when applied to longer sequences. In this paper, we propose two recurrent neural network architectures that leverage stochastic units and mixture models, and are trained with target propagation. We demonstrate that these networks can model complex conditional probability distributions, outperform backpropagation-trained alternatives, and do not rapidly degrade with increased time horizons. Our main contributions consist of the design and evaluation of the architectures that enable the networks to solve multi-model problems with a temporal dimension. This also includes the extension of the target propagation through time algorithm to handle stochastic neurons. The use of target propagation provides an additional computational advantage, which enables the network to handle time horizons that are substantially longer compared to networks fitted using backpropagation.</p>","PeriodicalId":55228,"journal":{"name":"Computational Intelligence","volume":"40 4","pages":""},"PeriodicalIF":1.8,"publicationDate":"2024-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/coin.12691","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141639565","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}