Juan E Arco, Andrés Ortiz, Nicolás J Gallego-Molina, Juan M Górriz, Javier Ramírez
{"title":"Enhancing Multimodal Patterns in Neuroimaging by Siamese Neural Networks with Self-Attention Mechanism.","authors":"Juan E Arco, Andrés Ortiz, Nicolás J Gallego-Molina, Juan M Górriz, Javier Ramírez","doi":"10.1142/S0129065723500193","DOIUrl":"https://doi.org/10.1142/S0129065723500193","url":null,"abstract":"<p><p>The combination of different sources of information is currently one of the most relevant aspects in the diagnostic process of several diseases. In the field of neurological disorders, different imaging modalities providing structural and functional information are frequently available. Those modalities are usually analyzed separately, although a joint of the features extracted from both sources can improve the classification performance of Computer-Aided Diagnosis (CAD) tools. Previous studies have computed independent models from each individual modality and combined them in a subsequent stage, which is not an optimum solution. In this work, we propose a method based on the principles of siamese neural networks to fuse information from Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET). This framework quantifies the similarities between both modalities and relates them with the diagnostic label during the training process. The resulting latent space at the output of this network is then entered into an attention module in order to evaluate the relevance of each brain region at different stages of the development of Alzheimer's disease. The excellent results obtained and the high flexibility of the method proposed allow fusing more than two modalities, leading to a scalable methodology that can be used in a wide range of contexts.</p>","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"33 4","pages":"2350019"},"PeriodicalIF":8.0,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9201400","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Xin Ding, Weiwei Nie, Xinyu Liu, Xiuying Wang, Qi Yuan
{"title":"Compact Convolutional Neural Network with Multi-Headed Attention Mechanism for Seizure Prediction.","authors":"Xin Ding, Weiwei Nie, Xinyu Liu, Xiuying Wang, Qi Yuan","doi":"10.1142/S0129065723500144","DOIUrl":"https://doi.org/10.1142/S0129065723500144","url":null,"abstract":"<p><p>Epilepsy is a neurological disorder related to frequent seizures. Automatic seizure prediction is crucial for the prevention and treatment of epilepsy. In this paper, we propose a novel model for seizure prediction that incorporates a convolutional neural network (CNN) with multi-head attention mechanism. In this model, the shallow CNN automatically captures the EEG features, and the multi-headed attention focuses on discriminating the effective information among these features for identifying pre-ictal EEG segments. Compared with current CNN models for seizure prediction, the embedded multi-headed attention empowers the shallow CNN to be more flexible, and enables improvement of the training efficiency. Hence, this compact model is more resistant to being trapped in overfitting. The proposed method was evaluated over the scalp EEG data from the two publicly available epileptic EEG databases, and achieved outperforming values of event-level sensitivity, false prediction rate (FPR), and epoch-level F1. Furthermore, our method achieved the stable length of seizure prediction time that was between 14 and 15 min. The experimental comparisons showed that our method outperformed other prediction methods in terms of prediction and generalization performance.</p>","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"33 3","pages":"2350014"},"PeriodicalIF":8.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9376878","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Large-Scale Image Retrieval with Deep Attentive Global Features.","authors":"Yingying Zhu, Yinghao Wang, Haonan Chen, Zemian Guo, Qiang Huang","doi":"10.1142/S0129065723500132","DOIUrl":"https://doi.org/10.1142/S0129065723500132","url":null,"abstract":"<p><p>How to obtain discriminative features has proved to be a core problem for image retrieval. Many recent works use convolutional neural networks to extract features. However, clutter and occlusion will interfere with the distinguishability of features when using convolutional neural network (CNN) for feature extraction. To address this problem, we intend to obtain high-response activations in the feature map based on the attention mechanism. We propose two attention modules, a spatial attention module and a channel attention module. For the spatial attention module, we first capture the global information and model the relation between channels as a region evaluator, which evaluates and assigns new weights to local features. For the channel attention module, we use a vector with trainable parameters to weight the importance of each feature map. The two attention modules are cascaded to adjust the weight distribution for the feature map, which makes the extracted features more discriminative. Furthermore, we present a scale and mask scheme to scale the major components and filter out the meaningless local features. This scheme can reduce the disadvantages of the various scales of the major components in images by applying multiple scale filters, and filter out the redundant features with the <i>MAX-Mask</i>. Exhaustive experiments demonstrate that the two attention modules are complementary to improve performance, and our network with the three modules outperforms the state-of-the-art methods on four well-known image retrieval datasets.</p>","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"33 3","pages":"2350013"},"PeriodicalIF":8.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10837304","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hengde Zhu, Jian Wang, Shui-Hua Wang, Rajeev Raman, Juan M Górriz, Yu-Dong Zhang
{"title":"An Evolutionary Attention-Based Network for Medical Image Classification.","authors":"Hengde Zhu, Jian Wang, Shui-Hua Wang, Rajeev Raman, Juan M Górriz, Yu-Dong Zhang","doi":"10.1142/S0129065723500107","DOIUrl":"https://doi.org/10.1142/S0129065723500107","url":null,"abstract":"<p><p>Deep learning has become a primary choice in medical image analysis due to its powerful representation capability. However, most existing deep learning models designed for medical image classification can only perform well on a specific disease. The performance drops dramatically when it comes to other diseases. Generalizability remains a challenging problem. In this paper, we propose an evolutionary attention-based network (EDCA-Net), which is an effective and robust network for medical image classification tasks. To extract task-related features from a given medical dataset, we first propose the densely connected attentional network (DCA-Net) where feature maps are automatically channel-wise weighted, and the dense connectivity pattern is introduced to improve the efficiency of information flow. To improve the model capability and generalizability, we introduce two types of evolution: intra- and inter-evolution. The intra-evolution optimizes the weights of DCA-Net, while the inter-evolution allows two instances of DCA-Net to exchange training experience during training. The evolutionary DCA-Net is referred to as EDCA-Net. The EDCA-Net is evaluated on four publicly accessible medical datasets of different diseases. Experiments showed that the EDCA-Net outperforms the state-of-the-art methods on three datasets and achieves comparable performance on the last dataset, demonstrating good generalizability for medical image classification.</p>","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"33 3","pages":"2350010"},"PeriodicalIF":8.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10830284","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Driver Drowsiness EEG Detection Based on Tree Federated Learning and Interpretable Network.","authors":"Xue Qin, Yi Niu, Huiyu Zhou, Xiaojie Li, Weikuan Jia, Yuanjie Zheng","doi":"10.1142/S0129065723500090","DOIUrl":"https://doi.org/10.1142/S0129065723500090","url":null,"abstract":"<p><p>Accurate identification of driver's drowsiness state through Electroencephalogram (EEG) signals can effectively reduce traffic accidents, but EEG signals are usually stored in various clients in the form of small samples. This study attempts to construct an efficient and accurate privacy-preserving drowsiness monitoring system, and proposes a fusion model based on tree Federated Learning (FL) and Convolutional Neural Network (CNN), which can not only identify and explain the driver's drowsiness state, but also integrate the information of different clients under the premise of privacy protection. Each client uses CNN with the Global Average Pooling (GAP) layer and shares model parameters. The tree FL transforms communication relationships into a graph structure, and model parameters are transmitted in parallel along connected branches of the graph. Moreover, the Class Activation Mapping (CAM) is used to find distinctive EEG features for representing specific classes. On EEG data of 11 subjects, it is found that this method has higher average accuracy, F1-score and AUC than the traditional classification method, reaching 73.56%, 73.26% and 78.23%, respectively. Compared with the traditional FL algorithm, this method better protects the driver's privacy and improves communication efficiency.</p>","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"33 3","pages":"2350009"},"PeriodicalIF":8.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10836266","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Wei Yan Peh, Prasanth Thangavel, Yuanyuan Yao, John Thomas, Yee-Leng Tan, Justin Dauwels
{"title":"Six-Center Assessment of CNN-Transformer with Belief Matching Loss for Patient-Independent Seizure Detection in EEG.","authors":"Wei Yan Peh, Prasanth Thangavel, Yuanyuan Yao, John Thomas, Yee-Leng Tan, Justin Dauwels","doi":"10.1142/S0129065723500120","DOIUrl":"https://doi.org/10.1142/S0129065723500120","url":null,"abstract":"<p><p>Neurologists typically identify epileptic seizures from electroencephalograms (EEGs) by visual inspection. This process is often time-consuming, especially for EEG recordings that last hours or days. To expedite the process, a reliable, automated, and patient-independent seizure detector is essential. However, developing a patient-independent seizure detector is challenging as seizures exhibit diverse characteristics across patients and recording devices. In this study, we propose a patient-independent seizure detector to automatically detect seizures in both scalp EEG and intracranial EEG (iEEG). First, we deploy a convolutional neural network with transformers and belief matching loss to detect seizures in single-channel EEG segments. Next, we extract regional features from the channel-level outputs to detect seizures in multi-channel EEG segments. At last, we apply post-processing filters to the segment-level outputs to determine seizures' start and end points in multi-channel EEGs. Finally, we introduce the minimum overlap evaluation scoring as an evaluation metric that accounts for minimum overlap between the detection and seizure, improving upon existing assessment metrics. We trained the seizure detector on the Temple University Hospital Seizure (TUH-SZ) dataset and evaluated it on five independent EEG datasets. We evaluate the systems with the following metrics: sensitivity (SEN), precision (PRE), and average and median false positive rate per hour (aFPR/h and mFPR/h). Across four adult scalp EEG and iEEG datasets, we obtained SEN of 0.617-1.00, PRE of 0.534-1.00, aFPR/h of 0.425-2.002, and mFPR/h of 0-1.003. The proposed seizure detector can detect seizures in adult EEGs and takes less than 15[Formula: see text]s for a 30[Formula: see text]min EEG. Hence, this system could aid clinicians in reliably identifying seizures expeditiously, allocating more time for devising proper treatment.</p>","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"33 3","pages":"2350012"},"PeriodicalIF":8.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9376871","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Guilherme Palumbo, Davide Carneiro, Miguel Guimares, Victor Alves, Paulo Novais
{"title":"Algorithm Recommendation and Performance Prediction Using Meta-Learning.","authors":"Guilherme Palumbo, Davide Carneiro, Miguel Guimares, Victor Alves, Paulo Novais","doi":"10.1142/S0129065723500119","DOIUrl":"https://doi.org/10.1142/S0129065723500119","url":null,"abstract":"<p><p>In the last years, the number of machine learning algorithms and their parameters has increased significantly. On the one hand, this increases the chances of finding better models. On the other hand, it increases the complexity of the task of training a model, as the search space expands significantly. As the size of datasets also grows, traditional approaches based on extensive search start to become prohibitively expensive in terms of computational resources and time, especially in data streaming scenarios. This paper describes an approach based on meta-learning that tackles two main challenges. The first is to predict key performance indicators of machine learning models. The second is to recommend the best algorithm/configuration for training a model for a given machine learning problem. When compared to a state-of-the-art method (AutoML), the proposed approach is up to 130x faster and only 4% worse in terms of average model quality. Hence, it is especially suited for scenarios in which models need to be updated regularly, such as in streaming scenarios with big data, in which some accuracy can be traded for a much shorter model training time.</p>","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"33 3","pages":"2350011"},"PeriodicalIF":8.0,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10827093","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Impulsivity Classification Using EEG Power and Explainable Machine Learning.","authors":"Philippa Hüpen, Himanshu Kumar, Aliaksandra Shymanskaya, Ramakrishnan Swaminathan, Ute Habel","doi":"10.1142/S0129065723500065","DOIUrl":"https://doi.org/10.1142/S0129065723500065","url":null,"abstract":"<p><p>Impulsivity is a multidimensional construct often associated with unfavorable outcomes. Previous studies have implicated several electroencephalography (EEG) indices to impulsiveness, but results are heterogeneous and inconsistent. Using a data-driven approach, we identified EEG power features for the prediction of self-reported impulsiveness. To this end, EEG signals of 56 individuals (18 low impulsive, 20 intermediate impulsive, 18 high impulsive) were recorded during a risk-taking task. Extracted EEG power features from 62 electrodes were fed into various machine learning classifiers to identify the most relevant band. Robustness of the classifier was varied by stratified [Formula: see text]-fold cross validation. Alpha and beta band power showed best performance in the classification of impulsiveness (accuracy = 95.18% and 95.11%, respectively) using a random forest classifier. Subsequently, a sequential bidirectional feature selection algorithm was used to estimate the most relevant electrode sites. Results show that as little as 10 electrodes are sufficient to reliably classify impulsiveness using alpha band power ([Formula: see text]-measure = 94.50%). Finally, the Shapley Additive exPlanations (SHAP) analysis approach was employed to reveal the individual EEG features that contributed most to the model's output. Results indicate that frontal as well as posterior midline alpha power seems to be of most importance for the classification of impulsiveness.</p>","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"33 2","pages":"2350006"},"PeriodicalIF":8.0,"publicationDate":"2023-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9191120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Sentiment Analysis Anomaly Detection System for Cyber Intelligence.","authors":"Roberta Maisano, Gian Luca Foresti","doi":"10.1142/S012906572350003X","DOIUrl":"https://doi.org/10.1142/S012906572350003X","url":null,"abstract":"<p><p>Considering the 2030 United Nations intent of world connection, Cyber Intelligence becomes the main area of the human dimension able of inflicting changes in geopolitical dynamics. In cyberspace, the new battlefield is the mind of people including new weapons like abuse of social media with information manipulation, deception by activists and misinformation. In this paper, a Sentiment Analysis system with Anomaly Detection (SAAD) capability is proposed. The system, scalable and modular, uses an OSINT-Deep Learning approach to investigate on social media sentiment in order to predict suspicious anomaly trend in Twitter posts. Anomaly detection is investigated with a new semi-supervised process that is able to detect potentially dangerous situations in critical areas. The main contributions of the paper are the system suitability for working in different areas and domains, the anomaly detection procedure in sentiment context and a time-dependent confusion matrix to address model evaluation with unbalanced dataset. Real experiments and tests were performed on Sahel Region. The detected anomalies in negative sentiment have been checked by experts of Sahel area, proving true links between the models results and real situations observable from the tweets.</p>","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"33 2","pages":"2350003"},"PeriodicalIF":8.0,"publicationDate":"2023-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10691830","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Performance Evaluation of Error-Correcting Output Coding Based on Noisy and Noiseless Binary Classifiers.","authors":"Gendo Kumoi, Hideki Yagi, Manabu Kobayashi, Masayuki Goto, Shigeichi Hirasawa","doi":"10.1142/S0129065723500041","DOIUrl":"https://doi.org/10.1142/S0129065723500041","url":null,"abstract":"<p><p>Error-correcting output coding (ECOC) is a method for constructing a multi-valued classifier using a combination of given binary classifiers. ECOC can estimate the correct category by other binary classifiers even if the output of some binary classifiers is incorrect based on the framework of the coding theory. The code word table representing the combination of these binary classifiers is important in ECOC. ECOC is known to perform well experimentally on real data. However, the complexity of the classification problem makes it difficult to analyze the classification performance in detail. For this reason, theoretical analysis of ECOC has not been conducted. In this study, if a binary classifier outputs the estimated posterior probability with errors, then this binary classifier is said to be noisy. In contrast, if a binary classifier outputs the true posterior probability, then this binary classifier is said to be noiseless. For a theoretical analysis of ECOC, we discuss the optimality for the code word table with noiseless binary classifiers and the error rate for one with noisy binary classifiers. This evaluation result shows that the Hamming distance of the code word table is an important indicator.</p>","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"33 2","pages":"2350004"},"PeriodicalIF":8.0,"publicationDate":"2023-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10629636","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}