Shaokai Zhao, Bin Chen, Hui Wang, Zhiyuan Luo, Zhang Tao
{"title":"A Feed-Forward Neural Network for Increasing the Hopfield-Network Storage Capacity","authors":"Shaokai Zhao, Bin Chen, Hui Wang, Zhiyuan Luo, Zhang Tao","doi":"10.1142/S0129065722500277","DOIUrl":"https://doi.org/10.1142/S0129065722500277","url":null,"abstract":"In the hippocampal dentate gyrus (DG), pattern separation mainly depends on the concepts of 'expansion recoding', meaning random mixing of different DG input channels. However, recent advances in neurophysiology have challenged the theory of pattern separation based on these concepts. In this study, we propose a novel feed-forward neural network, inspired by the structure of the DG and neural oscillatory analysis, to increase the Hopfield-network storage capacity. Unlike the previously published feed-forward neural networks, our bio-inspired neural network is designed to take advantage of both biological structure and functions of the DG. To better understand the computational principles of pattern separation in the DG, we have established a mouse model of environmental enrichment. We obtained a possible computational model of the DG, associated with better pattern separation ability, by using neural oscillatory analysis. Furthermore, we have developed a new algorithm based on Hebbian learning and coupling direction of neural oscillation to train the proposed neural network. The simulation results show that our proposed network significantly expands the storage capacity of Hopfield network, and more effective pattern separation is achieved. The storage capacity rises from 0.13 for the standard Hopfield network to 0.32 using our model when the overlap in patterns is 10%.","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"1 1","pages":"2250027"},"PeriodicalIF":8.0,"publicationDate":"2022-05-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41511142","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Danilo Avola, Marco Cascio, Luigi Cinque, Alessio Fagioli, Gian Luca Foresti
{"title":"Human Silhouette and Skeleton Video Synthesis Through Wi-Fi Signals.","authors":"Danilo Avola, Marco Cascio, Luigi Cinque, Alessio Fagioli, Gian Luca Foresti","doi":"10.1142/S0129065722500150","DOIUrl":"https://doi.org/10.1142/S0129065722500150","url":null,"abstract":"<p><p>The increasing availability of wireless access points (APs) is leading toward human sensing applications based on Wi-Fi signals as support or alternative tools to the widespread visual sensors, where the signals enable to address well-known vision-related problems such as illumination changes or occlusions. Indeed, using image synthesis techniques to translate radio frequencies to the visible spectrum can become essential to obtain otherwise unavailable visual data. This domain-to-domain translation is feasible because both objects and people affect electromagnetic waves, causing radio and optical frequencies variations. In the literature, models capable of inferring radio-to-visual features mappings have gained momentum in the last few years since frequency changes can be observed in the radio domain through the channel state information (CSI) of Wi-Fi APs, enabling signal-based feature extraction, e.g. amplitude. On this account, this paper presents a novel two-branch generative neural network that effectively maps radio data into visual features, following a teacher-student design that exploits a cross-modality supervision strategy. The latter conditions signal-based features in the visual domain to completely replace visual data. Once trained, the proposed method synthesizes human silhouette and skeleton videos using exclusively Wi-Fi signals. The approach is evaluated on publicly available data, where it obtains remarkable results for both silhouette and skeleton videos generation, demonstrating the effectiveness of the proposed cross-modality supervision strategy.</p>","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"32 5","pages":"2250015"},"PeriodicalIF":8.0,"publicationDate":"2022-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39958454","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
B. García-Martínez, A. Fernández-Caballero, A. Martínez-Rodrigo, R. Alcaraz, P. Novais
{"title":"Evaluation of Brain Functional Connectivity from Electroencephalographic Signals Under Different Emotional States","authors":"B. García-Martínez, A. Fernández-Caballero, A. Martínez-Rodrigo, R. Alcaraz, P. Novais","doi":"10.1142/S0129065722500265","DOIUrl":"https://doi.org/10.1142/S0129065722500265","url":null,"abstract":"The identification of the emotional states corresponding to the four quadrants of the valence/arousal space has been widely analyzed in the scientific literature by means of multiple techniques. Nevertheless, most of these methods were based on the assessment of each brain region separately, without considering the possible interactions among different areas. In order to study these interconnections, this study computes for the first time the functional connectivity metric called cross-sample entropy for the analysis of the brain synchronization in four groups of emotions from electroencephalographic signals. Outcomes reported a strong synchronization in the interconnections among central, parietal and occipital areas, while the interactions between left frontal and temporal structures with the rest of brain regions presented the lowest coordination. These differences were statistically significant for the four groups of emotions. All emotions were simultaneously classified with a 95.43% of accuracy, overcoming the results reported in previous studies. Moreover, the differences between high and low levels of valence and arousal, taking into account the state of the counterpart dimension, also provided notable findings about the degree of synchronization in the brain within different emotional conditions and the possible implications of these outcomes from a psychophysiological point of view.","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"1 1","pages":"2250026"},"PeriodicalIF":8.0,"publicationDate":"2022-04-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44364121","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Autumn Williams, Yinuo Zeng, Ziwei Li, N. Thakor, R. Geocadin, Jay Bronder, Nirma Carballido Martinez, E. Ritzl, Sung-Min Cho
{"title":"Quantitative Assessment of Electroencephalogram Reactivity in Comatose Patients on Extracorporeal Membrane Oxygenation","authors":"Autumn Williams, Yinuo Zeng, Ziwei Li, N. Thakor, R. Geocadin, Jay Bronder, Nirma Carballido Martinez, E. Ritzl, Sung-Min Cho","doi":"10.1142/S0129065722500253","DOIUrl":"https://doi.org/10.1142/S0129065722500253","url":null,"abstract":"Objective assessment of the brain's responsiveness in comatose patients on Extracorporeal Membrane Oxygenation (ECMO) support is essential to clinical care, but current approaches are limited by subjective methodology and inter-rater disagreement. Quantitative electroencephalogram (EEG) algorithms could potentially assist clinicians, improving diagnostic accuracy. We developed a quantitative, stimulus-based algorithm to assess EEG reactivity features in comatose patients on ECMO support. Patients underwent a stimulation protocol of increasing intensity (auditory, peripheral, and nostril stimulation). A total of 129 20-s EEG epochs were collected from 24 patients (age [Formula: see text], 10 females, 14 males) on ECMO support with a Glasgow Coma Scale[Formula: see text]8. EEG reactivity scores ([Formula: see text]-scores) were calculated using aggregated spectral power and permutation entropy for each of five frequency bands ([Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text]. Parameter estimation techniques were applied to [Formula: see text]-scores to identify properties that replicate the decision process of experienced clinicians performing visual analysis. Spectral power changes from audio stimulation were concentrated in the [Formula: see text] band, whereas peripheral stimulation elicited an increase in spectral power across multiple bands, and nostril stimulation changed the entropy of the [Formula: see text] band. The findings of this pilot study on [Formula: see text]-score lay a foundation for a future prediction tool with clinical applications.","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"1 1","pages":"2250025"},"PeriodicalIF":8.0,"publicationDate":"2022-04-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49403441","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
C. Porcaro, F. Vecchio, F. Miraglia, G. Zito, P. Rossini
{"title":"Dynamics of the \"Cognitive\" Brain Wave P3b at Rest for Alzheimer Dementia Prediction in Mild Cognitive Impairment","authors":"C. Porcaro, F. Vecchio, F. Miraglia, G. Zito, P. Rossini","doi":"10.1142/S0129065722500228","DOIUrl":"https://doi.org/10.1142/S0129065722500228","url":null,"abstract":"Alzheimer's disease (AD) is the most common cause of dementia that involves a progressive and irrevocable decline in cognitive abilities and social behavior, thus annihilating the patient's autonomy. The theoretical assumption that disease-modifying drugs are most effective in the early stages hopefully in the prodromal stage called mild cognitive impairment (MCI) urgently pushes toward the identification of robust and individualized markers of cognitive decline to establish an early pharmacological intervention. This requires the combination of well-established neural mechanisms and the development of increasingly sensitive methodologies. Among the neurophysiological markers of attention and cognition, one of the sub-components of the 'cognitive brain wave' P300 recordable in an odd-ball paradigm -namely the P3b- is extensively regarded as a sensitive indicator of cognitive performance. Several studies have reliably shown that changes in the amplitude and latency of the P3b are strongly related to cognitive decline and aging both healthy and pathological. Here, we used a P3b spatial filter to enhance the electroencephalographic (EEG) characteristics underlying 175 subjects divided into 135 MCI subjects, 20 elderly controls (EC), and 20 young volunteers (Y). The Y group served to extract the P3b spatial filter from EEG data, which was later applied to the other groups during resting conditions with eyes open and without being asked to perform any task. The group of 135 MCI subjects could be divided into two subgroups at the end of a month follow-up: 75 with stable MCI (MCI-S, not converted to AD), 60 converted to AD (MCI-C). The P3b spatial filter was built by means of a signal processing method called Functional Source Separation (FSS), which increases signal-to-noise ratio by using a weighted sum of all EEG recording channels rather than relying on a single, or a small sub-set, of channels. A clear difference was observed for the P3b dynamics at rest between groups. Moreover, a machine learning approach showed that P3b at rest could correctly distinguish MCI from EC (80.6% accuracy) and MCI-S from MCI-C (74.1% accuracy), with an accuracy as high as 93.8% in discriminating between MCI-C and EC. Finally, a comparison of the Bayes factor revealed that the group differences among MCI-S and MCI-C were 138 times more likely to be detected using the P3b dynamics compared with the best performing single electrode (Pz) approach. In conclusion, we propose that P3b as measured through spatial filters can be safely regarded as a simple and sensitive marker to predict the conversion from an MCI to AD status eventually combined with other non-neurophysiological biomarkers for a more precise definition of dementia having neuropathological Alzheimer characteristics.","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"1 1","pages":"2250022"},"PeriodicalIF":8.0,"publicationDate":"2022-04-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45049206","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Gexiang Zhang, Xihai Zhang, Haina Rong, Prithwineel Paul, Ming Zhu, Ferrante Neri, Y. Ong
{"title":"A Layered Spiking Neural System for Classification Problems","authors":"Gexiang Zhang, Xihai Zhang, Haina Rong, Prithwineel Paul, Ming Zhu, Ferrante Neri, Y. Ong","doi":"10.1142/S012906572250023X","DOIUrl":"https://doi.org/10.1142/S012906572250023X","url":null,"abstract":"Biological brains have a natural capacity for resolving certain classification tasks. Studies on biologically plausible spiking neurons, architectures and mechanisms of artificial neural systems that closely match biological observations while giving high classification performance are gaining momentum. Spiking neural P systems (SN P systems) are a class of membrane computing models and third-generation neural networks that are based on the behavior of biological neural cells and have been used in various engineering applications. Furthermore, SN P systems are characterized by a highly flexible structure that enables the design of a machine learning algorithm by mimicking the structure and behavior of biological cells without the over-simplification present in neural networks. Based on this aspect, this paper proposes a novel type of SN P system, namely, layered SN P system (LSN P system), to solve classification problems by supervised learning. The proposed LSN P system consists of a multi-layer network containing multiple weighted fuzzy SN P systems with adaptive weight adjustment rules. The proposed system employs specific ascending dimension techniques and a selection method of output neurons for classification problems. The experimental results obtained using benchmark datasets from the UCI machine learning repository and MNIST dataset demonstrated the feasibility and effectiveness of the proposed LSN P system. More importantly, the proposed LSN P system presents the first SN P system that demonstrates sufficient performance for use in addressing real-world classification problems.","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"1 1","pages":"2250023"},"PeriodicalIF":8.0,"publicationDate":"2022-04-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42045874","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Deep Learning Methods for Multi-Channel EEG-Based Emotion Recognition","authors":"A. Olamat, Pinar Özel, Sema Atasever","doi":"10.1142/S0129065722500216","DOIUrl":"https://doi.org/10.1142/S0129065722500216","url":null,"abstract":"Currently, Fourier-based, wavelet-based, and Hilbert-based time-frequency techniques have generated considerable interest in classification studies for emotion recognition in human-computer interface investigations. Empirical mode decomposition (EMD), one of the Hilbert-based time-frequency techniques, has been developed as a tool for adaptive signal processing. Additionally, the multi-variate version strongly influences designing the common oscillation structure of a multi-channel signal by utilizing the common instantaneous concepts of frequency and bandwidth. Additionally, electroencephalographic (EEG) signals are strongly preferred for comprehending emotion recognition perspectives in human-machine interactions. This study aims to herald an emotion detection design via EEG signal decomposition using multi-variate empirical mode decomposition (MEMD). For emotion recognition, the SJTU emotion EEG dataset (SEED) is classified using deep learning methods. Convolutional neural networks (AlexNet, DenseNet-201, ResNet-101, and ResNet50) and AutoKeras architectures are selected for image classification. The proposed framework reaches 99% and 100% classification accuracy when transfer learning methods and the AutoKeras method are used, respectively.","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"1 1","pages":"2250021"},"PeriodicalIF":8.0,"publicationDate":"2022-04-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41629533","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pritpal Singh, Marcin Wa Torek, Anna Ceglarek, Magdalena Fąfrowicz, Koryna Lewandowska, Tadeusz Marek, Barbara Sikora-Wachowicz, Paweł Oświȩcimka
{"title":"Analysis of fMRI Signals from Working Memory Tasks and Resting-State of Brain: Neutrosophic-Entropy-Based Clustering Algorithm.","authors":"Pritpal Singh, Marcin Wa Torek, Anna Ceglarek, Magdalena Fąfrowicz, Koryna Lewandowska, Tadeusz Marek, Barbara Sikora-Wachowicz, Paweł Oświȩcimka","doi":"10.1142/S0129065722500125","DOIUrl":"https://doi.org/10.1142/S0129065722500125","url":null,"abstract":"<p><p>This study applies a neutrosophic-entropy-based clustering algorithm (NEBCA) to analyze the fMRI signals. We consider the data obtained from four different working memory tasks and the brain's resting state for the experimental purpose. Three non-overlapping clusters of data related to temporal brain activity are determined and statistically analyzed. Moreover, we used the Uniform Manifold Approximation and Projection (UMAP) method to reduce system dimensionality and present the effectiveness of NEBCA. The results show that using NEBCA, we are able to distinguish between different working memory tasks and resting-state and identify subtle differences in the related activity of brain regions. By analyzing the statistical properties of the entropy inside the clusters, the various regions of interest (ROIs), according to Automated Anatomical Labeling (AAL) atlas crucial for clustering procedure, are determined. The inferior occipital gyrus is established as an important brain region in distinguishing the resting state from the tasks. Moreover, the inferior occipital gyrus and superior parietal lobule are identified as necessary to correct the data discrimination related to the different memory tasks. We verified the statistical significance of the results through the two-sample <i>t</i>-test and analysis of surrogates performed by randomization of the cluster elements. The presented methodology is also appropriate to determine the influence of time of day on brain activity patterns. The differences between working memory tasks and resting-state in the morning are related to a lower index of small-worldness and sleep inertia in the first hours after waking. We also compared the performance of NEBCA to two existing algorithms, KMCA and FKMCA. We showed the advantage of the NEBCA over these algorithms that could not effectively accumulate fMRI signals with higher variability.</p>","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"32 4","pages":"2250012"},"PeriodicalIF":8.0,"publicationDate":"2022-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39935030","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An Experimental Study of Neural Approaches to Multi-Hop Inference in Question Answering.","authors":"Patricia Jiménez, Rafael Corchuelo","doi":"10.1142/S0129065722500113","DOIUrl":"https://doi.org/10.1142/S0129065722500113","url":null,"abstract":"<p><p>Question answering aims at computing the answer to a question given a context with facts. Many proposals focus on questions whose answer is explicit in the context; lately, there has been an increasing interest in questions whose answer is not explicit and requires multi-hop inference to be computed. Our analysis of the literature reveals that there is a seminal proposal with increasingly complex follow-ups. Unfortunately, they were presented without an extensive study of their hyper-parameters, the experimental studies focused exclusively on English, and no statistical analysis to sustain the conclusions was ever performed. In this paper, we report on our experience devising a very simple neural approach to address the problem, on our extensive grid search over the space of hyper-parameters, on the results attained with English, Spanish, Hindi, and Portuguese, and sustain our conclusions with statistically sound analyses. Our findings prove that it is possible to beat many of the proposals in the literature with a very simple approach that was likely overlooked due to the difficulty to perform an extensive grid search, that the language does not have a statistically significant impact on the results, and that the empirical differences found among some existing proposals are not statistically significant.</p>","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"32 4","pages":"2250011"},"PeriodicalIF":8.0,"publicationDate":"2022-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39805387","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Brain Network Organization Following Post-Stroke Neurorehabilitation.","authors":"Antonino Naro, Loris Pignolo, Rocco Salvatore Calabrò","doi":"10.1142/S0129065722500095","DOIUrl":"https://doi.org/10.1142/S0129065722500095","url":null,"abstract":"<p><p>Brain network analysis can offer useful information to guide the rehabilitation of post-stroke patients. We applied functional network connection models based on multiplex-multilayer network analysis (MMN) to explore functional network connectivity changes induced by robot-aided gait training (RAGT) using the Ekso, a wearable exoskeleton, and compared it to conventional overground gait training (COGT) in chronic stroke patients. We extracted the coreness of individual nodes at multiple locations in the brain from EEG recordings obtained before and after gait training in a resting state. We found that patients provided with RAGT achieved a greater motor function recovery than those receiving COGT. This difference in clinical outcome was paralleled by greater changes in connectivity patterns among different brain areas central to motor programming and execution, as well as a recruitment of other areas beyond the sensorimotor cortices and at multiple frequency ranges, contemporarily. The magnitude of these changes correlated with motor function recovery chances. Our data suggest that the use of RAGT as an add-on treatment to COGT may provide post-stroke patients with a greater modification of the functional brain network impairment following a stroke. This might have potential clinical implications if confirmed in large clinical trials.</p>","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"32 4","pages":"2250009"},"PeriodicalIF":8.0,"publicationDate":"2022-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39903593","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}