{"title":"MindCeive: Perceiving human imagination using CNN-GRU and GANs","authors":"","doi":"10.1016/j.bspc.2024.107110","DOIUrl":null,"url":null,"abstract":"<div><div>Neuroscience has made astonishing advancements in understanding the human brain with the help of Brain-Computer Interface. Recent contributions in the field of Artificial Intelligence by different researchers made it possible to perceive human imagination by decoding brain signals. Generating visual stimuli perceived by humans will help in analyzing how the human brain works and behaves to different perceptual experiences. Different techniques like Electroencephalography, Magnetoencephalography, functional Magnetic Resonance Imaging, etc. are used to capture brain signals. Electroencephalography signals are non-invasive, low cost, and also have high temporal resolution, therefore they are preferred. Machine learning models are used to extract important features from these signals. These extracted features are then used by Generative Adversarial Network to generate images representing human imagination. This work uses Electroencephalography signals to generate realistic images. The task of extracting important features from Electroencephalography signals is achieved using Convolutional Neural Network and Gated Recurrent Unit based feature extractor. The proposed feature extractor accomplishes better classification accuracy than existing models. By using these extracted features in combination with proposed novel architecture of Generative Adversarial Network, realistic images of objects imagined by humans are generated. The proposed MindCeive approach outperforms previous works by showing improvement in various performance metrics such as Classification Accuracy, Inception Score, and Class Diversity Score.</div></div>","PeriodicalId":55362,"journal":{"name":"Biomedical Signal Processing and Control","volume":null,"pages":null},"PeriodicalIF":4.9000,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biomedical Signal Processing and Control","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1746809424011686","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Neuroscience has made astonishing advancements in understanding the human brain with the help of Brain-Computer Interface. Recent contributions in the field of Artificial Intelligence by different researchers made it possible to perceive human imagination by decoding brain signals. Generating visual stimuli perceived by humans will help in analyzing how the human brain works and behaves to different perceptual experiences. Different techniques like Electroencephalography, Magnetoencephalography, functional Magnetic Resonance Imaging, etc. are used to capture brain signals. Electroencephalography signals are non-invasive, low cost, and also have high temporal resolution, therefore they are preferred. Machine learning models are used to extract important features from these signals. These extracted features are then used by Generative Adversarial Network to generate images representing human imagination. This work uses Electroencephalography signals to generate realistic images. The task of extracting important features from Electroencephalography signals is achieved using Convolutional Neural Network and Gated Recurrent Unit based feature extractor. The proposed feature extractor accomplishes better classification accuracy than existing models. By using these extracted features in combination with proposed novel architecture of Generative Adversarial Network, realistic images of objects imagined by humans are generated. The proposed MindCeive approach outperforms previous works by showing improvement in various performance metrics such as Classification Accuracy, Inception Score, and Class Diversity Score.
期刊介绍:
Biomedical Signal Processing and Control aims to provide a cross-disciplinary international forum for the interchange of information on research in the measurement and analysis of signals and images in clinical medicine and the biological sciences. Emphasis is placed on contributions dealing with the practical, applications-led research on the use of methods and devices in clinical diagnosis, patient monitoring and management.
Biomedical Signal Processing and Control reflects the main areas in which these methods are being used and developed at the interface of both engineering and clinical science. The scope of the journal is defined to include relevant review papers, technical notes, short communications and letters. Tutorial papers and special issues will also be published.