Min-Kyung Jung, Hakseung Kim, Seho Lee, Jung-Bin Kim, Dong-Joo Kim
{"title":"基于心算的脑电图神经网络混合特征的可解释性","authors":"Min-Kyung Jung, Hakseung Kim, Seho Lee, Jung-Bin Kim, Dong-Joo Kim","doi":"10.1109/BCI57258.2023.10078648","DOIUrl":null,"url":null,"abstract":"A high cognitive load could significantly impair problem-solving skills. Electroencephalogram (EEG)-based real-time assessment of mental workload is feasible, and graph neural networks (GNN) can classify brain activity patterns during cognitively demanding tasks with high accuracy. However, previous GNN studies pertaining to mental workload classification lack explainability. This study utilized a state-of-the-art GNN variant with GNNexplainer to find relevant connectivity during mental arithmetic (MA) tasks. In this endeavor, MA EEG recordings were retrieved from an openaccess database. The signals were transformed to graph data through the envelope correlation and power spectral density (PSD), and subjected to GNN with hierarchical graph pooling with a structure learning model to classify MA and baseline (BL). The model accuracy was $85.57 \\pm 6.27$ and $96.26 \\pm 4.14$% for the connectivity dataset and the PSD and the connectivity feature, respectively. Among the connections between nodes identified as important by GNNExplainer, two notable edge patterns were found as 1) from the left centro-parietal region to left frontal regions, and 2) the frontoparietal connection. The results indicate 1) the GNN model performance could be improved using the connectivity and PSD feature together, and 2) characteristic patterns of the connectome and PSD could be important for MA classification. The connectivity analysis by the ‘‘explainable’’ GNN model could be beneficial in future brain activity pattern studies.","PeriodicalId":285262,"journal":{"name":"2023 11th International Winter Conference on Brain-Computer Interface (BCI)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-02-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Interpretability of Hybrid Feature Using Graph Neural Networks from Mental Arithmetic Based EEG\",\"authors\":\"Min-Kyung Jung, Hakseung Kim, Seho Lee, Jung-Bin Kim, Dong-Joo Kim\",\"doi\":\"10.1109/BCI57258.2023.10078648\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"A high cognitive load could significantly impair problem-solving skills. Electroencephalogram (EEG)-based real-time assessment of mental workload is feasible, and graph neural networks (GNN) can classify brain activity patterns during cognitively demanding tasks with high accuracy. However, previous GNN studies pertaining to mental workload classification lack explainability. This study utilized a state-of-the-art GNN variant with GNNexplainer to find relevant connectivity during mental arithmetic (MA) tasks. In this endeavor, MA EEG recordings were retrieved from an openaccess database. The signals were transformed to graph data through the envelope correlation and power spectral density (PSD), and subjected to GNN with hierarchical graph pooling with a structure learning model to classify MA and baseline (BL). The model accuracy was $85.57 \\\\pm 6.27$ and $96.26 \\\\pm 4.14$% for the connectivity dataset and the PSD and the connectivity feature, respectively. Among the connections between nodes identified as important by GNNExplainer, two notable edge patterns were found as 1) from the left centro-parietal region to left frontal regions, and 2) the frontoparietal connection. The results indicate 1) the GNN model performance could be improved using the connectivity and PSD feature together, and 2) characteristic patterns of the connectome and PSD could be important for MA classification. The connectivity analysis by the ‘‘explainable’’ GNN model could be beneficial in future brain activity pattern studies.\",\"PeriodicalId\":285262,\"journal\":{\"name\":\"2023 11th International Winter Conference on Brain-Computer Interface (BCI)\",\"volume\":\"2 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-02-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 11th International Winter Conference on Brain-Computer Interface (BCI)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/BCI57258.2023.10078648\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 11th International Winter Conference on Brain-Computer Interface (BCI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/BCI57258.2023.10078648","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Interpretability of Hybrid Feature Using Graph Neural Networks from Mental Arithmetic Based EEG
A high cognitive load could significantly impair problem-solving skills. Electroencephalogram (EEG)-based real-time assessment of mental workload is feasible, and graph neural networks (GNN) can classify brain activity patterns during cognitively demanding tasks with high accuracy. However, previous GNN studies pertaining to mental workload classification lack explainability. This study utilized a state-of-the-art GNN variant with GNNexplainer to find relevant connectivity during mental arithmetic (MA) tasks. In this endeavor, MA EEG recordings were retrieved from an openaccess database. The signals were transformed to graph data through the envelope correlation and power spectral density (PSD), and subjected to GNN with hierarchical graph pooling with a structure learning model to classify MA and baseline (BL). The model accuracy was $85.57 \pm 6.27$ and $96.26 \pm 4.14$% for the connectivity dataset and the PSD and the connectivity feature, respectively. Among the connections between nodes identified as important by GNNExplainer, two notable edge patterns were found as 1) from the left centro-parietal region to left frontal regions, and 2) the frontoparietal connection. The results indicate 1) the GNN model performance could be improved using the connectivity and PSD feature together, and 2) characteristic patterns of the connectome and PSD could be important for MA classification. The connectivity analysis by the ‘‘explainable’’ GNN model could be beneficial in future brain activity pattern studies.