通过在共形结构中探索Swin变压器集成来增强癫痫发作的识别。

IF 6.4
International journal of neural systems Pub Date : 2027-02-01 Epub Date: 2026-08-05 DOI:10.1142/S0129065727500079
Rufeng Wen, Jian Lian
{"title":"通过在共形结构中探索Swin变压器集成来增强癫痫发作的识别。","authors":"Rufeng Wen, Jian Lian","doi":"10.1142/S0129065727500079","DOIUrl":null,"url":null,"abstract":"<p><p>This study proposes a novel enhancement to the Conformer architecture for epileptic seizure identification by replacing the standard Vision Transformer (ViT) with the Swin Transformer. The proposed Swin-Conformer model leverages the hierarchical patch merging and shifted-window self-attention mechanisms of the Swin Transformer to better capture both local electrophysiological patterns and long-range temporal dependencies in electroencephalogram (EEG) signals. To handle the significant class imbalance inherent in epileptic EEG data, a weighted focal loss function is employed during training. The model is evaluated on the CHB-MIT dataset through stratified 10-fold cross-validation and validated on the independent Bonn EEG dataset. Experimental results demonstrate that the proposed model achieves accuracy of 99.24%, specificity of 99.55%, and sensitivity of 98.47% on the segment-based evaluation, as well as an event-based sensitivity of 99.50%, outperforming the original Conformer and state-of-the-art baseline methods. Ablation studies confirm that the performance gains originate from the Swin Transformer's hierarchical multi-scale feature representation and efficient local-global attention mechanism. Statistical analysis confirms that the improvements are statistically significant ([Formula: see text]).</p>","PeriodicalId":94052,"journal":{"name":"International journal of neural systems","volume":" ","pages":"2750007"},"PeriodicalIF":6.4000,"publicationDate":"2027-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Enhancing Epileptic Seizure Identification by Exploring Swin Transformer Integration within Conformer Architecture.\",\"authors\":\"Rufeng Wen, Jian Lian\",\"doi\":\"10.1142/S0129065727500079\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>This study proposes a novel enhancement to the Conformer architecture for epileptic seizure identification by replacing the standard Vision Transformer (ViT) with the Swin Transformer. The proposed Swin-Conformer model leverages the hierarchical patch merging and shifted-window self-attention mechanisms of the Swin Transformer to better capture both local electrophysiological patterns and long-range temporal dependencies in electroencephalogram (EEG) signals. To handle the significant class imbalance inherent in epileptic EEG data, a weighted focal loss function is employed during training. The model is evaluated on the CHB-MIT dataset through stratified 10-fold cross-validation and validated on the independent Bonn EEG dataset. Experimental results demonstrate that the proposed model achieves accuracy of 99.24%, specificity of 99.55%, and sensitivity of 98.47% on the segment-based evaluation, as well as an event-based sensitivity of 99.50%, outperforming the original Conformer and state-of-the-art baseline methods. Ablation studies confirm that the performance gains originate from the Swin Transformer's hierarchical multi-scale feature representation and efficient local-global attention mechanism. Statistical analysis confirms that the improvements are statistically significant ([Formula: see text]).</p>\",\"PeriodicalId\":94052,\"journal\":{\"name\":\"International journal of neural systems\",\"volume\":\" \",\"pages\":\"2750007\"},\"PeriodicalIF\":6.4000,\"publicationDate\":\"2027-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International journal of neural systems\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1142/S0129065727500079\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2026/8/5 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of neural systems","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1142/S0129065727500079","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/8/5 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

本研究提出了一种新的增强结构,通过用Swin变压器取代标准的视觉变压器(ViT)来识别癫痫发作。提出的Swin- conformer模型利用Swin变压器的分层补丁合并和移位窗口自注意机制,更好地捕捉脑电图信号中的局部电生理模式和长期时间依赖性。为了处理癫痫脑电数据中明显的类不平衡,在训练过程中采用了加权的局灶损失函数。该模型在CHB-MIT数据集上通过分层10倍交叉验证进行评估,并在独立的波恩EEG数据集上进行验证。实验结果表明,该模型在基于片段的评价上准确率为99.24%,特异性为99.55%,灵敏度为98.47%,基于事件的灵敏度为99.50%,优于原有的Conformer方法和最先进的基线方法。消融研究证实,Swin变压器的性能提升源于其分层多尺度特征表示和高效的局部-全局注意机制。统计分析证实,这些改进在统计上是显著的(公式:见文本)。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Enhancing Epileptic Seizure Identification by Exploring Swin Transformer Integration within Conformer Architecture.

This study proposes a novel enhancement to the Conformer architecture for epileptic seizure identification by replacing the standard Vision Transformer (ViT) with the Swin Transformer. The proposed Swin-Conformer model leverages the hierarchical patch merging and shifted-window self-attention mechanisms of the Swin Transformer to better capture both local electrophysiological patterns and long-range temporal dependencies in electroencephalogram (EEG) signals. To handle the significant class imbalance inherent in epileptic EEG data, a weighted focal loss function is employed during training. The model is evaluated on the CHB-MIT dataset through stratified 10-fold cross-validation and validated on the independent Bonn EEG dataset. Experimental results demonstrate that the proposed model achieves accuracy of 99.24%, specificity of 99.55%, and sensitivity of 98.47% on the segment-based evaluation, as well as an event-based sensitivity of 99.50%, outperforming the original Conformer and state-of-the-art baseline methods. Ablation studies confirm that the performance gains originate from the Swin Transformer's hierarchical multi-scale feature representation and efficient local-global attention mechanism. Statistical analysis confirms that the improvements are statistically significant ([Formula: see text]).

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书