Quanlin Chen, Chunjin Ye, Rui Xiao, Jiahui Pan, Jingcong Li
{"title":"SemSTNet:基于预训练语言模型生成类原型的医学脑电语义度量学习。","authors":"Quanlin Chen, Chunjin Ye, Rui Xiao, Jiahui Pan, Jingcong Li","doi":"10.1109/TBME.2025.3620754","DOIUrl":null,"url":null,"abstract":"<p><p>Electroencephalography (EEG) feature learning is crucial for brain-machine interfaces and medical diagnostics. Existing deep learning models for classification often overlook the intrinsic semantic relationships between different EEG classes and rely on overly complex models with a large number of parameters. To address these challenges, we propose SemSTNet, a novel and lightweight framework for EEG analysis. Firstly, we designed an e ficient, lightweight convolutional architecture that decouples spatial and temporal feature extraction. Then we propose a framework which introduces a novel semantic metric learning paradigm that uses class prototypes generated by a pretrained language model to better capture inter-class relationships and enhance intra-class compactness. These prototypes are extracted and stored offline, requiring no additional inference from the language model during training or deployment. This design significantly reduces model complexity, resulting in a model with only 23K parameters-over 100 times fewer than common Transformer-based models. Exten sive experiments demonstrate that SemSTNet outperforms state of-the-art approaches on tasks such as epilepsy classification and sleep staging, highlighting its effectiveness and efficiency. Our work demonstrates that integrating semantic knowledge with a purpose-built lightweight architecture provides a highly effective and efficient solution.</p>","PeriodicalId":13245,"journal":{"name":"IEEE Transactions on Biomedical Engineering","volume":"PP ","pages":""},"PeriodicalIF":4.5000,"publicationDate":"2025-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"SemSTNet: Medical EEG Semantic Metric Learning with Class Prototypes Generated by Pretrained Language Model.\",\"authors\":\"Quanlin Chen, Chunjin Ye, Rui Xiao, Jiahui Pan, Jingcong Li\",\"doi\":\"10.1109/TBME.2025.3620754\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Electroencephalography (EEG) feature learning is crucial for brain-machine interfaces and medical diagnostics. Existing deep learning models for classification often overlook the intrinsic semantic relationships between different EEG classes and rely on overly complex models with a large number of parameters. To address these challenges, we propose SemSTNet, a novel and lightweight framework for EEG analysis. Firstly, we designed an e ficient, lightweight convolutional architecture that decouples spatial and temporal feature extraction. Then we propose a framework which introduces a novel semantic metric learning paradigm that uses class prototypes generated by a pretrained language model to better capture inter-class relationships and enhance intra-class compactness. These prototypes are extracted and stored offline, requiring no additional inference from the language model during training or deployment. This design significantly reduces model complexity, resulting in a model with only 23K parameters-over 100 times fewer than common Transformer-based models. Exten sive experiments demonstrate that SemSTNet outperforms state of-the-art approaches on tasks such as epilepsy classification and sleep staging, highlighting its effectiveness and efficiency. Our work demonstrates that integrating semantic knowledge with a purpose-built lightweight architecture provides a highly effective and efficient solution.</p>\",\"PeriodicalId\":13245,\"journal\":{\"name\":\"IEEE Transactions on Biomedical Engineering\",\"volume\":\"PP \",\"pages\":\"\"},\"PeriodicalIF\":4.5000,\"publicationDate\":\"2025-10-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Biomedical Engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1109/TBME.2025.3620754\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Biomedical Engineering","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1109/TBME.2025.3620754","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
SemSTNet: Medical EEG Semantic Metric Learning with Class Prototypes Generated by Pretrained Language Model.
Electroencephalography (EEG) feature learning is crucial for brain-machine interfaces and medical diagnostics. Existing deep learning models for classification often overlook the intrinsic semantic relationships between different EEG classes and rely on overly complex models with a large number of parameters. To address these challenges, we propose SemSTNet, a novel and lightweight framework for EEG analysis. Firstly, we designed an e ficient, lightweight convolutional architecture that decouples spatial and temporal feature extraction. Then we propose a framework which introduces a novel semantic metric learning paradigm that uses class prototypes generated by a pretrained language model to better capture inter-class relationships and enhance intra-class compactness. These prototypes are extracted and stored offline, requiring no additional inference from the language model during training or deployment. This design significantly reduces model complexity, resulting in a model with only 23K parameters-over 100 times fewer than common Transformer-based models. Exten sive experiments demonstrate that SemSTNet outperforms state of-the-art approaches on tasks such as epilepsy classification and sleep staging, highlighting its effectiveness and efficiency. Our work demonstrates that integrating semantic knowledge with a purpose-built lightweight architecture provides a highly effective and efficient solution.
期刊介绍:
IEEE Transactions on Biomedical Engineering contains basic and applied papers dealing with biomedical engineering. Papers range from engineering development in methods and techniques with biomedical applications to experimental and clinical investigations with engineering contributions.