{"title":"用于心电表征学习的掩码自编码器","authors":"Shunxiang Yang, Cheng Lian, Zhigang Zeng","doi":"10.1109/ICIST55546.2022.9926900","DOIUrl":null,"url":null,"abstract":"In recent years, self-supervised methods have been widely used in representation learning for electrocardiogram (ECG), but most of the existing methods are based on contrastive learning. Contrastive learning methods usually rely on a large number of negative sample pairs and data augmentation. In this paper, we propose a masked autoencoder-based ECG representation learning model. Our approach is to mask the original ECG signal with a high ratio and then use the autoencoder to reconstruct the original ECG signal. To obtain better ECG features, our model not only extracts local features of ECG using multi-scale convolution, but also global features of ECG using transformer. Our model first pre-trains on the ECG datasets and then fine-tunes on each ECG classification task. Experimental results show that our model outperforms the extant SOTA models for self-supervised learning.","PeriodicalId":211213,"journal":{"name":"2022 12th International Conference on Information Science and Technology (ICIST)","volume":"6 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Masked Autoencoder for ECG Representation Learning\",\"authors\":\"Shunxiang Yang, Cheng Lian, Zhigang Zeng\",\"doi\":\"10.1109/ICIST55546.2022.9926900\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In recent years, self-supervised methods have been widely used in representation learning for electrocardiogram (ECG), but most of the existing methods are based on contrastive learning. Contrastive learning methods usually rely on a large number of negative sample pairs and data augmentation. In this paper, we propose a masked autoencoder-based ECG representation learning model. Our approach is to mask the original ECG signal with a high ratio and then use the autoencoder to reconstruct the original ECG signal. To obtain better ECG features, our model not only extracts local features of ECG using multi-scale convolution, but also global features of ECG using transformer. Our model first pre-trains on the ECG datasets and then fine-tunes on each ECG classification task. Experimental results show that our model outperforms the extant SOTA models for self-supervised learning.\",\"PeriodicalId\":211213,\"journal\":{\"name\":\"2022 12th International Conference on Information Science and Technology (ICIST)\",\"volume\":\"6 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 12th International Conference on Information Science and Technology (ICIST)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICIST55546.2022.9926900\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 12th International Conference on Information Science and Technology (ICIST)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICIST55546.2022.9926900","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Masked Autoencoder for ECG Representation Learning
In recent years, self-supervised methods have been widely used in representation learning for electrocardiogram (ECG), but most of the existing methods are based on contrastive learning. Contrastive learning methods usually rely on a large number of negative sample pairs and data augmentation. In this paper, we propose a masked autoencoder-based ECG representation learning model. Our approach is to mask the original ECG signal with a high ratio and then use the autoencoder to reconstruct the original ECG signal. To obtain better ECG features, our model not only extracts local features of ECG using multi-scale convolution, but also global features of ECG using transformer. Our model first pre-trains on the ECG datasets and then fine-tunes on each ECG classification task. Experimental results show that our model outperforms the extant SOTA models for self-supervised learning.