Motion-Resilient ECG Signal Reconstruction from a Wearable IMU through Attention Mechanism and Contrastive Learning

Jianxun Wang, Marc Foster, A. Bozkurt, David L. Roberts
{"title":"Motion-Resilient ECG Signal Reconstruction from a Wearable IMU through Attention Mechanism and Contrastive Learning","authors":"Jianxun Wang, Marc Foster, A. Bozkurt, David L. Roberts","doi":"10.1145/3565995.3566037","DOIUrl":null,"url":null,"abstract":"Wearable electrocardiogram (ECG) sensors can detect dogs’ heartbeat signals and have proven useful in monitoring dogs’ welfare and predicting temperament scores in structured evaluations of potential guide dog puppies. Despite advances in the ergonomics, performance, and usability of ECG sensor technologies specifically designed for dogs, deploying those systems in the real world imposes challenges such as training human operators to ensure electrodes’ proper contact with the skin and, especially in the case of puppies, socialization to achieve comfort and reduce behavioral inhibition. Seismocardiogram signal is an alternate modality for heartbeat signals and is acquired using the Inertial Measurement Unit (IMU), which is commercially available, widely deployed, and does not require skin-contact. However, the extracted signals from IMU are subject to heavy influences from motion and other noise sources. In this paper, we present a method that enables extracting the similar physiological parameters ECG provides using easier-to-deploy IMU sensors. We propose and evaluate a machine learning framework that reconstructs ECG signals from IMU signals even under moderate to heavy movements. Our study investigated two artificial neural network architectures to overcome severe noise artifacts in the IMU signal resulting from dogs’ movements and environmental factors. The first architecture combines the attention mechanism and convolution layers to extract important features from the temporal IMU input. The second architecture adapts contrastive representation learning to the regression problem and learns a more effective embedding for the ECG reconstruction. The qualitative inspection and quantitative analysis based on F1 scores of the R-peak alignment demonstrate the effectiveness of the two proposed models in removing motion noises and reconstructing realistic ECG signals, achieving an F1 score of 0.72 in the best case compared to 0.29 from the baseline.","PeriodicalId":432998,"journal":{"name":"Proceedings of the Ninth International Conference on Animal-Computer Interaction","volume":"5 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the Ninth International Conference on Animal-Computer Interaction","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3565995.3566037","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

Wearable electrocardiogram (ECG) sensors can detect dogs’ heartbeat signals and have proven useful in monitoring dogs’ welfare and predicting temperament scores in structured evaluations of potential guide dog puppies. Despite advances in the ergonomics, performance, and usability of ECG sensor technologies specifically designed for dogs, deploying those systems in the real world imposes challenges such as training human operators to ensure electrodes’ proper contact with the skin and, especially in the case of puppies, socialization to achieve comfort and reduce behavioral inhibition. Seismocardiogram signal is an alternate modality for heartbeat signals and is acquired using the Inertial Measurement Unit (IMU), which is commercially available, widely deployed, and does not require skin-contact. However, the extracted signals from IMU are subject to heavy influences from motion and other noise sources. In this paper, we present a method that enables extracting the similar physiological parameters ECG provides using easier-to-deploy IMU sensors. We propose and evaluate a machine learning framework that reconstructs ECG signals from IMU signals even under moderate to heavy movements. Our study investigated two artificial neural network architectures to overcome severe noise artifacts in the IMU signal resulting from dogs’ movements and environmental factors. The first architecture combines the attention mechanism and convolution layers to extract important features from the temporal IMU input. The second architecture adapts contrastive representation learning to the regression problem and learns a more effective embedding for the ECG reconstruction. The qualitative inspection and quantitative analysis based on F1 scores of the R-peak alignment demonstrate the effectiveness of the two proposed models in removing motion noises and reconstructing realistic ECG signals, achieving an F1 score of 0.72 in the best case compared to 0.29 from the baseline.
基于注意机制和对比学习的可穿戴IMU运动弹性心电信号重构
可穿戴式心电图(ECG)传感器可以检测狗的心跳信号,并已被证明在监测狗的福利和预测潜在导盲犬幼犬的结构化评估中的气质得分方面很有用。尽管专门为狗设计的心电传感器技术在人体工程学、性能和可用性方面取得了进步,但在现实世界中部署这些系统带来了挑战,例如培训人类操作员以确保电极与皮肤的适当接触,特别是在幼犬的情况下,社会化以实现舒适并减少行为抑制。地震心动图信号是心跳信号的另一种形式,使用惯性测量单元(IMU)获得,IMU是商用的,广泛部署,不需要皮肤接触。然而,从IMU中提取的信号受到运动和其他噪声源的严重影响。在本文中,我们提出了一种方法,可以使用更容易部署的IMU传感器提取ECG提供的类似生理参数。我们提出并评估了一种机器学习框架,即使在中度到重度运动下,也可以从IMU信号中重建ECG信号。我们研究了两种人工神经网络架构,以克服由狗的运动和环境因素引起的IMU信号中的严重噪声伪影。第一种体系结构结合了注意机制和卷积层,从时序IMU输入中提取重要特征。第二种结构将对比表示学习应用于回归问题,学习更有效的心电重构嵌入。基于r峰比对F1分数的定性检验和定量分析表明,两种模型在去除运动噪声和重建真实心电信号方面是有效的,在最佳情况下F1分数为0.72,而基线为0.29。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信