基于haar级联和CNN方法的人脸视频心率估计精度测量

Nur Arifin Akbar, Amgad Muneer, S. Taib, Suliman Mohamed Fati
{"title":"基于haar级联和CNN方法的人脸视频心率估计精度测量","authors":"Nur Arifin Akbar, Amgad Muneer, S. Taib, Suliman Mohamed Fati","doi":"10.1109/DASA54658.2022.9764992","DOIUrl":null,"url":null,"abstract":"COVID-19 leads us to have a social distancing even for health-treatment. In this study, we attempt to estimate heart rates in humans using camera-based remote photoplethysmography (rPPG) methods, which are named after conventional PPG methods. The basic concept is focused on capturing minute variations in skin color during the human body's cardiac cycle, which involves the inflow and outflow of blood from the heart to other body parts. We have compared the performance of different methods of Blind Source Separation and face detection which form an integral part in accurately calculating the heart rate. Purpose: The purpose of this method was comparing the actual heart rate with a tuned parameter of Face Video Heart Rate estimation with CNN and OpenCV haar-cascade. Patients and methods: Videos in the dataset are run through a face detection model to get the region of interest for heart rate calculation. Source signals are converted to frequency domain for filtering and peak detection to obtain heart rate estimates Results: Face segmentation using Convolution Neural Network gives better results than the Haar Cascade OpenCV face detection module, which is as expected. Conclusion: Face segmentation using Convolution Neural Network gives better results than the Haar Cascade OpenCV face detection module. CNNs are slower to detect faces than the Open-CV module. Choosing an ROI by segmenting out facial pixels helped to keep the outliers low and therefore increased the robustness.","PeriodicalId":231066,"journal":{"name":"2022 International Conference on Decision Aid Sciences and Applications (DASA)","volume":"32 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-03-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Measuring Accuracy Towards Facial Video Heart-Rate Estimation Using Haar-Cascade and CNN Method\",\"authors\":\"Nur Arifin Akbar, Amgad Muneer, S. Taib, Suliman Mohamed Fati\",\"doi\":\"10.1109/DASA54658.2022.9764992\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"COVID-19 leads us to have a social distancing even for health-treatment. In this study, we attempt to estimate heart rates in humans using camera-based remote photoplethysmography (rPPG) methods, which are named after conventional PPG methods. The basic concept is focused on capturing minute variations in skin color during the human body's cardiac cycle, which involves the inflow and outflow of blood from the heart to other body parts. We have compared the performance of different methods of Blind Source Separation and face detection which form an integral part in accurately calculating the heart rate. Purpose: The purpose of this method was comparing the actual heart rate with a tuned parameter of Face Video Heart Rate estimation with CNN and OpenCV haar-cascade. Patients and methods: Videos in the dataset are run through a face detection model to get the region of interest for heart rate calculation. Source signals are converted to frequency domain for filtering and peak detection to obtain heart rate estimates Results: Face segmentation using Convolution Neural Network gives better results than the Haar Cascade OpenCV face detection module, which is as expected. Conclusion: Face segmentation using Convolution Neural Network gives better results than the Haar Cascade OpenCV face detection module. CNNs are slower to detect faces than the Open-CV module. Choosing an ROI by segmenting out facial pixels helped to keep the outliers low and therefore increased the robustness.\",\"PeriodicalId\":231066,\"journal\":{\"name\":\"2022 International Conference on Decision Aid Sciences and Applications (DASA)\",\"volume\":\"32 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-03-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 International Conference on Decision Aid Sciences and Applications (DASA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/DASA54658.2022.9764992\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 International Conference on Decision Aid Sciences and Applications (DASA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/DASA54658.2022.9764992","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

摘要

COVID-19导致我们即使在健康治疗方面也要保持社会距离。在这项研究中,我们尝试使用基于相机的远程光电容积脉搏波描记(rPPG)方法来估计人类的心率,该方法以传统的光电容积脉搏波描记方法命名。其基本概念集中在捕捉人体心脏周期中皮肤颜色的微小变化,心脏周期涉及血液从心脏流入和流出到身体其他部位。我们比较了盲源分离和人脸检测两种方法的性能,这两种方法是准确计算心率的重要组成部分。目的:本方法的目的是将实际心率与CNN和OpenCV haar级联的Face Video心率估计的调整参数进行比较。患者和方法:数据集中的视频通过人脸检测模型运行,以获得感兴趣的心率计算区域。将源信号转换到频域进行滤波和峰值检测,得到心率估计结果:使用卷积神经网络进行人脸分割,效果优于Haar Cascade OpenCV人脸检测模块,符合预期。结论:卷积神经网络的人脸分割效果优于Haar Cascade OpenCV人脸检测模块。cnn检测人脸的速度比Open-CV模块慢。通过分割出面部像素来选择ROI有助于保持较低的异常值,从而增加鲁棒性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Measuring Accuracy Towards Facial Video Heart-Rate Estimation Using Haar-Cascade and CNN Method
COVID-19 leads us to have a social distancing even for health-treatment. In this study, we attempt to estimate heart rates in humans using camera-based remote photoplethysmography (rPPG) methods, which are named after conventional PPG methods. The basic concept is focused on capturing minute variations in skin color during the human body's cardiac cycle, which involves the inflow and outflow of blood from the heart to other body parts. We have compared the performance of different methods of Blind Source Separation and face detection which form an integral part in accurately calculating the heart rate. Purpose: The purpose of this method was comparing the actual heart rate with a tuned parameter of Face Video Heart Rate estimation with CNN and OpenCV haar-cascade. Patients and methods: Videos in the dataset are run through a face detection model to get the region of interest for heart rate calculation. Source signals are converted to frequency domain for filtering and peak detection to obtain heart rate estimates Results: Face segmentation using Convolution Neural Network gives better results than the Haar Cascade OpenCV face detection module, which is as expected. Conclusion: Face segmentation using Convolution Neural Network gives better results than the Haar Cascade OpenCV face detection module. CNNs are slower to detect faces than the Open-CV module. Choosing an ROI by segmenting out facial pixels helped to keep the outliers low and therefore increased the robustness.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信