Martin Clinton Tosima Manullang;Yuan-Hsiang Lin;Nai-Kuan Chou
{"title":"基于变压器的面部视频血压估计网络","authors":"Martin Clinton Tosima Manullang;Yuan-Hsiang Lin;Nai-Kuan Chou","doi":"10.1109/JSEN.2024.3496115","DOIUrl":null,"url":null,"abstract":"Blood pressure (BP) monitoring is essential for diagnosing and managing various health conditions. While traditional contact-based methods have been effective, they can be uncomfortable for continuous or prolonged monitoring. The innovative discovery of remote photoplethysmography (rPPG) brings a new era for noncontact BP measurement. In this article, a transformer-based deep learning network named BP network (BPNet) was proposed to estimate noncontact BP from RGB videos. The BPNet comprises three primary components: the signal branch, feature branch, and predictor. The architecture is designed to integrate information from rPPG signal and their derivatives, rPPG features, and user inputs. A standout feature of our model is its capability to work without the need for calibration, making it more user-friendly. We assessed our model, BPNet, using two diverse datasets: our BESTLab dataset and the externally sourced Vital Video (VV) dataset, which is noted for its varied subject demographics and extensive BP distribution. The results show that BPNet outperforms recent benchmarks, marking a significant advancement in noncontact BP measurement technology. It also showed greater efficiency in terms of inference time and model complexity. In the future, the approach might focus on developing a fully automated deep learning system that removes the need for manual preprocessing and rPPG extraction. Furthermore, adding subject’s demographic features and medical history could improve accuracy.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 1","pages":"1969-1977"},"PeriodicalIF":4.3000,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Transformer-Based Network for Estimating Blood Pressure Using Facial Videos\",\"authors\":\"Martin Clinton Tosima Manullang;Yuan-Hsiang Lin;Nai-Kuan Chou\",\"doi\":\"10.1109/JSEN.2024.3496115\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Blood pressure (BP) monitoring is essential for diagnosing and managing various health conditions. While traditional contact-based methods have been effective, they can be uncomfortable for continuous or prolonged monitoring. The innovative discovery of remote photoplethysmography (rPPG) brings a new era for noncontact BP measurement. In this article, a transformer-based deep learning network named BP network (BPNet) was proposed to estimate noncontact BP from RGB videos. The BPNet comprises three primary components: the signal branch, feature branch, and predictor. The architecture is designed to integrate information from rPPG signal and their derivatives, rPPG features, and user inputs. A standout feature of our model is its capability to work without the need for calibration, making it more user-friendly. We assessed our model, BPNet, using two diverse datasets: our BESTLab dataset and the externally sourced Vital Video (VV) dataset, which is noted for its varied subject demographics and extensive BP distribution. The results show that BPNet outperforms recent benchmarks, marking a significant advancement in noncontact BP measurement technology. It also showed greater efficiency in terms of inference time and model complexity. In the future, the approach might focus on developing a fully automated deep learning system that removes the need for manual preprocessing and rPPG extraction. Furthermore, adding subject’s demographic features and medical history could improve accuracy.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"25 1\",\"pages\":\"1969-1977\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-11-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10756549/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10756549/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
A Transformer-Based Network for Estimating Blood Pressure Using Facial Videos
Blood pressure (BP) monitoring is essential for diagnosing and managing various health conditions. While traditional contact-based methods have been effective, they can be uncomfortable for continuous or prolonged monitoring. The innovative discovery of remote photoplethysmography (rPPG) brings a new era for noncontact BP measurement. In this article, a transformer-based deep learning network named BP network (BPNet) was proposed to estimate noncontact BP from RGB videos. The BPNet comprises three primary components: the signal branch, feature branch, and predictor. The architecture is designed to integrate information from rPPG signal and their derivatives, rPPG features, and user inputs. A standout feature of our model is its capability to work without the need for calibration, making it more user-friendly. We assessed our model, BPNet, using two diverse datasets: our BESTLab dataset and the externally sourced Vital Video (VV) dataset, which is noted for its varied subject demographics and extensive BP distribution. The results show that BPNet outperforms recent benchmarks, marking a significant advancement in noncontact BP measurement technology. It also showed greater efficiency in terms of inference time and model complexity. In the future, the approach might focus on developing a fully automated deep learning system that removes the need for manual preprocessing and rPPG extraction. Furthermore, adding subject’s demographic features and medical history could improve accuracy.
期刊介绍:
The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following:
-Sensor Phenomenology, Modelling, and Evaluation
-Sensor Materials, Processing, and Fabrication
-Chemical and Gas Sensors
-Microfluidics and Biosensors
-Optical Sensors
-Physical Sensors: Temperature, Mechanical, Magnetic, and others
-Acoustic and Ultrasonic Sensors
-Sensor Packaging
-Sensor Networks
-Sensor Applications
-Sensor Systems: Signals, Processing, and Interfaces
-Actuators and Sensor Power Systems
-Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting
-Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data)
-Sensors in Industrial Practice