{"title":"BrainFuseNet:通过 EEG-PPG 加速计传感器融合和高效边缘部署增强可穿戴式癫痫发作检测能力","authors":"Thorir Mar Ingolfsson;Xiaying Wang;Upasana Chakraborty;Simone Benatti;Adriano Bernini;Pauline Ducouret;Philippe Ryvlin;Sándor Beniczky;Luca Benini;Andrea Cossettini","doi":"10.1109/TBCAS.2024.3395534","DOIUrl":null,"url":null,"abstract":"This paper introduces \n<sc>BrainFuseNet</small>\n, a novel lightweight seizure detection network based on the sensor fusion of electroencephalography (EEG) with photoplethysmography (PPG) and accelerometer (ACC) signals, tailored for low-channel count wearable systems. \n<sc>BrainFuseNet</small>\n utilizes the Sensitivity-Specificity Weighted Cross-Entropy (SSWCE), an innovative loss function incorporating sensitivity and specificity, to address the challenge of heavily unbalanced datasets. The \n<sc>BrainFuseNet</small>\n-SSWCE approach successfully detects \n<inline-formula><tex-math>$93.5\\%$</tex-math></inline-formula>\n seizure events on the CHB-MIT dataset (\n<inline-formula><tex-math>$76.34\\%$</tex-math></inline-formula>\n sample-based sensitivity), for EEG-based classification with only four channels. On the PEDESITE dataset, we demonstrate a sample-based sensitivity and false positive rate of \n<inline-formula><tex-math>$60.66\\%$</tex-math></inline-formula>\n and \n<inline-formula><tex-math>$1.18$</tex-math></inline-formula>\n FP/h, respectively, when considering EEG data alone. Additionally, we demonstrate that integrating PPG signals increases the sensitivity to \n<inline-formula><tex-math>$61.22\\%$</tex-math></inline-formula>\n (successfully detecting \n<inline-formula><tex-math>$92\\%$</tex-math></inline-formula>\n seizure events) while decreasing the number of false positives to \n<inline-formula><tex-math>$1.0$</tex-math></inline-formula>\n FP/h. Finally, when ACC data are also considered, the sensitivity increases to \n<inline-formula><tex-math>$64.28\\%$</tex-math></inline-formula>\n (successfully detecting \n<inline-formula><tex-math>$95\\%$</tex-math></inline-formula>\n seizure events) and the number of false positives drops to only \n<inline-formula><tex-math>$0.21$</tex-math></inline-formula>\n FP/h for sample-based estimations, with less than one false alarm per day when considering event-based estimations. \n<sc>BrainFuseNet</small>\n is resource-friendly and well-suited for implementation on low-power embedded platforms, and we evaluate its performance on GAP9, a state-of-the-art parallel ultra-low power (PULP) microcontroller for tiny Machine Learning applications on wearables. The implementation on GAP9 achieves an energy efficiency of \n<inline-formula><tex-math>$21.43$</tex-math></inline-formula>\n GMAC/s/W, with an energy consumption per inference of only \n<inline-formula><tex-math>$0.11$</tex-math></inline-formula>\n mJ at high performance (\n<inline-formula><tex-math>$412.54$</tex-math></inline-formula>\n MMAC/s). The \n<sc>BrainFuseNet</small>\n-SSWCE method demonstrates effective and accurate seizure detection on heavily imbalanced datasets while achieving state-of-the-art performance in the false positive rate and being well-suited for deployment on energy-constrained edge devices.","PeriodicalId":94031,"journal":{"name":"IEEE transactions on biomedical circuits and systems","volume":"18 4","pages":"720-733"},"PeriodicalIF":0.0000,"publicationDate":"2024-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10511055","citationCount":"0","resultStr":"{\"title\":\"BrainFuseNet: Enhancing Wearable Seizure Detection Through EEG-PPG-Accelerometer Sensor Fusion and Efficient Edge Deployment\",\"authors\":\"Thorir Mar Ingolfsson;Xiaying Wang;Upasana Chakraborty;Simone Benatti;Adriano Bernini;Pauline Ducouret;Philippe Ryvlin;Sándor Beniczky;Luca Benini;Andrea Cossettini\",\"doi\":\"10.1109/TBCAS.2024.3395534\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper introduces \\n<sc>BrainFuseNet</small>\\n, a novel lightweight seizure detection network based on the sensor fusion of electroencephalography (EEG) with photoplethysmography (PPG) and accelerometer (ACC) signals, tailored for low-channel count wearable systems. \\n<sc>BrainFuseNet</small>\\n utilizes the Sensitivity-Specificity Weighted Cross-Entropy (SSWCE), an innovative loss function incorporating sensitivity and specificity, to address the challenge of heavily unbalanced datasets. The \\n<sc>BrainFuseNet</small>\\n-SSWCE approach successfully detects \\n<inline-formula><tex-math>$93.5\\\\%$</tex-math></inline-formula>\\n seizure events on the CHB-MIT dataset (\\n<inline-formula><tex-math>$76.34\\\\%$</tex-math></inline-formula>\\n sample-based sensitivity), for EEG-based classification with only four channels. On the PEDESITE dataset, we demonstrate a sample-based sensitivity and false positive rate of \\n<inline-formula><tex-math>$60.66\\\\%$</tex-math></inline-formula>\\n and \\n<inline-formula><tex-math>$1.18$</tex-math></inline-formula>\\n FP/h, respectively, when considering EEG data alone. Additionally, we demonstrate that integrating PPG signals increases the sensitivity to \\n<inline-formula><tex-math>$61.22\\\\%$</tex-math></inline-formula>\\n (successfully detecting \\n<inline-formula><tex-math>$92\\\\%$</tex-math></inline-formula>\\n seizure events) while decreasing the number of false positives to \\n<inline-formula><tex-math>$1.0$</tex-math></inline-formula>\\n FP/h. Finally, when ACC data are also considered, the sensitivity increases to \\n<inline-formula><tex-math>$64.28\\\\%$</tex-math></inline-formula>\\n (successfully detecting \\n<inline-formula><tex-math>$95\\\\%$</tex-math></inline-formula>\\n seizure events) and the number of false positives drops to only \\n<inline-formula><tex-math>$0.21$</tex-math></inline-formula>\\n FP/h for sample-based estimations, with less than one false alarm per day when considering event-based estimations. \\n<sc>BrainFuseNet</small>\\n is resource-friendly and well-suited for implementation on low-power embedded platforms, and we evaluate its performance on GAP9, a state-of-the-art parallel ultra-low power (PULP) microcontroller for tiny Machine Learning applications on wearables. The implementation on GAP9 achieves an energy efficiency of \\n<inline-formula><tex-math>$21.43$</tex-math></inline-formula>\\n GMAC/s/W, with an energy consumption per inference of only \\n<inline-formula><tex-math>$0.11$</tex-math></inline-formula>\\n mJ at high performance (\\n<inline-formula><tex-math>$412.54$</tex-math></inline-formula>\\n MMAC/s). The \\n<sc>BrainFuseNet</small>\\n-SSWCE method demonstrates effective and accurate seizure detection on heavily imbalanced datasets while achieving state-of-the-art performance in the false positive rate and being well-suited for deployment on energy-constrained edge devices.\",\"PeriodicalId\":94031,\"journal\":{\"name\":\"IEEE transactions on biomedical circuits and systems\",\"volume\":\"18 4\",\"pages\":\"720-733\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-04-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10511055\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE transactions on biomedical circuits and systems\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10511055/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on biomedical circuits and systems","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10511055/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
BrainFuseNet: Enhancing Wearable Seizure Detection Through EEG-PPG-Accelerometer Sensor Fusion and Efficient Edge Deployment
This paper introduces
BrainFuseNet
, a novel lightweight seizure detection network based on the sensor fusion of electroencephalography (EEG) with photoplethysmography (PPG) and accelerometer (ACC) signals, tailored for low-channel count wearable systems.
BrainFuseNet
utilizes the Sensitivity-Specificity Weighted Cross-Entropy (SSWCE), an innovative loss function incorporating sensitivity and specificity, to address the challenge of heavily unbalanced datasets. The
BrainFuseNet
-SSWCE approach successfully detects
$93.5\%$
seizure events on the CHB-MIT dataset (
$76.34\%$
sample-based sensitivity), for EEG-based classification with only four channels. On the PEDESITE dataset, we demonstrate a sample-based sensitivity and false positive rate of
$60.66\%$
and
$1.18$
FP/h, respectively, when considering EEG data alone. Additionally, we demonstrate that integrating PPG signals increases the sensitivity to
$61.22\%$
(successfully detecting
$92\%$
seizure events) while decreasing the number of false positives to
$1.0$
FP/h. Finally, when ACC data are also considered, the sensitivity increases to
$64.28\%$
(successfully detecting
$95\%$
seizure events) and the number of false positives drops to only
$0.21$
FP/h for sample-based estimations, with less than one false alarm per day when considering event-based estimations.
BrainFuseNet
is resource-friendly and well-suited for implementation on low-power embedded platforms, and we evaluate its performance on GAP9, a state-of-the-art parallel ultra-low power (PULP) microcontroller for tiny Machine Learning applications on wearables. The implementation on GAP9 achieves an energy efficiency of
$21.43$
GMAC/s/W, with an energy consumption per inference of only
$0.11$
mJ at high performance (
$412.54$
MMAC/s). The
BrainFuseNet
-SSWCE method demonstrates effective and accurate seizure detection on heavily imbalanced datasets while achieving state-of-the-art performance in the false positive rate and being well-suited for deployment on energy-constrained edge devices.