{"title":"BrainFuseNet: Enhancing Wearable Seizure Detection Through EEG-PPG-Accelerometer Sensor Fusion and Efficient Edge Deployment","authors":"Thorir Mar Ingolfsson;Xiaying Wang;Upasana Chakraborty;Simone Benatti;Adriano Bernini;Pauline Ducouret;Philippe Ryvlin;Sándor Beniczky;Luca Benini;Andrea Cossettini","doi":"10.1109/TBCAS.2024.3395534","DOIUrl":null,"url":null,"abstract":"This paper introduces \n<sc>BrainFuseNet</small>\n, a novel lightweight seizure detection network based on the sensor fusion of electroencephalography (EEG) with photoplethysmography (PPG) and accelerometer (ACC) signals, tailored for low-channel count wearable systems. \n<sc>BrainFuseNet</small>\n utilizes the Sensitivity-Specificity Weighted Cross-Entropy (SSWCE), an innovative loss function incorporating sensitivity and specificity, to address the challenge of heavily unbalanced datasets. The \n<sc>BrainFuseNet</small>\n-SSWCE approach successfully detects \n<inline-formula><tex-math>$93.5\\%$</tex-math></inline-formula>\n seizure events on the CHB-MIT dataset (\n<inline-formula><tex-math>$76.34\\%$</tex-math></inline-formula>\n sample-based sensitivity), for EEG-based classification with only four channels. On the PEDESITE dataset, we demonstrate a sample-based sensitivity and false positive rate of \n<inline-formula><tex-math>$60.66\\%$</tex-math></inline-formula>\n and \n<inline-formula><tex-math>$1.18$</tex-math></inline-formula>\n FP/h, respectively, when considering EEG data alone. Additionally, we demonstrate that integrating PPG signals increases the sensitivity to \n<inline-formula><tex-math>$61.22\\%$</tex-math></inline-formula>\n (successfully detecting \n<inline-formula><tex-math>$92\\%$</tex-math></inline-formula>\n seizure events) while decreasing the number of false positives to \n<inline-formula><tex-math>$1.0$</tex-math></inline-formula>\n FP/h. Finally, when ACC data are also considered, the sensitivity increases to \n<inline-formula><tex-math>$64.28\\%$</tex-math></inline-formula>\n (successfully detecting \n<inline-formula><tex-math>$95\\%$</tex-math></inline-formula>\n seizure events) and the number of false positives drops to only \n<inline-formula><tex-math>$0.21$</tex-math></inline-formula>\n FP/h for sample-based estimations, with less than one false alarm per day when considering event-based estimations. \n<sc>BrainFuseNet</small>\n is resource-friendly and well-suited for implementation on low-power embedded platforms, and we evaluate its performance on GAP9, a state-of-the-art parallel ultra-low power (PULP) microcontroller for tiny Machine Learning applications on wearables. The implementation on GAP9 achieves an energy efficiency of \n<inline-formula><tex-math>$21.43$</tex-math></inline-formula>\n GMAC/s/W, with an energy consumption per inference of only \n<inline-formula><tex-math>$0.11$</tex-math></inline-formula>\n mJ at high performance (\n<inline-formula><tex-math>$412.54$</tex-math></inline-formula>\n MMAC/s). The \n<sc>BrainFuseNet</small>\n-SSWCE method demonstrates effective and accurate seizure detection on heavily imbalanced datasets while achieving state-of-the-art performance in the false positive rate and being well-suited for deployment on energy-constrained edge devices.","PeriodicalId":94031,"journal":{"name":"IEEE transactions on biomedical circuits and systems","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10511055","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on biomedical circuits and systems","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10511055/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
This paper introduces
BrainFuseNet
, a novel lightweight seizure detection network based on the sensor fusion of electroencephalography (EEG) with photoplethysmography (PPG) and accelerometer (ACC) signals, tailored for low-channel count wearable systems.
BrainFuseNet
utilizes the Sensitivity-Specificity Weighted Cross-Entropy (SSWCE), an innovative loss function incorporating sensitivity and specificity, to address the challenge of heavily unbalanced datasets. The
BrainFuseNet
-SSWCE approach successfully detects
$93.5\%$
seizure events on the CHB-MIT dataset (
$76.34\%$
sample-based sensitivity), for EEG-based classification with only four channels. On the PEDESITE dataset, we demonstrate a sample-based sensitivity and false positive rate of
$60.66\%$
and
$1.18$
FP/h, respectively, when considering EEG data alone. Additionally, we demonstrate that integrating PPG signals increases the sensitivity to
$61.22\%$
(successfully detecting
$92\%$
seizure events) while decreasing the number of false positives to
$1.0$
FP/h. Finally, when ACC data are also considered, the sensitivity increases to
$64.28\%$
(successfully detecting
$95\%$
seizure events) and the number of false positives drops to only
$0.21$
FP/h for sample-based estimations, with less than one false alarm per day when considering event-based estimations.
BrainFuseNet
is resource-friendly and well-suited for implementation on low-power embedded platforms, and we evaluate its performance on GAP9, a state-of-the-art parallel ultra-low power (PULP) microcontroller for tiny Machine Learning applications on wearables. The implementation on GAP9 achieves an energy efficiency of
$21.43$
GMAC/s/W, with an energy consumption per inference of only
$0.11$
mJ at high performance (
$412.54$
MMAC/s). The
BrainFuseNet
-SSWCE method demonstrates effective and accurate seizure detection on heavily imbalanced datasets while achieving state-of-the-art performance in the false positive rate and being well-suited for deployment on energy-constrained edge devices.