Lan Mei, Cristian Cioflan, Thorir Mar Ingolfsson, Victor Kartsch, Andrea Cossettini, Xiaying Wang, Luca Benini
{"title":"Train-On-Request: An On-Device Continual Learning Workflow for Adaptive Real-World Brain Machine Interfaces","authors":"Lan Mei, Cristian Cioflan, Thorir Mar Ingolfsson, Victor Kartsch, Andrea Cossettini, Xiaying Wang, Luca Benini","doi":"arxiv-2409.09161","DOIUrl":null,"url":null,"abstract":"Brain-machine interfaces (BMIs) are expanding beyond clinical settings thanks\nto advances in hardware and algorithms. However, they still face challenges in\nuser-friendliness and signal variability. Classification models need periodic\nadaptation for real-life use, making an optimal re-training strategy essential\nto maximize user acceptance and maintain high performance. We propose TOR, a\ntrain-on-request workflow that enables user-specific model adaptation to novel\nconditions, addressing signal variability over time. Using continual learning,\nTOR preserves knowledge across sessions and mitigates inter-session\nvariability. With TOR, users can refine, on demand, the model through on-device\nlearning (ODL) to enhance accuracy adapting to changing conditions. We evaluate\nthe proposed methodology on a motor-movement dataset recorded with a\nnon-stigmatizing wearable BMI headband, achieving up to 92% accuracy and a\nre-calibration time as low as 1.6 minutes, a 46% reduction compared to a naive\ntransfer learning workflow. We additionally demonstrate that TOR is suitable\nfor ODL in extreme edge settings by deploying the training procedure on a\nRISC-V ultra-low-power SoC (GAP9), resulting in 21.6 ms of latency and 1 mJ of\nenergy consumption per training step. To the best of our knowledge, this work\nis the first demonstration of an online, energy-efficient, dynamic adaptation\nof a BMI model to the intrinsic variability of EEG signals in real-time\nsettings.","PeriodicalId":501034,"journal":{"name":"arXiv - EE - Signal Processing","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - EE - Signal Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.09161","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Brain-machine interfaces (BMIs) are expanding beyond clinical settings thanks
to advances in hardware and algorithms. However, they still face challenges in
user-friendliness and signal variability. Classification models need periodic
adaptation for real-life use, making an optimal re-training strategy essential
to maximize user acceptance and maintain high performance. We propose TOR, a
train-on-request workflow that enables user-specific model adaptation to novel
conditions, addressing signal variability over time. Using continual learning,
TOR preserves knowledge across sessions and mitigates inter-session
variability. With TOR, users can refine, on demand, the model through on-device
learning (ODL) to enhance accuracy adapting to changing conditions. We evaluate
the proposed methodology on a motor-movement dataset recorded with a
non-stigmatizing wearable BMI headband, achieving up to 92% accuracy and a
re-calibration time as low as 1.6 minutes, a 46% reduction compared to a naive
transfer learning workflow. We additionally demonstrate that TOR is suitable
for ODL in extreme edge settings by deploying the training procedure on a
RISC-V ultra-low-power SoC (GAP9), resulting in 21.6 ms of latency and 1 mJ of
energy consumption per training step. To the best of our knowledge, this work
is the first demonstration of an online, energy-efficient, dynamic adaptation
of a BMI model to the intrinsic variability of EEG signals in real-time
settings.