Catalyzing EEG signal analysis: unveiling the potential of machine learning-enabled smart K nearest neighbor outlier detection

Abstract

Electroencephalogram (EEG) data are susceptible to artifacts, such as lapses in concentration or poor imagination, which can significantly impact the accuracy of disease diagnosis in e-health applications. To mitigate this issue, the use of machine learning (ML) and potentially artificial intelligence (AI) solutions to accurately identify outliers becomes crucial. Unlike many AI methods that incorporate unnecessary or redundant input variables, our study focuses on detecting anomalous values in EEG data through the K nearest neighbor (KNN) process and Euclidean distance metric. Our proposed unsupervised non-parametric algorithm, known as the smart KNN outlier detector (SKOD), eliminates the need for initial parameter configurations such as the number of neighbors (K), while achieving high performance. Evaluation of SKOD using real EEG data from 140 trials demonstrated sensitivity and specificity exceeding 60%, with nearly perfect accuracy in detecting outliers reaching close to 100%.