D. Nhu, M. Janmohamed, L. Shakhatreh, O. Gonen, P. Perucca, A. Gilligan, P. Kwan, T. O'Brien, C. Tan, L. Kuhlmann
{"title":"Automated Interictal Epileptiform Discharge Detection From Scalp EEG Using Scalable Time-series Classification Approaches","authors":"D. Nhu, M. Janmohamed, L. Shakhatreh, O. Gonen, P. Perucca, A. Gilligan, P. Kwan, T. O'Brien, C. Tan, L. Kuhlmann","doi":"10.1101/2022.07.06.22277287","DOIUrl":null,"url":null,"abstract":"Deep learning for automated interictal epileptiform discharge (IED) detection has been topical with many published papers in recent years. All existing work viewed EEG signals as time-series and developed specific models for IED classification; however, general time-series classification (TSC) methods were not considered. Moreover, none of these methods were evaluated on any public datasets, making direct comparisons challenging. This paper explored two state-of-the-art convolutional-based TSC algorithms, InceptionTime and Minirocket, on IED detection. We fine-tuned and cross-evaluated them on two private and public (Temple University Events - TUEV) datasets and provided ready metrics for benchmarking future work. We observed that the optimal parameters correlated with the clinical duration of an IED and achieved the best AUC, AUPRC and F1 scores of 0.98, 0.80 and 0.77 on the private datasets, respectively. The AUC, AUPRC and F1 on TUEV were 0.99, 0.99 and 0.97, respectively. While algorithms trained on the private sets maintained the performance when tested on the TUEV data, those trained on TUEV could not generalise well to the private data. These results emerge from differences in the class distributions across datasets and indicate a need for public datasets with a better diversity of IED waveforms, background activities and artifacts to facilitate standardisation and benchmarking of algorithms.","PeriodicalId":50305,"journal":{"name":"International Journal of Neural Systems","volume":"1 1","pages":"2350001"},"PeriodicalIF":6.6000,"publicationDate":"2022-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Neural Systems","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1101/2022.07.06.22277287","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 2
Abstract
Deep learning for automated interictal epileptiform discharge (IED) detection has been topical with many published papers in recent years. All existing work viewed EEG signals as time-series and developed specific models for IED classification; however, general time-series classification (TSC) methods were not considered. Moreover, none of these methods were evaluated on any public datasets, making direct comparisons challenging. This paper explored two state-of-the-art convolutional-based TSC algorithms, InceptionTime and Minirocket, on IED detection. We fine-tuned and cross-evaluated them on two private and public (Temple University Events - TUEV) datasets and provided ready metrics for benchmarking future work. We observed that the optimal parameters correlated with the clinical duration of an IED and achieved the best AUC, AUPRC and F1 scores of 0.98, 0.80 and 0.77 on the private datasets, respectively. The AUC, AUPRC and F1 on TUEV were 0.99, 0.99 and 0.97, respectively. While algorithms trained on the private sets maintained the performance when tested on the TUEV data, those trained on TUEV could not generalise well to the private data. These results emerge from differences in the class distributions across datasets and indicate a need for public datasets with a better diversity of IED waveforms, background activities and artifacts to facilitate standardisation and benchmarking of algorithms.
期刊介绍:
The International Journal of Neural Systems is a monthly, rigorously peer-reviewed transdisciplinary journal focusing on information processing in both natural and artificial neural systems. Special interests include machine learning, computational neuroscience and neurology. The journal prioritizes innovative, high-impact articles spanning multiple fields, including neurosciences and computer science and engineering. It adopts an open-minded approach to this multidisciplinary field, serving as a platform for novel ideas and enhanced understanding of collective and cooperative phenomena in computationally capable systems.