Giridhar P. Kalamangalam , Subeikshanan Venkatesan , Maria-Jose Bruzzone , Yue Wang , Carolina B. Maciel , Sotiris Mitropanopoulos , Jean Cibula , Kajal Patel , Abbas Babajani-Feremi
{"title":"COMPRESSIVE DATA STORAGE FOR LONG-TERM EEG: VALIDATION BY VISUAL ANALYSIS","authors":"Giridhar P. Kalamangalam , Subeikshanan Venkatesan , Maria-Jose Bruzzone , Yue Wang , Carolina B. Maciel , Sotiris Mitropanopoulos , Jean Cibula , Kajal Patel , Abbas Babajani-Feremi","doi":"10.1016/j.cnp.2025.07.005","DOIUrl":null,"url":null,"abstract":"<div><h3>Objectives</h3><div>Long-term EEG monitoring (LTM) in acute neurology generates massive data volumes. We investigated whether data-analytic techniques could reduce LTM data size yet conserve their visual diagnostic features.</div></div><div><h3>Methods</h3><div>LTM exemplars from 50 patients underwent singular value decomposition (SVD). High-variance SVD components were transformed using discrete cosine transform (DCT), and significant elements run-length encoded. Two regimes were tested: (I) SVD and DCT compression ratio (CR) of 1.7 and 12, and (II) CR of 3.7 and 5.7; each achieved an overall CR of ≈20. Compressed data were reconstructed alongside uncompressed originals, to create a total of 200 recordings that were scored by two blinded reviewers. Scores of original and reconstructed data were statistically analyzed.</div></div><div><h3>Results</h3><div>Score differences between original recordings were smaller than comparisons involving reconstructions using the first regime but did not differ significantly from reconstructions using the second regime.</div></div><div><h3>Conclusions</h3><div>Raw LTM EEG has sufficient redundancy to undergo extreme (20-fold) data compression without compromising visual diagnostic information. A balanced mix of SVD and DCT appears to be a suitable data-analytic pipeline for achieving such compression.</div></div><div><h3>Significance</h3><div>Dimension reduction is a significant goal in managing big biomedical data. Our results suggest a pathway for archival of meaningful representations of entire LTM datasets. The latent space suggests new lines of data-scientific inquiry of the EEG in acute neurological illness.</div></div>","PeriodicalId":45697,"journal":{"name":"Clinical Neurophysiology Practice","volume":"10 ","pages":"Pages 331-339"},"PeriodicalIF":2.0000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical Neurophysiology Practice","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2467981X25000393","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"NEUROSCIENCES","Score":null,"Total":0}
引用次数: 0
Abstract
Objectives
Long-term EEG monitoring (LTM) in acute neurology generates massive data volumes. We investigated whether data-analytic techniques could reduce LTM data size yet conserve their visual diagnostic features.
Methods
LTM exemplars from 50 patients underwent singular value decomposition (SVD). High-variance SVD components were transformed using discrete cosine transform (DCT), and significant elements run-length encoded. Two regimes were tested: (I) SVD and DCT compression ratio (CR) of 1.7 and 12, and (II) CR of 3.7 and 5.7; each achieved an overall CR of ≈20. Compressed data were reconstructed alongside uncompressed originals, to create a total of 200 recordings that were scored by two blinded reviewers. Scores of original and reconstructed data were statistically analyzed.
Results
Score differences between original recordings were smaller than comparisons involving reconstructions using the first regime but did not differ significantly from reconstructions using the second regime.
Conclusions
Raw LTM EEG has sufficient redundancy to undergo extreme (20-fold) data compression without compromising visual diagnostic information. A balanced mix of SVD and DCT appears to be a suitable data-analytic pipeline for achieving such compression.
Significance
Dimension reduction is a significant goal in managing big biomedical data. Our results suggest a pathway for archival of meaningful representations of entire LTM datasets. The latent space suggests new lines of data-scientific inquiry of the EEG in acute neurological illness.
期刊介绍:
Clinical Neurophysiology Practice (CNP) is a new Open Access journal that focuses on clinical practice issues in clinical neurophysiology including relevant new research, case reports or clinical series, normal values and didactic reviews. It is an official journal of the International Federation of Clinical Neurophysiology and complements Clinical Neurophysiology which focuses on innovative research in the specialty. It has a role in supporting established clinical practice, and an educational role for trainees, technicians and practitioners.