Two common issues in synchronized multimodal recordings with EEG: Jitter and latency

Abstract

Multimodal recording using electroencephalogram (EEG) and other biological signals (e.g., muscle activities, eye movement, pupil diameters, or body kinematics data) is ubiquitous in human neuroscience research. However, the precise time alignment of multiple data from heterogeneous sources (i.e., devices) is often arduous due to variable recording parameters of commercially available research devices and complex experimental setups. In this review, we introduced the versatility of a Lab Streaming Layer (LSL)-based application that can overcome two common issues in measuring multimodal data: jitter and latency. We discussed the issues of jitter and latency in multimodal recordings and the benefits of time-synchronization when recording with multiple devices. In addition, a computer simulation was performed to highlight how the millisecond-order jitter readily affects the signal-to-noise ratio of the electrophysiological outcome. Together, we argue that the LSL-based system can be used for research requiring precise time-alignment of datasets. Studies that detect stimulus-induced transient neural responses or test hypotheses regarding temporal relationships of different functional aspects with multimodal data would benefit most from LSL-based systems.