Neural speech tracking in noise reflects the opposing influence of SNR on intelligibility and attentional effort.

Abstract

Understanding speech in noise depends on several interacting factors, including the signal-to-noise ratio (SNR), speech intelligibility (SI), and attentional engagement. However, how these factors relate to selective neural speech tracking remains unclear. In this study, we recorded EEG and eye-tracking data while participants performed a selective listening task involving a target talker in the presence of a competing masker talker and background noise across a wide range of SNRs. Our results revealed a non-linear relationship, where neural tracking of the target speech first increased with SNR but then paradoxically decreased as SNR continued to improve. To explain this, we quantified SI behaviorally, estimated attentional effort (AE) using gaze velocity, and measured behavioral performance (BP) via a repeated-word detection task. Our analysis showed that neural tracking of the target speech increased with both SI and attentional engagement. However, when intelligibility reached ceiling levels, selective neural speech tracking decreased as AE declined. Statistical modeling indicated that SI and AE were reliable predictors of neural tracking, while SNR showed no independent contribution after accounting for these factors. Our results demonstrate that improved SNR influences selective neural speech tracking primarily by increasing SI and simultaneously reducing AE, which have opposing effects on neural tracking. These findings underscore the importance of jointly considering these factors in studies of speech perception in noise.