A dual‐modality study on the neural features of cochlear implant simulated tone and consonant perception

Abstract

Accurately perceiving lexical tones and consonants is critical for understanding speech in tonal languages. Cochlear implant (CI) users exhibit reduced phonetic perception due to spectral loss in CI encoding, yet the underlying neural mechanisms remain unclear. This study combined electroencephalography and functional near‐infrared spectroscopy (fNIRS) to investigate the neural processing mechanisms of CI‐simulated channelized speech in 26 normal‐hearing adults during the processing of tones (T1–T4) and consonants (“ba,” “da,” “ga,” “za”). Results showed that the N1 amplitude in auditory evoked potentials was significantly lower for channelized speech than a natural human voice (NH), particularly for T2 and T4 tones, indicating a weaker perception of channelized speech. Functional connectivity analysis revealed that an NH exhibited significantly higher synchrony in the δ and θ frequency bands than channelized speech, which was more pronounced in the right temporal lobe. This finding was also observed with “za” consonants. fNIRS results showed stronger right temporal lobe activation for channelized speech, suggesting that the brain requires greater auditory effort to process channelized speech. Combining both modalities revealed neural compensatory mechanisms underlying channelized speech—manifesting as “low‐efficiency perception with high cognitive load.” This study provides potential biomarkers for CI rehabilitation assessment and a foundation for future research.