The cortical architecture representing the linguistic hierarchy of the conversational speech

Abstract

Recent studies demonstrate that the brain parses natural language into smaller units represented in lower-order regions and larger units in higher-order regions. Most of these studies, however, have been conducted on unidirectional narrative speech, leaving the linguistic hierarchy and its cortical representation in bidirectional conversational speech unexplored. To address this gap, we simultaneously measured brain activity from two individuals using functional near-infrared spectroscopy (fNIRS) hyperscanning while they engaged in a naturalistic conversation. Using a Pre-trained Language Model (PLM) and Representational Similarity Analysis (RSA), we demonstrated that conversational speech, jointly produced by two interlocutors in a turn-taking manner, exhibits a linguistic hierarchy, characterized by a boundary effect between linguistic units and an incremental context effect. Furthermore, a gradient pattern of shared cortical representation of the linguistic hierarchy was identified at the dyadic rather than the individual level. Interpersonal neural synchronization (INS) in the left superior temporal cortex was associated with turn representation, whereas INS in the medial prefrontal cortex was linked to topic representation. These findings further validated the distinctiveness of linguistic units of different sizes. Together, our results provide original evidence for the linguistic hierarchy and the underlying cortical architecture during a naturalistic conversation, extending the hierarchical nature of natural language from unidirectional narrative speech to bidirectional conversational speech.