William Matchin, Diogo Almeida, Gregory Hickok, Jon Sprouse
{"title":"A Functional Magnetic Resonance Imaging Study of Phrase Structure and Subject Island Violations.","authors":"William Matchin, Diogo Almeida, Gregory Hickok, Jon Sprouse","doi":"10.1162/jocn_a_02266","DOIUrl":"10.1162/jocn_a_02266","url":null,"abstract":"<p><p>In principle, functional neuroimaging provides uniquely informative data in addressing linguistic questions, because it can indicate distinct processes that are not apparent from behavioral data alone. This could involve adjudicating the source of unacceptability via the different patterns of elicited brain responses to different ungrammatical sentence types. However, it is difficult to interpret brain activations to syntactic violations. Such responses could reflect processes that have nothing intrinsically related to linguistic representations, such as domain-general executive function abilities. To facilitate the potential use of functional neuroimaging methods to identify the source of different syntactic violations, we conducted a functional magnetic resonance imaging experiment to identify the brain activation maps associated with two distinct syntactic violation types: phrase structure (created by inverting the order of two adjacent words within a sentence) and subject islands (created by extracting a wh-phrase out of an embedded subject). The comparison of these violations to control sentences surprisingly showed no indication of a generalized violation response, with almost completely divergent activation patterns. Phrase structure violations seemingly activated regions previously implicated in verbal working memory and structural complexity in sentence processing, whereas the subject islands appeared to activate regions previously implicated in conceptual-semantic processing, broadly defined. We review our findings in the context of previous research on syntactic and semantic violations using ERPs. Although our results suggest potentially distinct underlying mechanisms underlying phrase structure and subject island violations, our results are tentative and suggest important methodological considerations for future research in this area.</p>","PeriodicalId":51081,"journal":{"name":"Journal of Cognitive Neuroscience","volume":" ","pages":"1-29"},"PeriodicalIF":3.1,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142607240","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Movement Strategy Moderates the Effect of Spatially Congruent Cues on the Stability of Rhythmic Bimanual Finger Movements.","authors":"Ronan Denyer, Lara A Boyd","doi":"10.1162/jocn_a_02268","DOIUrl":"https://doi.org/10.1162/jocn_a_02268","url":null,"abstract":"<p><p>Spatially congruent cues increase the speed of bimanual reach decisions compared with abstract symbolic cues, particularly for asymmetric reaches. Asymmetric rhythmic bimanual movements are less stable than symmetric rhythmic movements, but it is not well understood if spatially congruent cues similarly increase the stability of asymmetric rhythmic bimanual movements. To address this question, in Experiment 1, participants performed symmetric and asymmetric bimanual rhythmic finger tapping movements at different movement frequencies in time with flickering spatially congruent and abstract symbolic stimuli. As expected, symmetric movements were more stable. Spatially congruent cues similarly increased the stability of symmetric and asymmetric movements compared with abstract symbolic cues. The benefits of spatial congruence and movement symmetry were restricted to high movement frequencies (>2 Hz). To better understand if the emergence of these effects at high movement frequencies was driven by a change in movement strategy, in Experiment 2, video of the hands was concurrently recorded during task performance. Markerless motion tracking software revealed that participants switched from discontinuous to continuous movement strategies with increasing movement frequency. Because discontinuous and continuous movements are thought to be controlled by distinct neurocognitive systems, this might explain why the beneficial effects of spatial congruence and response symmetry emerged only at high movement frequencies. Overall, results from the current study indicate that the perceptual quality of the stimulus use to cue movement frequency can have powerful effects on the stability of rhythmic bimanual movements, but that these effects may depend on whether discontinuous or continuous movement strategies are selected.</p>","PeriodicalId":51081,"journal":{"name":"Journal of Cognitive Neuroscience","volume":" ","pages":"1-20"},"PeriodicalIF":3.1,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142584924","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Impact of Selective Attention and Musical Training on the Cortical Speech Tracking in the Delta and Theta Frequency Bands.","authors":"Alina Schüller, Annika Mücke, Jasmin Riegel, Tobias Reichenbach","doi":"10.1162/jocn_a_02275","DOIUrl":"https://doi.org/10.1162/jocn_a_02275","url":null,"abstract":"<p><p>Oral communication regularly takes place amidst background noise, requiring the ability to selectively attend to a target speech stream. Musical training has been shown to be beneficial for this task. Regarding the underlying neural mechanisms, recent studies showed that the speech envelope is tracked by neural activity in auditory cortex, which plays a role in the neural processing of speech, including speech in noise. The neural tracking occurs predominantly in two frequency bands, the delta and the theta bands. However, much regarding the specifics of these neural responses, as well as their modulation through musical training, still remain unclear. Here, we investigated the delta- and theta-band cortical tracking of the speech envelope of attended and ignored speech using magnetoencephalography (MEG) recordings. We thereby assessed both musicians and nonmusicians to explore potential differences between these groups. The cortical speech tracking was quantified through source-reconstructing the MEG data and subsequently relating the speech envelope in a certain frequency band to the MEG data using linear models. We thereby found the theta-band tracking to be dominated by early responses with comparable magnitudes for attended and ignored speech, whereas the delta band tracking exhibited both earlier and later responses that were modulated by selective attention. Almost no significant differences emerged in the neural responses between musicians and nonmusicians. Our findings show that only the speech tracking in the delta but not in the theta band contributes to selective attention, but that this mechanism is essentially unaffected by musical training.</p>","PeriodicalId":51081,"journal":{"name":"Journal of Cognitive Neuroscience","volume":" ","pages":"1-18"},"PeriodicalIF":3.1,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142607310","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Cybelle M. Smith;Sharon L. Thompson-Schill;Anna C. Schapiro
{"title":"Rapid Learning of Temporal Dependencies at Multiple Timescales","authors":"Cybelle M. Smith;Sharon L. Thompson-Schill;Anna C. Schapiro","doi":"10.1162/jocn_a_02232","DOIUrl":"10.1162/jocn_a_02232","url":null,"abstract":"Our environment contains temporal information unfolding simultaneously at multiple timescales. How do we learn and represent these dynamic and overlapping information streams? We investigated these processes in a statistical learning paradigm with simultaneous short and long timescale contingencies. Human participants (n = 96) played a game where they learned to quickly click on a target image when it appeared in one of nine locations, in eight different contexts. Across contexts, we manipulated the order of target locations: at a short timescale, the order of pairs of sequential locations in which the target appeared; at a longer timescale, the set of locations that appeared in the first versus the second half of the game. Participants periodically predicted the upcoming target location, and later performed similarity judgments comparing the games based on their order properties. Participants showed context-dependent sensitivity to order information at both short and long timescales, with evidence of stronger learning for short timescales. We modeled the learning paradigm using a gated recurrent network trained to make immediate predictions, which demonstrated multilevel learning timecourses and patterns of sensitivity to the similarity structure of the games that mirrored human participants. The model grouped games with matching rule structure and dissociated games based on low-level order information more so than high-level order information. The work shows how humans and models can rapidly and concurrently acquire order information at different timescales.","PeriodicalId":51081,"journal":{"name":"Journal of Cognitive Neuroscience","volume":"36 11","pages":"2343-2356"},"PeriodicalIF":3.1,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141898869","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Human Visual Pathways for Action Recognition versus Deep Convolutional Neural Networks: Representation Correspondence in Late but Not Early Layers","authors":"Yujia Peng;Xizi Gong;Hongjing Lu;Fang Fang","doi":"10.1162/jocn_a_02233","DOIUrl":"10.1162/jocn_a_02233","url":null,"abstract":"Deep convolutional neural networks (DCNNs) have attained human-level performance for object categorization and exhibited representation alignment between network layers and brain regions. Does such representation alignment naturally extend to other visual tasks beyond recognizing objects in static images? In this study, we expanded the exploration to the recognition of human actions from videos and assessed the representation capabilities and alignment of two-stream DCNNs in comparison with brain regions situated along ventral and dorsal pathways. Using decoding analysis and representational similarity analysis, we show that DCNN models do not show hierarchical representation alignment to human brain across visual regions when processing action videos. Instead, later layers of DCNN models demonstrate greater representation similarities to the human visual cortex. These findings were revealed for two display formats: photorealistic avatars with full-body information and simplified stimuli in the point-light display. The discrepancies in representation alignment suggest fundamental differences in how DCNNs and the human brain represent dynamic visual information related to actions.","PeriodicalId":51081,"journal":{"name":"Journal of Cognitive Neuroscience","volume":"36 11","pages":"2458-2480"},"PeriodicalIF":3.1,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10738325","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141898868","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Emily T. Cowan;Avi J. Chanales;Lila Davachi;David Clewett
{"title":"Goal Shifts Structure Memories and Prioritize Event-defining Information in Memory","authors":"Emily T. Cowan;Avi J. Chanales;Lila Davachi;David Clewett","doi":"10.1162/jocn_a_02220","DOIUrl":"10.1162/jocn_a_02220","url":null,"abstract":"Every day, we encounter far more information than we could possibly remember. Thus, our memory systems must organize and prioritize the details from an experience that can adaptively guide the storage and retrieval of specific episodic events. Prior work has shown that shifts in internal goal states can function as event boundaries, chunking experiences into distinct and memorable episodes. In addition, at short delays, memory for contextual information at boundaries has been shown to be enhanced compared with items within each event. However, it remains unclear if these memory enhancements are limited to features that signal a meaningful transition between events. To determine how changes in dynamic goal states influence the organization and content of long-term memory, we designed a 2-day experiment in which participants viewed a series of black-and-white objects surrounded by a color border on a two-by-two grid. The location of the object on the grid determined which of two tasks participants performed on a given trial. To examine if distinct types of goal shifts modulate the effects of event segmentation, we changed the border color, the task, or both after every four items in a sequence. We found that goal shifts influenced temporal memory in a manner consistent with the formation of distinct events. However, for subjective memory representations in particular, these effects differed by the type of event boundary. Furthermore, to examine if goal shifts lead to the prioritization of goal-relevant features in longer lasting memories, we tested source memory for each object's color and grid location both immediately and after a 24-hr delay. On the immediate test, boundaries enhanced the memory for all concurrent source features compared with nonboundary items, but only if those boundaries involved a goal shift. In contrast, after a delay, the source memory was selectively enhanced for the feature relevant to the goal shift. These findings suggest that goals can adaptively structure memories by prioritizing contextual features that define a unique episode in memory.","PeriodicalId":51081,"journal":{"name":"Journal of Cognitive Neuroscience","volume":"36 11","pages":"2415-2431"},"PeriodicalIF":3.1,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141591990","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Relationship between Event Boundary Strength and Pattern Shifts across the Cortical Hierarchy during Naturalistic Movie-viewing","authors":"Yoonjung Lee;Janice Chen","doi":"10.1162/jocn_a_02213","DOIUrl":"10.1162/jocn_a_02213","url":null,"abstract":"Our continuous experience is spontaneously segmented by the brain into discrete events. However, the beginning of a new event (an event boundary) is not always sharply identifiable: Phenomenologically, event boundaries vary in salience. How are the response profiles of cortical areas at event boundaries modulated by boundary strength during complex, naturalistic movie-viewing? Do cortical responses scale in a graded manner with boundary strength, or do they merely detect boundaries in a binary fashion? We measured “cortical boundary shifts” as transient changes in multivoxel patterns at event boundaries with different strengths (weak, moderate, and strong), determined by across-participant agreement. Cortical regions with different processing timescales were examined. In auditory areas, which have short timescales, cortical boundary shifts exhibited a clearly graded profile in both group-level and individual-level analyses. In cortical areas with long timescales, including the default mode network, boundary strength modulated pattern shift magnitude at the individual participant level. We also observed a positive relationship between boundary strength and the extent of temporal alignment of boundary shifts across different levels of the cortical hierarchy. In addition, hippocampal activity was highest at event boundaries for which cortical boundary shifts were most aligned across hierarchical levels. Overall, we found that event boundary strength modulated cortical pattern shifts strongly in sensory areas and more weakly in higher-level areas and that stronger boundaries were associated with greater alignment of these shifts across the cortical hierarchy.","PeriodicalId":51081,"journal":{"name":"Journal of Cognitive Neuroscience","volume":"36 11","pages":"2317-2342"},"PeriodicalIF":3.1,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141591994","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"“All the Stars Will Be Wells with a Rusty Pulley”: Neural Processing of the Social and Pragmatic Content in a Narrative","authors":"Melissa Thye;Paul Hoffman;Daniel Mirman","doi":"10.1162/jocn_a_02228","DOIUrl":"10.1162/jocn_a_02228","url":null,"abstract":"Making sense of natural language and narratives requires building and manipulating a situation model by adding incoming information to the model and using the context stored in the model to comprehend subsequent details and events. Situation model maintenance is supported by the default mode network (DMN), but comprehension of the individual moments in the narrative relies on access to the conceptual store within the semantic system. The present study examined how these systems are engaged by different narrative content to investigate whether highly informative, or semantic, content is a particularly strong driver of semantic system activation compared with contextually driven content that requires using the situation model, which might instead engage DMN regions. The study further investigated which subregions of the graded semantic hub in the left anterior temporal lobe (ATL) were engaged by the type of narrative content. To do this, we quantified the semantic, pragmatic, social, ambiguous, and emotional content for each sentence in a complete narrative, the English translation of The Little Prince. Increased activation in the transmodal hub in the ventral ATL was only observed for high semantic (i.e., informative) relative to low semantic sentences. Activation in the dorsolateral and ventrolateral ATL subregions was observed for both high relative to low semantic and social content sentences, but the ventrolateral ATL effects were more extensive in the social condition. There was high correspondence between the social and pragmatic content results, particularly in the ventrolateral ATL. We argue that the ventrolateral ATL may be particularly engaged by internal, or endogenous, processing demands, aided by functional connections between the anterior middle temporal gyrus and the DMN. Pragmatic and social content may have driven endogenous processing given the pervasive and plot-progressing nature of this content in the narrative. We put forward a revised account of how the semantic system is engaged in naturalistic contexts, a critical step toward better understanding real-world semantic and social processing.","PeriodicalId":51081,"journal":{"name":"Journal of Cognitive Neuroscience","volume":"36 11","pages":"2495-2517"},"PeriodicalIF":3.1,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141898866","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Isaac N. Treves;Kannammai Pichappan;Jude Hammoud;Clemens C. C. Bauer;Sebastian Ehmann;Matthew D. Sacchet;John D. E. Gabrieli
{"title":"The Mindful Brain: A Systematic Review of the Neural Correlates of Trait Mindfulness","authors":"Isaac N. Treves;Kannammai Pichappan;Jude Hammoud;Clemens C. C. Bauer;Sebastian Ehmann;Matthew D. Sacchet;John D. E. Gabrieli","doi":"10.1162/jocn_a_02230","DOIUrl":"10.1162/jocn_a_02230","url":null,"abstract":"Trait self-report mindfulness scales measure one's disposition to pay nonjudgmental attention to the present moment. Concerns have been raised about the validity of trait mindfulness scales. Despite this, there is extensive literature correlating mindfulness scales with objective brain measures, with the goal of providing insight into mechanisms of mindfulness, and insight into associated positive mental health outcomes. Here, we systematically examined the neural correlates of trait mindfulness. We assessed 68 correlational studies across structural magnetic resonance imaging, task-based fMRI, resting-state fMRI, and EEG. Several consistent findings were identified, associating greater trait mindfulness with decreased amygdala reactivity to emotional stimuli, increased cortical thickness in frontal regions and insular cortex regions, and decreased connectivity within the default-mode network. These findings converged with results from intervention studies and those that included mindfulness experts. On the other hand, the connections between trait mindfulness and EEG metrics remain inconclusive, as do the associations between trait mindfulness and between-network resting-state fMRI metrics. ERP measures from EEG used to measure attentional or emotional processing may not show reliable individual variation. Research on body awareness and self-relevant processing is scarce. For a more robust correlational neuroscience of trait mindfulness, we recommend larger sample sizes, data-driven, multivariate approaches to self-report and brain measures, and careful consideration of test–retest reliability. In addition, we should leave behind simplistic explanations of mindfulness, as there are many ways to be mindful, and leave behind simplistic explanations of the brain, as distributed networks of brain areas support mindfulness.","PeriodicalId":51081,"journal":{"name":"Journal of Cognitive Neuroscience","volume":"36 11","pages":"2518-2555"},"PeriodicalIF":3.1,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10738334","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141908301","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Remembering Sarah DuBrow across All Contexts","authors":"Alexa Tompary;Megan T. deBettencourt;Nina Rouhani","doi":"10.1162/jocn_a_02189","DOIUrl":"10.1162/jocn_a_02189","url":null,"abstract":"","PeriodicalId":51081,"journal":{"name":"Journal of Cognitive Neuroscience","volume":"36 11","pages":"2455-2457"},"PeriodicalIF":3.1,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140917370","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}