Exploring the specificity of linguistic rule learning through reinforcement learning: Semantic and syntactic perspectives

IF 2.7 3区 医学 Q1 BEHAVIORAL SCIENCES
Yingyu Li , Xiyuan Wang , Weiwei Zhang , John W. Schwieter , Huanhuan Liu
{"title":"Exploring the specificity of linguistic rule learning through reinforcement learning: Semantic and syntactic perspectives","authors":"Yingyu Li ,&nbsp;Xiyuan Wang ,&nbsp;Weiwei Zhang ,&nbsp;John W. Schwieter ,&nbsp;Huanhuan Liu","doi":"10.1016/j.biopsycho.2025.109081","DOIUrl":null,"url":null,"abstract":"<div><div>Learning linguistic rules is crucial for human cognition, and recent studies have demonstrated that reinforcement learning modeling can effectively simulate rule learning in non-linguistic symbol systems. In this study, we use reinforcement learning to model trial-by-trial dynamic processes of semantic and syntactic rule learning in linguistic symbols (i.e., words in an artificial language) and non-linguistic symbols (i.e., shapes). By analyzing the effects of reinforcement learning parameters on behavioral performance and neural oscillations, we aim to explore whether the mechanisms underlying semantic and syntactic processing differ between linguistic and non-linguistic symbols. Our findings underscore the greater complexity of semantic processing in language, which demands more cognitive resources and engages slower, more deliberative processes. These patterns were reflected by slower response times and a decrease in beta-band power as prediction error signals increased. In contrast, syntactic processing in language—unlike in symbolic tasks—benefited from inherent structural cues, as shown by an increase in beta-band power as prediction error signals grew. These findings provide novel insights into the distinct cognitive and neural mechanisms underlying inherent language rule processing and artificially-created symbolic rule processing within a reinforcement learning paradigm.</div></div>","PeriodicalId":55372,"journal":{"name":"Biological Psychology","volume":"199 ","pages":"Article 109081"},"PeriodicalIF":2.7000,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biological Psychology","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0301051125000997","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"BEHAVIORAL SCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

Learning linguistic rules is crucial for human cognition, and recent studies have demonstrated that reinforcement learning modeling can effectively simulate rule learning in non-linguistic symbol systems. In this study, we use reinforcement learning to model trial-by-trial dynamic processes of semantic and syntactic rule learning in linguistic symbols (i.e., words in an artificial language) and non-linguistic symbols (i.e., shapes). By analyzing the effects of reinforcement learning parameters on behavioral performance and neural oscillations, we aim to explore whether the mechanisms underlying semantic and syntactic processing differ between linguistic and non-linguistic symbols. Our findings underscore the greater complexity of semantic processing in language, which demands more cognitive resources and engages slower, more deliberative processes. These patterns were reflected by slower response times and a decrease in beta-band power as prediction error signals increased. In contrast, syntactic processing in language—unlike in symbolic tasks—benefited from inherent structural cues, as shown by an increase in beta-band power as prediction error signals grew. These findings provide novel insights into the distinct cognitive and neural mechanisms underlying inherent language rule processing and artificially-created symbolic rule processing within a reinforcement learning paradigm.
通过强化学习探索语言规则学习的特殊性:语义和句法的视角
语言规则的学习对人类认知至关重要,近年来的研究表明,强化学习建模可以有效地模拟非语言符号系统中的规则学习。在本研究中,我们使用强化学习来模拟语言符号(即人工语言中的单词)和非语言符号(即形状)中语义和句法规则学习的逐试动态过程。通过分析强化学习参数对行为表现和神经振荡的影响,我们旨在探讨语言和非语言符号之间语义和句法加工的机制是否存在差异。我们的发现强调了语言中语义处理的复杂性,这需要更多的认知资源,需要更慢、更慎重的过程。这些模式反映在较慢的响应时间和随着预测误差信号的增加而降低的β波段功率上。相反,与符号任务不同,语言中的句法处理受益于固有的结构线索,正如预测错误信号增加时β波段功率的增加所显示的那样。这些发现为在强化学习范式中固有语言规则处理和人工创建的符号规则处理的独特认知和神经机制提供了新的见解。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Biological Psychology
Biological Psychology 医学-行为科学
CiteScore
4.20
自引率
11.50%
发文量
146
审稿时长
3 months
期刊介绍: Biological Psychology publishes original scientific papers on the biological aspects of psychological states and processes. Biological aspects include electrophysiology and biochemical assessments during psychological experiments as well as biologically induced changes in psychological function. Psychological investigations based on biological theories are also of interest. All aspects of psychological functioning, including psychopathology, are germane. The Journal concentrates on work with human subjects, but may consider work with animal subjects if conceptually related to issues in human biological psychology.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信