Signal-Dependent Planning Noise Reduces Task Interference by Assisting in the Formation of Stable Motor Primitives in a Neural Network Model of Muscle Coordination Learning

IF 2.1 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Neural Computation Pub Date : 2026-04-30 Epub Date: 2026-03-08 DOI:10.1162/NECO.a.1512
Daniel W. Feng;David J. Reinkensmeyer;Juan C. Perez-Ibarra
{"title":"Signal-Dependent Planning Noise Reduces Task Interference by Assisting in the Formation of Stable Motor Primitives in a Neural Network Model of Muscle Coordination Learning","authors":"Daniel W. Feng;David J. Reinkensmeyer;Juan C. Perez-Ibarra","doi":"10.1162/NECO.a.1512","DOIUrl":null,"url":null,"abstract":"In human motor coordination, learning to coactivate multiple muscles at once to achieve distinct target combinations of forces or tasks remains a fundamental area of study. Task interference, where training on one task degrades performance on previously learned tasks, can slow motor learning. However, the neural mechanisms that reduce interference are not fully understood. We hypothesized that the structure of planning noise, specifically its signal-dependent nature, significantly shapes learning dynamics and limits interference within motor learning systems that rely on variability for exploration. To test this hypothesis, we developed a three-layer neural network model of muscle coordination informed by key neuroanatomical and neurophysiological principles and simulated learning for producing various combinations of muscle forces. Synaptic weights were stochastically altered from trial to trial with either fixed-variance planning noise (FVPN), where each connection's variance was fixed during learning, or signal-dependent planning noise (SDPN), where noise variance depended on the neuron population activity. Weights were reinforced when they reduced output error relative to target forces. An execution noise term, applied to the motor output, modeled peripheral motor variability. However, the learning rule was not informed about how much of the output corresponded to peripheral or central variability. Our results showed that SDPN improved both the rate and accuracy of multitask learning by reducing task interference compared to FVPN across network sizes, training schedules, and execution noise levels. SDPN achieved this by concentrating neural plasticity within the neuron populations engaged by the current task rather than modifying the entire network. This signal-dependent plasticity allowed multiple motor primitives to form, stabilize, and be reused for new tasks. The model replicated the well-documented benefit of interleaved versus blocked training in motor learning. As a computational proof of concept, this work suggests that SDPN can benefit multitask motor training by facilitating the formation of motor primitives.","PeriodicalId":54731,"journal":{"name":"Neural Computation","volume":"38 5","pages":"783-822"},"PeriodicalIF":2.1000,"publicationDate":"2026-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neural Computation","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11513270/","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/3/8 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

In human motor coordination, learning to coactivate multiple muscles at once to achieve distinct target combinations of forces or tasks remains a fundamental area of study. Task interference, where training on one task degrades performance on previously learned tasks, can slow motor learning. However, the neural mechanisms that reduce interference are not fully understood. We hypothesized that the structure of planning noise, specifically its signal-dependent nature, significantly shapes learning dynamics and limits interference within motor learning systems that rely on variability for exploration. To test this hypothesis, we developed a three-layer neural network model of muscle coordination informed by key neuroanatomical and neurophysiological principles and simulated learning for producing various combinations of muscle forces. Synaptic weights were stochastically altered from trial to trial with either fixed-variance planning noise (FVPN), where each connection's variance was fixed during learning, or signal-dependent planning noise (SDPN), where noise variance depended on the neuron population activity. Weights were reinforced when they reduced output error relative to target forces. An execution noise term, applied to the motor output, modeled peripheral motor variability. However, the learning rule was not informed about how much of the output corresponded to peripheral or central variability. Our results showed that SDPN improved both the rate and accuracy of multitask learning by reducing task interference compared to FVPN across network sizes, training schedules, and execution noise levels. SDPN achieved this by concentrating neural plasticity within the neuron populations engaged by the current task rather than modifying the entire network. This signal-dependent plasticity allowed multiple motor primitives to form, stabilize, and be reused for new tasks. The model replicated the well-documented benefit of interleaved versus blocked training in motor learning. As a computational proof of concept, this work suggests that SDPN can benefit multitask motor training by facilitating the formation of motor primitives.
在肌肉协调学习的神经网络模型中,信号依赖的规划噪声通过协助形成稳定的运动原语来减少任务干扰。
在人类运动协调中,学习同时激活多个肌肉以实现不同的目标力量或任务组合仍然是一个基本的研究领域。任务干扰,即在一个任务上的训练降低了先前学习任务的表现,可以减缓运动学习。然而,减少干扰的神经机制尚不完全清楚。我们假设,规划噪声的结构,特别是其信号依赖性,显著地塑造了学习动态,并限制了运动学习系统中依赖于可变性进行探索的干扰。为了验证这一假设,我们开发了一个基于关键神经解剖学和神经生理学原理的三层肌肉协调神经网络模型,并模拟了产生各种肌肉力量组合的学习。通过固定方差规划噪声(FVPN)(其中每个连接的方差在学习期间是固定的)或信号依赖规划噪声(SDPN)(其中噪声方差取决于神经元群体活动),突触权重在每次试验中随机改变。当权重减少相对于目标力的输出误差时,权重就会得到加强。一个执行噪声项,应用于电机输出,模拟外围电机可变性。然而,学习规则没有被告知有多少输出对应于外围或中心变异性。我们的研究结果表明,与FVPN相比,通过减少跨网络规模、训练计划和执行噪声水平的任务干扰,svpn提高了多任务学习的速度和准确性。SDPN通过将神经可塑性集中在参与当前任务的神经元群中而不是修改整个网络来实现这一点。这种信号依赖的可塑性允许多个运动原语形成、稳定并在新任务中重用。该模型复制了充分证明的运动学习中交错训练与阻断训练的好处。作为概念的计算证明,这项工作表明,SDPN可以通过促进运动原语的形成而有益于多任务运动训练。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Neural Computation
Neural Computation 工程技术-计算机:人工智能
CiteScore
6.30
自引率
3.40%
发文量
83
审稿时长
3.0 months
期刊介绍: Neural Computation is uniquely positioned at the crossroads between neuroscience and TMCS and welcomes the submission of original papers from all areas of TMCS, including: Advanced experimental design; Analysis of chemical sensor data; Connectomic reconstructions; Analysis of multielectrode and optical recordings; Genetic data for cell identity; Analysis of behavioral data; Multiscale models; Analysis of molecular mechanisms; Neuroinformatics; Analysis of brain imaging data; Neuromorphic engineering; Principles of neural coding, computation, circuit dynamics, and plasticity; Theories of brain function.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书