神经动力学中的协同调制途径可实现稳健的任务包装

Giacomo Vedovati, ShiNung Ching
{"title":"神经动力学中的协同调制途径可实现稳健的任务包装","authors":"Giacomo Vedovati, ShiNung Ching","doi":"arxiv-2408.01316","DOIUrl":null,"url":null,"abstract":"Understanding how brain networks learn and manage multiple tasks\nsimultaneously is of interest in both neuroscience and artificial intelligence.\nIn this regard, a recent research thread in theoretical neuroscience has\nfocused on how recurrent neural network models and their internal dynamics\nenact multi-task learning. To manage different tasks requires a mechanism to\nconvey information about task identity or context into the model, which from a\nbiological perspective may involve mechanisms of neuromodulation. In this\nstudy, we use recurrent network models to probe the distinctions between two\nforms of contextual modulation of neural dynamics, at the level of neuronal\nexcitability and at the level of synaptic strength. We characterize these\nmechanisms in terms of their functional outcomes, focusing on their robustness\nto context ambiguity and, relatedly, their efficiency with respect to packing\nmultiple tasks into finite size networks. We also demonstrate distinction\nbetween these mechanisms at the level of the neuronal dynamics they induce.\nTogether, these characterizations indicate complementarity and synergy in how\nthese mechanisms act, potentially over multiple time-scales, toward enhancing\nrobustness of multi-task learning.","PeriodicalId":501517,"journal":{"name":"arXiv - QuanBio - Neurons and Cognition","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Synergistic pathways of modulation enable robust task packing within neural dynamics\",\"authors\":\"Giacomo Vedovati, ShiNung Ching\",\"doi\":\"arxiv-2408.01316\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Understanding how brain networks learn and manage multiple tasks\\nsimultaneously is of interest in both neuroscience and artificial intelligence.\\nIn this regard, a recent research thread in theoretical neuroscience has\\nfocused on how recurrent neural network models and their internal dynamics\\nenact multi-task learning. To manage different tasks requires a mechanism to\\nconvey information about task identity or context into the model, which from a\\nbiological perspective may involve mechanisms of neuromodulation. In this\\nstudy, we use recurrent network models to probe the distinctions between two\\nforms of contextual modulation of neural dynamics, at the level of neuronal\\nexcitability and at the level of synaptic strength. We characterize these\\nmechanisms in terms of their functional outcomes, focusing on their robustness\\nto context ambiguity and, relatedly, their efficiency with respect to packing\\nmultiple tasks into finite size networks. We also demonstrate distinction\\nbetween these mechanisms at the level of the neuronal dynamics they induce.\\nTogether, these characterizations indicate complementarity and synergy in how\\nthese mechanisms act, potentially over multiple time-scales, toward enhancing\\nrobustness of multi-task learning.\",\"PeriodicalId\":501517,\"journal\":{\"name\":\"arXiv - QuanBio - Neurons and Cognition\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-08-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - QuanBio - Neurons and Cognition\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2408.01316\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - QuanBio - Neurons and Cognition","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2408.01316","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

了解大脑网络如何同时学习和管理多个任务,是神经科学和人工智能领域都感兴趣的问题。在这方面,理论神经科学领域最近的一条研究主线是研究递归神经网络模型及其内部动力学如何影响多任务学习。要管理不同的任务,就需要一种机制来向模型传递有关任务特征或背景的信息,从生物学的角度来看,这可能涉及神经调节机制。在这项研究中,我们利用递归网络模型,从神经元兴奋性和突触强度两个层面,探究了神经动力学的两种情境调控形式之间的区别。我们从功能结果的角度描述了这些机制的特征,重点关注它们对语境模糊性的稳健性,以及相关的将多个任务打包到有限规模网络中的效率。我们还证明了这些机制在其诱导的神经元动力学水平上的区别。这些特征共同表明,这些机制在如何发挥作用方面具有互补性和协同性,可能在多个时间尺度上发挥作用,从而提高多任务学习的稳健性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Synergistic pathways of modulation enable robust task packing within neural dynamics
Understanding how brain networks learn and manage multiple tasks simultaneously is of interest in both neuroscience and artificial intelligence. In this regard, a recent research thread in theoretical neuroscience has focused on how recurrent neural network models and their internal dynamics enact multi-task learning. To manage different tasks requires a mechanism to convey information about task identity or context into the model, which from a biological perspective may involve mechanisms of neuromodulation. In this study, we use recurrent network models to probe the distinctions between two forms of contextual modulation of neural dynamics, at the level of neuronal excitability and at the level of synaptic strength. We characterize these mechanisms in terms of their functional outcomes, focusing on their robustness to context ambiguity and, relatedly, their efficiency with respect to packing multiple tasks into finite size networks. We also demonstrate distinction between these mechanisms at the level of the neuronal dynamics they induce. Together, these characterizations indicate complementarity and synergy in how these mechanisms act, potentially over multiple time-scales, toward enhancing robustness of multi-task learning.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信