受定向位置细胞启发的矢量导航。

Harrison Espino, Jeffrey L Krichmar
{"title":"受定向位置细胞启发的矢量导航。","authors":"Harrison Espino, Jeffrey L Krichmar","doi":"10.1007/978-3-031-71533-4_3","DOIUrl":null,"url":null,"abstract":"<p><p>We introduce a navigation algorithm inspired by directional sensitivity observed in CA1 place cells of the rat hippocampus. These cells exhibit directional polarization characterized by vector fields converging to specific locations in the environment, known as ConSinks [8]. By sampling from a population of such cells at varying orientations, an optimal vector of travel towards a goal can be determined. Our proposed algorithm aims to emulate this mechanism for learning goal-directed navigation tasks. We employ a novel learning rule that integrates environmental reward signals with an eligibility trace to determine the update eligibility of a cell's directional sensitivity. Compared to state-of-the-art Reinforcement Learning algorithms, our approach demonstrates superior performance and speed in learning to navigate towards goals in obstacle-filled environments. Additionally, we observe analogous behavior in our algorithm to experimental evidence, where the mean ConSink location dynamically shifts toward a new goal shortly after it is introduced.</p>","PeriodicalId":520536,"journal":{"name":"From animals to animats : proceedings of the ... International Conference on Simulation of Adaptive Behavior. International Conference on Simulation of Adaptive Behavior","volume":"14993 ","pages":"27-38"},"PeriodicalIF":0.0000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12031638/pdf/","citationCount":"0","resultStr":"{\"title\":\"Vector-Based Navigation Inspired by Directional Place Cells.\",\"authors\":\"Harrison Espino, Jeffrey L Krichmar\",\"doi\":\"10.1007/978-3-031-71533-4_3\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>We introduce a navigation algorithm inspired by directional sensitivity observed in CA1 place cells of the rat hippocampus. These cells exhibit directional polarization characterized by vector fields converging to specific locations in the environment, known as ConSinks [8]. By sampling from a population of such cells at varying orientations, an optimal vector of travel towards a goal can be determined. Our proposed algorithm aims to emulate this mechanism for learning goal-directed navigation tasks. We employ a novel learning rule that integrates environmental reward signals with an eligibility trace to determine the update eligibility of a cell's directional sensitivity. Compared to state-of-the-art Reinforcement Learning algorithms, our approach demonstrates superior performance and speed in learning to navigate towards goals in obstacle-filled environments. Additionally, we observe analogous behavior in our algorithm to experimental evidence, where the mean ConSink location dynamically shifts toward a new goal shortly after it is introduced.</p>\",\"PeriodicalId\":520536,\"journal\":{\"name\":\"From animals to animats : proceedings of the ... International Conference on Simulation of Adaptive Behavior. International Conference on Simulation of Adaptive Behavior\",\"volume\":\"14993 \",\"pages\":\"27-38\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12031638/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"From animals to animats : proceedings of the ... International Conference on Simulation of Adaptive Behavior. International Conference on Simulation of Adaptive Behavior\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1007/978-3-031-71533-4_3\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/9/7 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"From animals to animats : proceedings of the ... International Conference on Simulation of Adaptive Behavior. International Conference on Simulation of Adaptive Behavior","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/978-3-031-71533-4_3","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/9/7 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

我们介绍了一种受大鼠海马CA1位置细胞方向敏感性启发的导航算法。这些细胞表现出定向极化,其特征是矢量场会聚到环境中的特定位置,称为consink[8]。通过在不同方向上从一群这样的细胞中取样,可以确定向目标行进的最佳矢量。我们提出的算法旨在模拟这种机制来学习目标导向的导航任务。我们采用了一种新的学习规则,该规则将环境奖励信号与资格跟踪相结合,以确定细胞方向灵敏度的更新资格。与最先进的强化学习算法相比,我们的方法在学习中表现出卓越的性能和速度,可以在充满障碍的环境中导航到目标。此外,我们在算法中观察到与实验证据类似的行为,其中平均ConSink位置在引入后不久动态地向新目标移动。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Vector-Based Navigation Inspired by Directional Place Cells.

We introduce a navigation algorithm inspired by directional sensitivity observed in CA1 place cells of the rat hippocampus. These cells exhibit directional polarization characterized by vector fields converging to specific locations in the environment, known as ConSinks [8]. By sampling from a population of such cells at varying orientations, an optimal vector of travel towards a goal can be determined. Our proposed algorithm aims to emulate this mechanism for learning goal-directed navigation tasks. We employ a novel learning rule that integrates environmental reward signals with an eligibility trace to determine the update eligibility of a cell's directional sensitivity. Compared to state-of-the-art Reinforcement Learning algorithms, our approach demonstrates superior performance and speed in learning to navigate towards goals in obstacle-filled environments. Additionally, we observe analogous behavior in our algorithm to experimental evidence, where the mean ConSink location dynamically shifts toward a new goal shortly after it is introduced.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信